iFacialMocap (iPhone App)

info

Under Construction

This guide will walk-through setting up the iFacialMocap iOS app and the corresponding VRCFT tracking module.

Setup

info

Ensure that your Apple device is connected to the same network as your computer!

1. Install one of the following apps on your Apple device
   • The original ($): iFacialMocap
   • Free trial version: iFacialMocapTr
   • "Newer" app ($ - streaming license for "Other/Unity"): FaceMotion3D
2. Start VRCFaceTracking and install the "iFacialMocap" VRCFT module from the VRCFaceTracking Module Registry.
3. Go to the Output tab in VRCFT and look for the message printing our your computer's local IP address
   • Verify that the IP address is the local IP of your computer on your local network. See [INSERT LINK HERE] for more general networking tips.
4. Open the iFacialMocap app on your Apple device, tap the gear in the top right to open settings, then tap the Destination IP address option under Destination setting. Enter in the local IP address of your computer as found in step 3
   • If you are using FaceMotion3D, tap the "Live" button in the top left, set the Live Stream type to "Other", and enter in the local IP address of your computer in the provided field
5. The first time setting this up, your phone should ask if you want to give permission for the iFacialMocap/FaceMotion3D app to access your Local Network. Make sure to tap "Allow", otherwise the app will be completely blocked from sending data!
6. Return to the main iFacialMocap screen. Whenever you are in this screen, the app should be streaming data.
   • If you are using FaceMotion3D, simply tap the "Connect" button
7. Verify that the module has initialized in VRCFT

Module

Interested in the source code? Check out the iFacialMocap module source repository

Using iFacialMocap / FaceMotion3D

Recentering

You can "zero out" your head's position and rotation values using the "look forward" (iFacialMocap) or "Reset" (FaceMotion3D) buttons at the bottom right the main screen. This is useful to help your avatar look straight forward when you look at the center of your screen, even if your phone is below, above, or to the side of your monitor.

1. Position your phone how you could like it to stay during use.
2. While looking forwards towards the center of your monitor (i.e. towards your VRC desktop cursor), tap the "look forward"/Reset button in the app
3. You should see the rotation of the demo face snap to face directly outwards from the screen, indicating that the head orientation has successfully been reset

Adjusting Multipliers and Smoothing

iFacialMocap and FaceMotion3D allow you to artificially adjust the tracked blendshape values streamed to VRCFT (or other software). Tap the "Settings" gear icon (top right in iFacialMocap, bottom left in FaceMotion3D)