MO-SYS VP Pro XR, Manual

Page 1: ...www mo sys com 0 MoSys VPPro XR manual ...

Page 2: ...lignment 5 10 MoSysCameraXR 21 Summary flowchart 10 Test patterns 21 Colour calibration procedure 22 Render nodes hardware setup nDisplay 11 XR controller panel 23 Network 11 Add AR objects 23 Synchronisation 11 FAQ 24 NVIDIA software synchronisation 12 13 Render nodes setup 14 17 nDisplay actor setup in screenshots 14 Livelink 15 nDisplay level 15 Defining LED screens 15 Mesh builder 15 Launching...

Page 3: ...r a reliable and precise camera tracking essential for XR to work Before installation In order to speed up the installation it is recommended to take the following steps Measure the height of the LED volume from the bottom to top row of the pixels Usually the number of the rendering nodes corresponds to the number of LED processors The maximum resolution available from one node is 3840x2160 px Div...

Page 4: ...ine 4 27 2 Nvidia Quadro Sync Card II if using hardware sync included 3 VPPro XR plugin only on the Primary Render Node Global Settings After creating a new project in Unreal Editor open XR Controller panel and click Auto Configure Project Then restart the editor StarTracker data output Set up StarTracker to send data to w outputs XR Engine here having IP of 192 168 99 72 and Primary Render Node I...

Page 5: ...des The tracking won t be just passed through Unreal s Multi user if using in a configuration with a dedicated editor computer 2 The network is solely used for tracking updates triggering nDisplay and events There is no image streaming over network Network drives Render nodes are mapped as network drives on XR Engine so it s easier to distribute the project across Normally most of the editing can ...

Page 6: ...ed on both the XR Engine to mask the LEDs and the rendering nodes to define the nDisplay configuration New UE project Let s start on the XR Engine Create a new empty UE project Once successfully installed the plugin make sure the following steps are completed pages 12 13 VP Pro project settings are set to the correct framerate HasTimecodeSync is unchecked and compositing mode is set to XR Video in...

Page 7: ...RMaskBP object and click Assign LED plane Go through the steps indicated in Mesh Builder section on page 5 and 6 If there are multiple screens just place more XRMaskBP objects and repeat the procedure Delays correction with Timed Data Monitor Open the panel from Window Developer Tools If it s not present enable the Timed Data Monitor plugin Use Time Correction value in seconds to delay the trackin...

Page 8: ...nes near image edges usually indicates problems with lens calibration Displacement of the cone when camera has moved in position usually indicates problems with StarTracker auto aligner best to centre the camera on the cone Mind that when cones are selected the yellow outline shows their undistorted position which is not of interest here It s the actual red cones that should be looked at Lens zoom...

Page 9: ...pivot point on one of the corners of the mesh Make an empty actor place it under MoSysStage and snap its position to the bottom left LED mesh To do it click on the sphere gizmo of the empty actor and press v key It will then offer snap points Now parent the XRMaskBP to the empty actor Snap the empty actor to the position of the bottom left cone or copy its position Use the pan rotation of the empt...

Page 10: ...orking with simple planes make sure the static mesh is set to Plane and not plane_1x1 Copy the parent empty actor s transform on nDisplayTransform and the XRMaksBP s transform onto nDisplayScreen Go back to the main viewport and on Mesh Builder load the marker cones by clicking Load from file with Load parent transform checked Compare if the cones are aligned with the nDisplay screen corners Confi...

Page 11: ...www mo sys com 10 Quick start guide and geometry alignment The flow chart shows the process of setting up nDisplay with set extensions ...

Page 12: ... only one display connected to it the LED processor If more than one are necessary configure them via Nvidia Mosaic Synchronisation Synchronisation of the LED screen output is a key to a seamless shoot It is crucial that all the sections of the volume are rendering at the same time so there is no tearing between sections This is achieved by using an Nvidia Quadro Sync Card II Every Render node has...

Page 13: ...tting up EDID Once you have everything setup in the Nvidia control panel with regards to sync resolutions and colour space etc it is useful to export the current EDID and then load it from a file find the instructions here Alternatively you can set your EDID via your switcher such as a Lightware matrix It s important to note that incorrectly configured EDIDs can half the performance of nDisplay wh...

Page 14: ...om 13 NVIDIA software synchronisation Bouncing ball test Prepare the nDisplay level so the ball is positioned in between the nDisplay screens After launching in Switchboard the ball with bounce quickly up and down ...

Page 15: ...www mo sys com 14 Render nodes setup nDisplay Example nDisplay config actor setup described on next page ...

Page 16: ...ove the content levels there so it fits the current shoot Below is an example of the levels setup Defining LED Screens Depending on the number and shape of the LED volumes the virtual layout needs to be adjusted Usually one Node is responsible for one viewport Edit nDisplayRootActorST to define the viewports Refer to Step 3 and the screenshots on previous page Top part of the nDisplay config actor...

Page 17: ...cutive corners of the screen through crosshair and click on corresponding store buttons 5 Click Calculate and move mesh to fit the plane in place 6 Optionally check LED screen levelled to only use 2 bottom corners The calculation assumes the screen is perfectly vertical Launching See Step 4 Launching Your Project with nDisplay in In Camera VFX Quick Start to launch the project on the LED screens U...

Page 18: ...ine so the source on the left is a local directory of the UE project and the destination on the right is the network drive Set synchronisation option to update Click compare to see the differences and Synchronize to update the destination Loading from network drive Alternatively especially for testing a user can use a project that is located in Windows shared folder visible to all rendering nodes ...

Page 19: ...nder Node USB port Configure the serial port in Device Manager and take note of the COM port number Apply the following settings Bits per second 115200 Data bits 8 Parity none Stop bits 1 Flow control Xon Xoff Advanced settings BM Options Latency Timer 2 msec Preston FIZ Setup Setting up the FIZ system is out of the scope of this manual Please refer to Preston s documents for more information It c...

Page 20: ...fig blueprint set the collision presets in collision section on the mesh es used with viewports as follows Collision Presets set to Custom and below Object Type is set to LED Finally set Manual Focus to true to enable Hand control to set the focus distance There is a sample level with the component already on the camera It s nDisplayLensControl in MoSysVPPro Content nDisplay LensControl Other Rend...

Page 21: ...video SDI inputs Set it up in Mo Sys Video Controller panel page 19 in VPPro documentation Mo Sys VP Pro Settings In project settings Mo Sys VP pro Select Post Process for XR as the Mode Define the image framerate and resolution Uncheck Has Timecode Sync Insert the IP address of the Primary Render Node in Multi Engine section Refer to page 6 in VPPro documentation Other Settings and Notes Verify S...

Page 22: ...py the transform of the mask from the defined mesh during Render Node setup nDisplay Alternatively use the Mesh Builder to retrieve the transform again It is recommended to scale the mask slightly down to allow a margin for smooth blend between the LED screen and the extended view nDisplay config stays the same don t scale down the mesh there MoSysCameraXR Apply the created livelink subject onto t...

Page 23: ...pattern on the XR engine should be scaled up so it is visible as set extension together with the pattern on the LED screen Depending on the selected pattern a user can move the PatternBoardBP in the scene Colour calibration procedure It is advisable to use an SDI monitor with an option to show a vectorscope and a waveform Start from framing the image so both LED and the extension is visible E g ti...

Page 24: ...ask visibility in editor Bringing test patterns Recreate PP materials on the camera Nominating objects to be visible in front of the XR mask LED screen Toggle as AR Adjusting colour correction If in play mode click Refresh button to be able to change parameters dynamically Add AR objects Actors can be nominated to be visible as AR in front of the LED screen This can be done from the XRController p...

Page 25: ...have a collision preset set to LED How can I map a network drive Enable file sharing on local networks from the network and sharing centre On each render node create a folder in the same directory normaly D Shared and make it a shared folder Give read write privileges to the user who will share the folder by right clicking the folder and going into Properties Sharing Advanced Sharing From the XREn...

Page 26: ...www mo sys com January 2022 For more information sales mo sys com www mo sys com ...