Building Hollywood Motion Capture from Scratch

In this massive DIY engineering project, I build a professional-grade optical motion capture (mocap) system from scratch using 16 custom-designed cameras and Raspberry Pi compute modules. By engineering custom circuit boards, synchronizing 2.5kW infrared LED strobes, and writing high-speed computer vision software, this setup processes over 4 billion pixels per second. Watch how we achieve sub-millimeter 3D tracking accuracy for less than 1/10th the cost of Hollywood studio gear to animate 3D characters and VTubers. Thank you to NextPCB for sponsoring this project. Bring your electronics ideas to life by following this link: https://www.nextpcb.com/?code=MadeByD... And get a $500 SMT coupon for your first Rev 0 PCBA order: https://www.nextpcb.com/rev0-pcba Open Source Design Files: 3D Files: https://www.printables.com/model/1745863 Documentation / PCBs / Code: https://github.com/dennisss/dacha/blo... Want to buy a camera? https://forms.gle/kGWyutEj3ao1y2u86 Links: Safety Glasses I am Using (NoIR YG3 #52): https://www.noirinsight.com/yg3 Background Music (BGM): "DASHI - Sobayu" Precision Outdoor GPS: https://en.wikipedia.org/wiki/Real-ti... Drone Light Show Video:    • [4K 드론시점] 마지막 케데헌 드론쇼 앵콜 공연 @NetflixKoreaK...   VR FluxPose Video:    • FLUXPOSE: The Most Exciting New VR Hardwar...   AI Based Motion Capture: https://github.com/zju3dv/EasyMocap Street Fighter Mocap Video:    • Street Fighter 6 - Alex Motion Capture - B...   Sony Project Ace Robotics Video:    • Project Ace   Entry Level Professional Camera: https://optitrack.com/cameras/primex-... Bayer Filter Reference: https://en.wikipedia.org/wiki/Bayer_f... My PnP (pick and place) Machine: https://www.opulo.io/products/lumenpnp The PCB holders and oscilloscope probes I use: https://sensepeek.com/pcbite-kits Cheapest Raspberry Pi Board: https://www.digikey.com/en/products/d... Camera sensor we are using (AR0234): https://www.onsemi.com/products/senso... PoE Injector I am using: https://www.amazon.com/dp/B0D41XBXJ4 Time synchronization protocol (PTP): https://en.wikipedia.org/wiki/Precisi... Raspberry Pi 22-pin camera pinout (we use GPIO1): https://www.raspberrypi.com/documenta... PoE Power Limits Spec: https://en.wikipedia.org/wiki/Power_o... The IR LEDs we are using: https://look.ams-osram.com/m/59706141... Emissivity (for heatsink design): https://en.wikipedia.org/wiki/Emissivity Chapters: 0:00 Intro 0:47 Background 4:46 Retroreflection 5:59 Camera Sensor 14:21 Compute Board 18:02 Achieving Precision 22:16 Way too much IR light 26:15 Keeping this thing cool 28:50 Camera Assembly 30:49 Image Processing 36:15 Conclusion Corrections: 7:04 I cut some content from the video here about the Bayer filters due to inaccuracies to avoid confusing anyone. TLDR: The R/G/B filters in front of the sensor will typically reduce IR intensity by up to around 5% though the IR filter in the Lens is the more important to avoid issue.