Apps & websites

A 3D tool that matches photo bursts to footage from a hot-shoe GoPro

At Fleet Week, a GoPro on the camera's hot shoe filmed each shoot through a 400-800mm lens. Codex built a three.js viewer that lines bursts up with the recorded shutter sounds, places footage in 3D from motion telemetry, levels the horizon and outlines each photo's framing.

View on X
258likes
15reposts
97saves
16Kviews
Role
Designer and technologist
Posted
Erik Natzke@Natzke

📹 Video as Photo Assistant 📷

( ( audio ) )

At this year’s Fleet Week, I mounted a GoPro to the hot shoe of my Sony A7RVI while shooting with a 400–800mm lens.

After importing the footage, I asked Codex to build a viewer that synchronized photo bursts with the shutter sounds captured in the video. Using Three.js and the GoPro’s motion telemetry, we placed the footage in 3D and added horizon-leveling assistance.

To approximate where each photo was framed, we added a rectangle sized from its focal length and image dimensions, with compensation for the GoPro’s stabilization.

Makes me wish the camera had a built-in context camera so more of my capture sessions could be reviewed this way.

It’s such a delight to build bespoke creative tools like this.

#Codex #Astra @OpenAI #Prototype @Adobe @threejs #CreativeTools @GoPro

View on X
Still from the video

More in Apps & websites

Touch ID enrolled from Linux on a wiped T2 Mac, after nine yearsApps & websites@macintogdev2992797
Age of Empires IV running at 70-150 fps on Apple SiliconApps & websites@marc_ibrahim6.5K3131.9K
60 more three.js components added to an open-source UI libraryApps & websites@MengTo1.1K961.2K
Camp Nou rebuilt in 3D with 86,964 selectable seats and their viewsApps & websites@thebuggeddev1.5K105917