Skip to content

Instantly share code, notes, and snippets.

View schen2315's full-sized avatar

Song Chen schen2315

  • Brooklyn, NY
View GitHub Profile
@schen2315
schen2315 / README.md
Last active January 6, 2022 12:42
Streaming ZED onto a Gear VRf app

REU Site Umass Lowell Research part 2

Viewing ZED camera live stream through a Gear VRf app

I was tasked with sending a live stream 3D video from the ZED camera to a Gear VR app. More accurately, I would need to process the ZED stream on the Jetson TX2 and send that over to a phone (Samsung Galaxy S8) and view it through the Gear VR headset. Don't ask me why I had to do this (I've been asking and haven't received any concrete answers ...). I'll update with the academic paper assoiciated with this project soon. Anyway, here's a brief description of all the equipment I used just in case.

  • Gear VR - It's basically an oculus rift but completely powered by the phone. A compatible phone is plugged into the headset through USB type-C or by USB type-B and placed directly in front of the lens.
  • ZED Camera - This is one beast of a camera, currently costing ~$400. It's actually two cameras, as it captures 2 images that are slightly offset from one another. This way, the ZED can do depth sensing, 3D mappin
@schen2315
schen2315 / README.md
Last active June 10, 2019 10:12
Recording ZED video on the JTX2

REU Site Umass Lowell Research Part 1

Recording video using ZED on the JTX2

The goal was to capture video using the ZED on the TX2 without also capturing depth sensing information. The ZED sdk does not allow you to seperately capture video from the ZED, so gstreamer was used. I was able to capture 30fps @1080p from the ZED.

Setting up the Jetson TX2

Flashing the TX2 using Jetpack:

After recieving the Jetson TX2 I connected it to power with the AC adapter, plugged it into an hdmi display TV and powered it on. I also connected a usb hub to the TX2 and on the usb hub connected a mouse, keyboard. The antennae are neccessary, otherwise the TX2 will have poor wifi reception. Upon booting up the TX2, connecting onto my home network, and rebooting, I get only a blue screen from the TX2.

I followed the instructions from [https://devtalk.nvidia.com/default/topic/1000569/jetson-tx2/tx2-blue-screen-after-booting/](https://devtalk.nvidia.com/default/topic/1000569/jetson-tx2/tx2-blue-screen-after-booti