Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5

VR with Stereo Camera Feed

#1
Hello, 

Does Robodk support stereoscopic cameras for streaming/viewing real-time stereo camera feeds on a VR headset? The camera feed would replace the normal 3D view of the workspace and just show the video feed.
#2
What do you mean by streaming stereo camera feeds? RoboDK supports VR headsets. We use Valve's OpenVR API.
#3
(03-04-2024, 10:36 AM)Albert Wrote: What do you mean by streaming stereo camera feeds? RoboDK supports VR headsets. We use Valve's OpenVR API.

"Streaming stereo camera feeds" as in taking the live stereo video output from something like the Stereopi or the Karmin3D stereo vision camera and then using that as input to a VR headset, but through RoboDK as an availble viewpoint or option if using the VR functionality. The viewpoint would be fixed and not controllable from the VR controls, of course (unless other hardware for matching head movement to camera movement was added, but that's beyond the scope of this question). 

If this is possible, it could potentially be coupled with the AR functionality of displaying the robot in a real environment using machine vision markers, such that the virtual robot could be rendered in real-time on top of the real robot.
#4
The foundation to do such a thing is available, but we do not offer it as a built-in solution.
You can retrieve a livestream of 2 cameras (in a stereo arrangement) in RoboDK through the API and appose them on another livestream.

We do have sample code in our Python API documentation:
https://robodk.com/doc/en/PythonAPI/exam...ive-stream

You can check out this App as well, which uses OpenCV to process simulated and hardware 2D cameras:
https://robodk.com/addin/com.robodk.app....singeditor

For further customization, please contact us at info@robodk.com mentioning my name
Please read the Forum Guidelines before posting!
Find useful information about RoboDK by visiting our Online Documentation.
  




Users browsing this thread:
1 Guest(s)