matsemann / oculus-fpv

Code for TPG4850 eksperter i team vr-landsbyen

Welcome to my corner of GitHub. I mostly spend my time on here making fun little projects or workshops where I explore some area, often related to algorithms. Some things to check out:

Impossible objects > 250 ⭐
Using math to make optical illusions, I have showcased these on Deichmanske/Oslo Skaperfestival and various other occasions.

Master thesis
Using evolutionary multiobjective optimization algorithms to evolve lacing patterns

Some workshops I've made for others to play with:

• Boids workshp: Program your own boid
• Image workshop: Implement various image algorithms, most notably the cool seam carving algorithm
• Max flow workshop: Implement it and then use it to solve various problems
• WalkingEa workshop: Implement parts of a genetic algorithm and teach 2d objects to walk

Other fun stuff:

• Algorithm-problems: My solutions to various problems / competitions (Kattis, Advent of Code)
• Declaraoids 70 ⭐: 1. april joke, where I used javascript ES6 proxies to make self-implementing code
• Oculus FPV > 450 ⭐: Old project where drone+oculus was combined

oculus-fpv's Issues

DirectShow and Hauppauge USB Link-2

Hello,

I am trying to capture the digitized video from the Hauppauge USB Link-2 device in DirectShow Graph editor, however, I can't find the Cx23100 Crossbar filter or the Video Capture filter. I can see a bunch of other filters in there from Hauppauge, just not these two. Could you guide me as to where I can find them? Thank you.

Regards
Deepak

how to build this project

It seems this project runs in windows.I guess it could build by visual studio.
Is there any document shows how to build it?

can I try it out, in Trondheim?

Dear Mats,

I saw your video regarding the Occulus Rift / DJI drone project. I'm in Trondheim right now, preparing for the http://metamorf.no/ exhibiton. I wonder if it's possible to try out your Rift / Drone setup during this week?

best regards,

Akos Maroy
[email protected]

Compatible to other devices?

Hi,
I'm very interested in 3D glasses. But as they are expensive and often hardware limited, I wonder if your idea would be portable to android, using a Durovis or Open Dive. All neccessary sensors for headtracking are on most mobilephones which are suitable for the Dive. So it's a matter or streaming software and getting the sensor results to your rc copter.
Open/Durovis Dive is using the a SDK which depents on Unity.
So what do you think? Might it be possible to make your invention compatible with Dive?

Instructions for a dumb person

Hi,
I just stumbled across this project and i think it is great, as the owner of both an Oculus rift DK2 and a decent hexacopter I am very excited to say the least.
I am not a technological illiterate, but then again i'm not particularly gifted either.
I don't really understand how you would setup all the firmware on the computer. I am struggling to understand: what you do with the two video inputs after they reach your computer and how the firmware controls the servos with the head tracking.
Also at what spacing the two cameras have to be at to produce the right visual effect, as talked about in the reports.
It might just be me but I cannot see anywhere in the files how to configure it, i know all the code for it is there but i don't know how to set it up and how to configure it after that, so maybe someone who has done it could give me a couple of tips.
If a particularly generous individual could produce some instructions i would be over the moon.
I see that this hasn't been active since last year so i will email the authors as well.
Thanks allot
Jacob

HDMI and high FPS

What are your thoughts on using something like a GoPro Hero3+ (or higher), which support both 1080 HDMI video and 120 frames per second?

I don't know offhand of a way to input two HDMI video signals to a computer (even a desktop PC). Would it have to be converted to USB (treated like a webcam)? Seems like that would degrade the video quality, but then the Oculus doesn't actually render 1080 video.

The possibility of higher fps seems more interesting. The video could still be converted to analog USB, but having 120 fps should help with the responsiveness and immersiveness of the feed, I suspect.

Any thoughts on whether such hardware would work and whether the rendering pipeline would preserve a higher frame rate?

How do I contact the team to get more information on this project

Oculus vr tec.

Dear sir could i use the oculus drift kit2 with parrot bebop skycontroler with useing ur cods without usin pc or hıw can i use it as costumer face

Cameras

Hi,
Just thought of another thing, to cut down on costs, weight and battery consumption would it be possible to use the current system but with a stereoscopic 3d fpv camera. Something like this: http://www.getfpv.com/nerdcam3d-stereoscopic-3d-fpv-camera.html ,but yet still use the same tx/rx and analog converter to input into the computer.
Thanks
Jacob

Video Sync issues? Other questions

Hello, I must say this is a great project!

I wanted to know if you needed to sync the videos from the two cameras before streaming them onto the Oculus. Isn't there different sort of latency for both the camera streams? I would imagine that it might create some frame mismatch between the two eye streams.

Also, what sort of software platform did you use to composite the two digital video streams together, and add the required barrel distortion? I am not experienced with the Oculus SDK. Does it already provide functions for it? Thank you for your help!

Regards
Deepak

Update Source.cpp to use more recent Oculus SDK

I had a devil of a time trying to compile the source, until I realized that it's built against the v0.2.x SDK. Once I switch to the older ovr_sdk_win_0.2.5c.zip SDK files, I was able to get the project to compile pretty easily.

The breaking changes are detailed in the v0.4 SDK Developer Guide (pdf) in Appendix A.1 Changes since release 0.2.

I realize you probably don't have the bandwidth to make the updates (and presumably later SDKs may break backwards compatibility as well), but I'm logging the issue in case others struggle with this as well. Would be simple enough to add a note to the readme that the project is meant to be built against the v0.2 SDK.

Can I get the English version of the project report?

I have a plan to follow your project. Because I'm software engineer, I fill a lack of information such as hardware block diagram, cabling, power, etc. Do you give me the information with several real pictures?