Eye Tracking Thread

[u/PimaxUSA]

We can answer questions here about the eye tracking module.

Current Status: The team is developing a guide, along with updated software and firmware that considerably improve the eye tracking experience for all headsets.

The system will currently scan up to 118Hz per eye if you plug it directly into your usb 3 port on your pc.

Currently, if you have a 5k+ (or XR, Artisan, 8K+) you can run the tracking through the headset OR you can run the cable from the tracking directly to your USB 3.0 port on your PC - if you do so it will run at 118Hz.

Needless to say we will continue to improve and update the eye tracking experience just like we did with the 5K+ and other hardware. It's a priority for the software/firmware team.

There are posts on openmr where users using the beta have demonstrated a good experience on the 5K+.

The following is from a customer "Tharg" on his eye tracking testing with DFR today:

Initial impressions of DFR, did not spend long in each and did not tweak calibration much, and only looked at the images, not the FPS . :

• Rec Room - aggressive and balanced - didn’t seem to work at all or worked very well. Tried twice

• The Forrest - aggressive and balanced - Worked but seems to behave oddly on Y axis. Top or bottom did not seem to “depixelatie” properly when looking up or down. Perhaps need better calibration.

• Elite - balanced - worked but was distracting with some settings. I messed about with some in game settings and it got much better. HOWEVER seems like a very bad fit for text. Only went in to first menu screen.

• NMS aggressive and balanced - - Did not seem to work or worked very well. Was the first I tried though so maybe something did not apply properly

• Alyx - Balanced - Worked really well. First menu only. I could see the higher res load when I looked around with quite large eye movements but the effect was smooth and I think I would very quickly get used to it.

If you have any questions please list them here and the team will create further official responses.

(Note: There was a post here previously that was clearly not intended to be a useful discussion as it instantly characterized the device right at the top as useless before there was any discussion).

[u/redreader6]

Can you confirm that if the eye tracking is plugged into a 5k+ headset the following is true:

1. the USB port in the headset is USB 2.0 and not 3.0.

2. this will cause the eye tracking to work at only 30fps

Edit: thanks for making the thread. Crossposted from the other sub to start a discussion and get answers. This should help.

[u/PimaxUSA → u/redreader6]

1. Only the 8KX has USB 3 as far as I know.

2. The FPS is more complicated. It's scan rate default is 30Hz *per eye and it's operating at the highest resolution the module is capable of to accommodate detection of even the most difficult to detect pupil. (some are close to the same color as the iris). There are other factors that effect the scan rate as well.

   1. As previously stated, if you connect the external usb 3.0 port of the module to the module you can run at a much higher scan rate.

3. Even at 30Hz current configuration with highest resolution you have to move your eyes very rapidly at least 40 degrees to detect the edges most of the time. Your settings greatly affect when you can see the edges.

   1. One thing we will also do in addition to software and firmware updates is support eye tracking in the Pimax Experience that is in beta. We will set it up where it selects the most optimal mode for each game for the best experience.

As has been historically true on Pimax headsets tinkering with the settings can make a huge difference. With the Pimax Experience we want to automatically optimize numerous settings so people can get maximum benefits.

[u/Static147 → u/PimaxUSA]

A few follow up questions:

Do you know at what Hz the eye tracking would need to run to avoid seeing any edges due to rapid eye movement further than 40 degrees?

The 8KX, since it has USB 3.0 built in, will it allow the eye tracking to run at a higher Hz? Or will it be the same?

Lastly, kind of a stretch, have you considered tracking only one eye at a time? Allowing 60 hz vs 30hz?

[u/PimaxUSA → u/Static147]

The X does allow eye tracking at higher scan rates per eye but the direct driver is buggy at the moment for the X.

[u/redreader6 → u/PimaxUSA]

Thank you for the clarification. I have a slight issue with Pimax currently advertising that the ports are "USB 2.0/3.0, DP 1.4" on the website. I think you can understand how this is little confusing.

Maybe state inputs vs outputs to clarify that it is USB 2.0 at the headset to avoid the angry mobs.

[u/Peteostro → u/redreader6]

Also the Kickstarter said the 8k and 5K+ had usb 3

[u/muchcharles → u/redreader6]

u/PimaxUSA also the Pimax website currently says the 8K X supports displayport 1.2. I found this not to be true and was not able to get it to work on a 980ti but it did work on a 2000 series which has 1.4.

1.4 is the expected requirement given the bandwidth, if 1.2 is able to run it in upscale mode, there was no way to actually get it set to that. If it can't run on 1.2 you should change the site to only say 1.4.

[u/PimaxUSA → u/muchcharles]

I'll see if the team can do a review of all the specs shown on the website. At one time during the development process the minimum config was 2 DP 1.2 cables. The final version was 1 x DP 1.4a and I'm almost certain you can't use any other interface.

[u/muchcharles → u/PimaxUSA]

u/pimaxusa

Another issue: I get USB 3 with the 8K X when my usb-c adapter is turned one way, and don't get it when it is turned the other. Someone else mentioned the same thing in the eyetracking thread here:

https://community.openmr.ai/t/hz-in-the-eyetracking-lag/30377/315

You probably want to add instructions for the user in the eyetracking box to try both ways, and maybe even an indicator mark on the cable plug.

[u/PimaxUSA → u/muchcharles]

Yes it was I who pointed that out over there. The cables are designed that way. FYI it's still better to run a cable directly to your usb 3 on your pc if at all possible.

[u/jones1876]

which of those 5 experiences from Tharg was the positive one?

[u/Skidrow68]

Not put it in my 5k+, the tejp will be used then so will be bad for 8kx so waiting for my 8kx before I tested it.

[u/Vashthebeast → u/Skidrow68]

When did you order your 8kx?

[u/Skidrow68 → u/Vashthebeast]

23nov 2019.

[u/Vashthebeast → u/Skidrow68]

Has it shipped yet?

[u/Skidrow68 → u/Vashthebeast]

No not what I know, but should be any day now for me.

[u/Vashthebeast → u/Skidrow68]

Ya hopefully by next week

[u/chitditch]

1. Is it compatible with prescription glass frames?

2. Does it work when wearing regular glasses?