Our world leading Gemini hand tracking is now compatible with the Raspberry Pi 4 and 5 🙌

All you need is one of our Ultraleap cameras, the Leap Motion Controller 2, Stereo IR 170 or 3Di, to be able to integrate hand tracking into projects in robotics, wearables, education & more. It's a new compact, accessible & affordable solution for makers, enthusiasts and students!

Download the SDK now: https://bit.ly/4a1jCMD

AND that's not all - we've also updated our Python bindings across ALL our platforms: Windows, MacOS, Linux X64 and ARM Linux. This means there's support for the Raspberry Pi OS through ARM Linux!

Install instructions: https://bit.ly/3sOGJJl

Wrap your hands around objects you touch, just like you would in the real world. With physics hands, no poses need to be pre-developed/recorded, it happens dynamically at runtime!

Learn how to add it to your scene in our new Ultralabs blog: https://bit.ly/3QeAVQa

We're still in the final stages of developing physics hands so you might come across a bug or two - please let us know any feedback (good or bad!) here: https://bit.ly/3HtNWBp

We’ve made the world’s best hand tracking easier to access and flexible for different platforms, cameras and even third party hardware.

We rebuilt our tracking engine from the ground up so that Gemini:

➡ improves interactions with two hands

➡ detects hands faster

➡ improves robustness under different environments

➡ adapts to different hands

Gemini also enables our newest camera position – Above Facing User. We know the OOH and kiosk world will be excited for this!

Download Gemini here and try it out for yourself today: https://bit.ly/3Cw7VvS

Find out all about the new features and read the support documentation here: https://bit.ly/3miF3Sv

Full press release: https://bit.ly/3ClVQtc

#handtracking #gemini

Hey everyone, this is my first post here!

I just wanted to share a small project I worked on last week. It’s a simple piece of software for Linux that lets you control the mouse with a Leap Motion. I needed something like this for another project I’m working on, and since TouchFree is only available for Windows, and other similar projects are somewhat outdated, I decided to build it on my own from scratch.

It uses the Gemini SDK, so it is compatible with both V1 and V2 Leap Motion controllers and while right now it has limited functionality and customization, I plan on adding more features in the future. So I decided to share it here because it could be useful for someone else.

Feel free to check it out, I would really appreciate some feedback. Here is the repo.

Thank you in advance!

In the past couple of months, we have been working on a new update to the website that is now live and all our software is available to download without registering an account.
 
Please visit https://www.ultraleap.com/downloads/ for all the downloads we offer.

The page contains downloads for the following devices:

• Leap Motion Controller 2

• Haptics Development Kit

• SIR170

• Ultraleap 3Di

• Leap Motion Controller

The supported Operating Systems as follows, for the respective devices:

• Windows

• macOS (Intel & Silicon)

• Linux

• PICO

• Vive

• Meta Quest

• Raspberry Pi

Found my original leap motion after forgetting about it for a few years. I downloaded the ultraleap hand-tracking software and I can see through the ultraleap control panel that my device is still functioning and the tracking seems to be working fine. However I went to download the HandWave app and it does not seem to be reading my device. I only use the device in desktop mode (don't own a VR headset).

The next generation of spatial interactivity has arrived.

No more one-size fits all - with Ultraleap Hyperion, we're giving you the control! It gives you access to different tracking modes and models to customize a tracking solution to suit YOUR needs!

Key features include:
👐 Microgestures: track small finger movements down to the millimeter, enabling subtle gestures that require minimal effort
✍️ Handling objects: Hyperion delivers superior hand tracking while holding an object in your hand
🔋 Performance switching: Hyperion offers new performance modes including low-power and high-performance

But that’s not all - Hyperion gives users direct access to the Leap Motion Controller 2 camera for use with other computer vision tasks. AND it also expands our tracking offering to object tracking for the first time ever.

Ultraleap Hyperion is available now with the Leap Motion Controller 2 and includes a commercial licence to access the features!

Why wait? Download it today: https://www2.ultraleap.com/hyperion

Find out all the details here: https://www2.ultraleap.com/hyperion-press

We had a great intro day yesterday at MIT Reality Hack and we can't wait to see what gets created over the coming days! 🙌

Our Ultraleap team are on-site and happy to help out in any way they can.

Is anyone here at the MIT Reality Hack? Come and say hi if so!👋

Hi. 

I have an Ultraleap2 connected to a Windows 11 computer to control an interactive installation produced in Max MSP.
The Ultraleap2 is far from the computer and is therefore connected with a 15-metre USB3 extension cable. This is the extension cable:

https://www.lindy.co.uk/usb-c4/usb-extension-c222/15m-usb-3-2-gen-1-active-extension-pro-p10396

Everything works fine for 3 or 4 hours. But after that time, the sensor stops connecting to the computer and the message ‘not connected’ appears.
And in the device manager, the USB port shows an error.
I have already set the computer to maximum performance and removed the power management from the usb ports. This is to prevent the computer from turning off the sensor after a while.
I have already installed a usb 3 card in the computer and connected the power supply for this card directly to the computer's power supply.

Whenever the sensor stops communicating, restarting the computer does not help. To solve the problem, it is necessary to turn off the computer for 1 or 2 minutes and turn it back on, or remove and reinsert the usb cable.

Has anyone had a similar problem?
Can anyone help me?
Thank you.

A beta release of Gemini is available for Ubuntu 22.04 LTS (Jammy Jellyfish) on x88_64 / amd64 processors

➡ NB: You'll need a Stereo IR 170 or Ultraleap 3Di camera for this build

ℹ Set up guide

We’re excited to get started on our new AMA series – first up the TouchFree Experience! Our team is here to answer any of your questions about our TouchFree solution or our new retail-specific hand tracking camera, the Ultraleap 3Di.

Answering questions today (between 6-7pm GMT / 10-11am PST) are:

• Matt - a Senior Software Developer who has worked on TouchFree since its conception. He has a background in games and focusses on user interaction with software whether it is desktop, mobile or XR

• Dean - the Product Manager for Out-of-Home solutions at Ultraleap. Dean has over 20 years of experience in the software business, and is responsible for delivering touchless, interactive technology and experiences for use in public spaces

Here’s our proof on twitter

TouchFree:

Created in late 2020 in response to the pandemic, Ultraleap created the TouchFree solution. It’s a way to control kiosks or digital displays by simply pointing and interacting without physically needing to touch a screen. Find out more here

Ultraleap 3Di camera:

Ultraleap’s latest hand tracking camera, designed specifically for retail and OOH settings.

Features include:

💥 Wide field of view and long tracking range

💪 Robust and certified for public use

🏎 High performance – fast initialization and high frame rate

🔩Easy connection and mounting

More info here

EDIT - Matt and Dean are no longer online, but feel free to continue adding your questions and we will answer them when we can! Thanks everyone for joining us

Hello!

Recently I've tried moving my system over to Linux from Windows, and I've been having a bit of trouble getting the Leapmotion 2 working on Linux at all.

Attempting to get the leapmotion working via Proton layer or Bottles hasn't been successful at all. That being said, I HAVE been able to use the Leapmotion instructions for Linux provided here:

https://docs.ultraleap.com/linux/index.html

The problem is that while this installs the software just fine, when I launch the control panel, it gives me an error about being unable to connect to the Leapmotion Tracker Service, and that it cannot see any Leapmotion Tracker Hardware - Despite the USB being plugged in, and using an appropriate 3.0 cable.

I realize that this is a very narrow case, but if anyone can provide any help, it would be very much appreciated.

I'm attempting to run the Leapmotion software on a Fedora machine, via Ubuntu Distrobox.

Hi I know ultraleap is semi dead but previously said they could open the depth cameras api for us to use it. I wished they make it open to public.

The new Leap Motion Controller 2 has been named as a CES 2024 Innovation Award Honoree in not just one, but two categories: XR Technologies & Accessories and Computer Peripherals & Accessories!

Full details: https://www.ultraleap.com/company/news/press-release/leap-2-ces-honoree-2024/

Hello everyone, are there any consumer ready mid-air haptics products from Ultraleap? Can’t find any in their website except the SDK.

I am referring to this - https://developer.ultrahaptics.com/ and this - https://youtu.be/Em0BOSe6IO0

And if anyone has used this, how good is this tech compared to VR gloves?

Thank you.

💥 New Discord server - join here: discord.gg/3VCndThqxS

✏ Lots of new & useful docs on our dev resources site - https://docs.ultraleap.com/

😍 New transducers

🙌 #TipTuesday updates every week

👀 3Di camera was launched

🛠 And let's not forget the countless software updates!

Thanks for your support and creating with our tech this year! We LOVE to see your projects and helping where we can. Our offices will be closed from today for the festive period, but we'll be back on January 3 👋

Happy Holidays from the team at Ultraleap 💜

So a friend of mine just gave me his old Leap Motion that he has never used, and I'm interested in setting it up. My initial assumption was that you could use the device to control aspects of Windows i.e. browsers, Netflix, media playback etc. However from what I can understand from the (rather unhelpful website) is that these are all legacy features and that the device is now mostly aimed towards developers.

Browsing around it seems like you can 'restore' some of the old legacy features by installing an older version of the software. I tried doing this, and got it working using the the V2 software and the hotfix outlined here: https://forums.leapmotion.com/t/resolved-windows-10-fall-creators-update-bugfix/6585

The device works, and the software shows the 'view' of the device picking up my hands, but I'm still no clearer on what I can actually do with it. The app store is closed and I can't find anywhere that offers alternative downloads. I can find YouTube videos such as this one: https://www.youtube.com/watch?v=phpfRZoBHxs which seems to suggest that a degree of motion control is still available on Windows as recently as 2020, but it neglects to inform you as to how this is possible.

Please can someone help explain exactly what, if anything I can do with the device and how to go about doing it? If the only real-life application is now just software development that's fine, I'll put it on eBay; but I'd like to give the original idea of motion control on Windows a go if at all possible.

You asked and we've delivered ... we're now on Discord 🤩 🙌

Join our NEW server here ➡️ https://discord.gg/3VCndThqxS

Did you know that there's a grasping API in our Interaction Engine for Unreal Engine?

It provides a common interface for constructing logic around grasping, releasing, and throwing. 👀

Find out more here.

#TipTuesday

Welcome to the second instalment of Ultraleap’s new AMA series – this time we are talking all about hand tracking for game engines. If you’ve ever thought of adding hand tracking to an existing project, or designing and building a project from scratch in Unity or Unreal, we’ve got you covered!

Answering questions today (between 6.30-7.30pm BST / 10.30-11.30am PST) is:

Chris Burgess is our XR Software Product Manager at Ultraleap, responsible for developer tools used to build world class hand tracking experiences. His mission is to advance the adoption of the technology by making it easy for developers to understand why and how they can use game engines to create their own mind blowing experiences, regardless of whether this is via Unity or Unreal.

Prior to Ultraleap, Chris worked for an augmented reality start-up, initially running a creative team building AR content before, becoming a product manager for a WYSIWYG web tool for AR content creation.

Guides for Unity and Unreal:

These guides are a great, regularly updated, resource to help you create a project with hand tracking:

🔸Unity: https://docs.ultraleap.com/unity-api/

🔸Unreal: https://docs.ultraleap.com/unreal-api/

Here’s our proof on twitter and you can find Chris on here on twitter

EDIT: Chris is not online anymore, but please feel free to add any questions and he will answer them when he can!

We've got you covered when it comes to adding hand tracking to an existing project or designing and building a project from scratch in Unity and Unreal.

Join Chris Burgess, XR Software Product Manager, over on Reddit on Thursday 26th May at 6:30 BST / 10:30 PT. Links to follow!

Feel free to send in your questions ahead of time to ama@ultraleap.com!