Thanks for this update! I picked up a leap motion a couple of years back for really cheap on eBay. For the first year, I didn't use it for DCS because of how janky it was-- as you mentioned in a previous video, not having the ability to disable your VR hands cause issues with accidental inputs while using your hotas was a disaster (e.g., accidentally [and devastatingly] engaging landing gear on the hornet while using the throttle). For a few months now, there has been a lot of work in the DCS forums on the fingers app in conjunction with bluetooth mice/espurino-based finger buttons that you would attach to gloves or rings. This essentially created a much less expensive and more obtainable pointCTRL system. The fingers app has made using a leap motion in this game so incredibly easy and extremely precise to the point where I no longer need button boxes or anything else other than my hotas, VR headset, and a couple of cheap bluetooth finger mice. Now, having the ability to physically flick switches with my fingers, yet disable my hands might entirely remove my need to wear bluetooth finger mice. Really excited to try this out!
Thanks for the update. I think this branch of usability is extremely important for the developing of the VR implementation in DCS, and I feel that ED is leaving this a little bit on the backburner of the plans for the future of the sim :(
Great update! I’m so glad you posted this since my Leap Motion device has been sitting in the closet collecting dust. This looks very promising! So that I you for posting this! I also posted a link to this video on Twitter in case anyone is interested and hasn’t seen this. So great stuff! Thank you again for posting this update!🤙
I saw your last video and it kind of shy' d me away from getting this although I thought it was fantastic at the time . I think now I am ready to pull the trigger on it. Thanks for posting.
Hi Joan Gracias !! for the excellent INFO covering each detail . I immediatly ordered LEAP MOTION before it is selled out. The immersion before the update in DCS with the Laserpointer coming out the finger prevents me from buying leap motion, but now it is fantastic.
Muchas Gracias! I didn't know about the button mapping and the fingers app. Will try your hints on my next sortie! Since I picked up the Leap Motion device two years ago I've been testing it every couple of months to see if it is finally usable. It has great potential! But it is not as easy as you might think especially when it comes to rotaries and I haven't made it my primary input method yet. And believe me: when you pull the fire extinguisher handle in the A-10C for the 10th time instead of changing the steerpoint it's really hard not to lose your temper 😅
Wait a minute. So in theory you could program it to always enable the hand tracking if the joystick is centered at 0 . This way when flying you would only get hands when reaching away from the joystick.
it would be nice is there was also a keybind to use the laser for those hard to use areas. That way we can use palm up and palm down for left and right click
I would build multiple reed-switches inside the joystick/throttle and also a Leo Bodnar BBI-32 Button Box Interface and put strong magnets into some nice pilot gloves. When theese magnets coming near of the reed-switches the Leo Bodnar BBI-32 Button Box Interface can make use of the "turn hands off" feature inside DCS. This BBI-32 Button Box Interface can be well assigned inside DCS. I have many of them in use for other things and they are working quite well. Just an idea...
I got hand tracking module for pimax crystal I installed all the software needed while in dcs I can see my hands but when I reach for the switches nothing happens... how to make it work??
@@essamahmod it only works with ED made aircraft, not the rest, that's why I was asking. How are your settings in the Leap Motion page of the Special settings tab?
I'm trying it out in the hind. I have some questions and problems. 1. My right hand disappears and never returns when in the simulator. It's there at the start but then it is gone. I am using your recommendations for assigning commands for when you need hands on and off in the cockpit - I have these commands assigned to my hotas. Left hand stays solid and remains... right hand shows for a bit but then disappears. The right hand still functions as a mouse cross and is usable. Very odd. 2. How do I turn off the "laser pointers" from my hands? 3. The unit gets VERY hot when on for a short time, it's because it is an infrared light. I'm worried it will overheat my VR headset. Do you have mounts for an HTC Vive? Currently I am only using velcro alone to attach it to the VR headset. 4. Switches are not easy to engage but it does work. Thank your for taking the time to respond.
Hi! Answers to each question: 1. It's happening to me too. At first I didn't notice because I mostly used the left hand. In another comment someone said they're reporting the bug to ED, let's hope they find the source! 2. That's in the VR tab of DCS's settings, to the right, a combo box where you can chose which hands have a laser pointer 3. You can try the mount I designed for the reverb, maybe it works there too? It keeps the Leap a little more separated from the headset: www.thingiverse.com/thing:5445093 Cheers!
Oh: 4. You might try to use your hands in an angle where the leap can sense them better, that helps a lot. Angle them a little upwards so the leap has a full view of your hand, preventing occlusion of some parts of it.
Still got problems with my leap motion. Very often one hand disappears and I need going back to the special folder to make an on off action …also it is tedious using it for rotating buttons. In fact it is quite usefull mainly for the VAB of MFD and in front otherwise you have to carefully adapt your environment to prevent blockade by furnitures. Using the positioning movement inside the cockpit helps a lot. I am using some buttons for up down fwd aft to close the hand to the buttons to activate but using a trackball in place of leap motion is also very convenient for flight in VR, faster and more precise.
Is there any documentation on how to setup and use Fingers?. I downloaded it and ran it but it does not seem to be doing anything. I have leap motion working and the ability to turn the hand off and on works great. I have a HP Reverb gen2 VR head set, so I set fingers to Generic. The status shows connected but what are the RINGS for? When I get in to DCS the hands work (on and off) and I can switch things (not always accurately ) but when I turn them off and point, nothing happens. That's why I think fingers is not operational. I do have everything set up in DCS per your video (no pointing,etc.) Thanks for all your videos and any help would be greatly appreciated. Doc
After switching both hands off in DCS, you should be able to point with your fingers to move the blue cross. If that happens, then Fingers is running, that's it's job. To be able to click you need to map buttons in DCS, for click and right click, in the UI Layer section of controls. Use spare hotas buttons for that. And the rings are an extra, if you have one of those Bluetooth rings you can click with them instead, without having to map hotas buttons to click when using the pointer.
@@fisadev thank you for the quick reply. It must not be working then. I do have the on and off for the left and right hand track to a button but what do you mean by mapping a button for a right and left click? I have to map a button on my Hottis for a right and left mouse click? Is that what you mean? So actually, I have to bind four different keys to my Hodos, correct DVR left and right hand and a left and right mouse click. Is that correct again, thank you for your quick reply.
@@anthonydallalio5716 yes, that's correct, if you want to use both the hands and the pointer from Fingers, you need 4 buttons mapped. If you are too constrained in free buttons and have to choose only one mode, I suggest using just the pointer mode with fingers and disabling the DCS Leap support, because with that you can do everything (with the hands there will be stuff you can't do).
Big news in patch 2.9!! DCS made great steps in adding 3 axis for leap motion and regular hands! unfortunally it currently only works on left hand. The same 3 axis for the right hand would be excellent aswell! For now i can work around it and use my left hand in my real simpit aligned with the virtual one which helps a lot in immersion! Also made the option that hands are "not active" which is really beneficial so you dont accidentally activate switches.
Hi, do you have a video or recommend one on how to setup leapmotion on the PC . I am confused on the various type of software and configurations for use on Dcs.
Finger app just don’t work for me I am using the leap motion dll not the one provided with the app but I guess it is more recent. The app stay permanently in connecting position with generic mode for my G2
I don't do any of those things, hehe. When I did the video I was using an HP Reverb, which is completely different to the Quest which I'm guessing you assume I had. It doesn't connect via usb link but through a custom cable, the Leap can't even be connected to that headset at all, the headset doesn't have any usb ports. Since then I switched to another headset which is similar to the Quest, I'm using the Pico4. The Leap Motion is connected directly to the PC with a long USB cable (secured to the headset straps with a small velcro loop), and I don't use a link cable either for the headset, I connect it to the PC via wifi 6. I usually have the headset connected to a power source for infinite playtime.
Una pregunta. Tengo el fingers puesto pero no se mueve nada en DCS cuando estoy en VR. Tengo las Varjo y no se si tendrá algo que ver con ello. Sabes si hay que configurar algo en el programa fingers?
Buenas! No sabría decirte si el hand tracking de las Varjo está soportado por la app y si hay que hacer algo extra. En el caso del Leap Motion "normal", no hay que hacer nada, es suficiente con tener los drivers instalados y abrir la app. Quizás sería bueno preguntarles directamente a los devs de Fingers, por las dudas (acá podés crear un issue para eso: github.com/glenmurphy/fingers/issues )
For some reason mine sucks. It works fine in the program but if I even try to point, my finger just bends and warps. I cant press any buttons either cuz of how unstable it is. I really want to use this because it looks awesome so if there are any solution please let me know. Edit: I found out that the issue is the Gemini software and there doesn’t seem to be a fix. The other part of the issue is just the bad implementation of Leap Motion in DCS.
I own an Valve Index, and have recently been seeing a handful of my friends get into DCS - I also own a sad excuse for a flight stick with a twist yaw. Is there nothing that will allow me to run DCS with my physical VR controllers to interact with the cockpit buttons?
@@fisadev I did manager to find those controls shortly after seeing this video and making the comment - I found them to be incredibly clunky, and a bit haywire, taking more than 5 minutes tryingto figure out how to close my canopy on the P-51 lol. - It's my own fault for not watching the video further in, in my haste to find a quick answer. Now I've watched further, I didn't realize that "No Pointer" setting would allow me to physically interact with the controls, much in the way that VTOL vr allows. I'll have to load the game back up and give it another shot. Thanks for the relpy!
I did! But I couldn't find one that wasn't too intrusive. So instead I started developing my own "finger buttons" with some small arduino boards and tiny buttons. I'm still working on it, but honestly I've been procrastinating a lot on that project, hehe. I need to design a good mount and 3D print it, because the electronics are done and work pretty well. I'm also using the Fingers app instead of the laser, because it lets me use more apps aside from DCS.
Just got the hand tracker for the Pimax8kx, so far I've found it next to useless. It can barely track my hands, using the UltraLeap visualiser it can barely make out my hands it would seem, if I put them in front of a high contrast source like a window it grabs them fine, but anywhere else it just refuses to track. Did you have any similar issues?
hi! No, in my case it tracks them pretty well under normal lights and even low contrast when using black gloves with a black chair and simpit pannels in the background. Maybe you need better illumination? Or maybe a cleaning of the tracker's glass? Or maybe it's just that the pimax one isn't as good as a standalone leap motion?
I really don’t understand why ED doesn’t have the user place their hands on HOTAS in the controls menu and calibrate the gestures and range of motion of moving the stick and throttle to maximum extents so as to say “hey DCS when my hands are placed here in this particular grabbing gesture and move from here to here… It is stick and throttle movements and disable virtual hands please!” What should obviously happen is that you could configure this for each individual aircraft to allow customizable profiles per aircraft to accommodate different grips and hardware setups and for it to be automatic so as to give the user complete and full immersion in DCS and not have to reach for some hardware like a mouse or button box or hand controllers, etc, etc… Ultimately the idea being to replicate the actions of a pilot IRL in terms of hand interaction inside a cockpit.
They should allow to draw boxes in the virtual cockpit by the player when in the cockpit, where the virtual hands would not interact with the cockpit. We have beatiful and working 3D cockpits, where we are sitting. let us draw box and move it around that space to define things! (Let us click the button/switch in cockpit and then bind it to HOTAS, no more menus to scroll! Call it as "Interactive Binding mode" ™) We could even have those zones defined for different common actions, like "Eject" by moving both hands to ejection handles! There is the setting that when your physical controller movement is detected, your virtual hands are hidden. Or at least it use to be there.
Joystick/throttle manufacturers should start putting capacitive sensors inside controllers to detect when the controllers are held/touched. With that we could configure virtual hands to show only when needed.
How do you map the finger gestures of the leap motion controls if I may ask? And for me it seems like that I can't really interact with the Buttons. Flightstick and Throttle are working although I have deactivated this setting in the Special settings of Leap Motion. Tracking of the fingers are fine in the Gemini Software.
When using the DCS hands and pointer you don't need to map them, just pick the settings you prefer in the Leap Motion settings page. But I don't use that. When using Fingers as a pointer, there are no gestures to map. Instead you need to map two buttons from your hotas or joystick, to the left and right click buttons. That's under the UI Layer group of controls mappings.
how do you turn knobs like lighting, hud intensity, etc with the fingers ? do you click and move your finger as you would do it with the mouse? I will defenatly replug my leapmotion and check this update. many thanks on sharing this video. I dont get why ED did not talked about it in their own video devellopment.
Hmm. I got the on/off switch working, but I couldn’t get it to ‘click’ any switch or move any of the levers in DCS. I packed it away again in frustration. I’ll check your links and the comments and see if I can figure out where I went wrong.
If you are trying to use the switches with the hands, then the problem is probably that you have the DCS pointers feature enabled, which breaks the hands interactions. If you are trying to click with the Fingers app pointer, then the problem is probably that you have no click and right click mappings, which are configured in DCS's controls (UI layer section).
@@fisadev Unfortunately, that's not the case. I disabled the pointers feature-that's on the VR menu. I enabled the 'finger crook' click mode on the other menu. Unfortunately it didn't seem to work. I tried using Matt B's OpenXR addon for hand controllers but just wound up making it impossible to start DCS- giving me some kind of an 'unrecognized controller' message. Anyhow, I've removed the hand controller module from my Pimax 8KX and everything is working as it should again.I wonder if the problem has something to do with the Pimax version of the firmware? Anyhow, the hand control doesn't really do anything I can't already do with a mouse in DCS VR. It would be really useful in a sim like IL2 in which the mouse doesn't function in the cockpit. Cheers Dave
Quick Question. When I click on the finger app it just disappears. I cant seem to get it to work in DCS. Leap works as leap does but when I hide my hands the lazer pointer moves to my headset instead of my hands. I am running OpenBeta with Windows 11. Does your Finger App stay up and running?
With leap how do you turn dials? Also, how is the latency of moving your hands? When you say map button that means you are push a physical button like a mouse click?
Hi! I not sure I understand your question. Do you mean mapping VR controller's buttons to things in DCS? Because what I show in the video is not using any VR controllers, those are my real hands being tracked by a device.
This is my current setup: photos.app.goo.gl/3kFNefMCKiu4Xg4j6 . The chair is a custom design, I designed it and a friend carpenter made it for me, and then I added some of the metal extras.
It's great you can disable hand interactivity but I would prefer it if the hands were still rendered. I fly the F-16 in VR but I have a physical ICP and a pair of Cougar MFDs so I'd like to be able to still see what I'm interacting with; I just don't want the hands to also interact while I do that. Personally, I would need the hands to interact with everything else, such as aux and side consoles.
Exactly. I don't want the hands to disappear completely. Seeing the hands and being able to designate what it interacts with would make it much more practical for me. 100 percent on or 100 percent off just doesnt work for me.
About to get this exact setup. Is there not a setting where you can see the hands, but not have them interact with anything? I was wanting to just be able to see the hands to make it easier to manipulate my MFDs and ICP, but then use the mouse for everything else. Obviously it would be better to be able to still use the hands for manipulating virtual switches. Also, how easy is it to keep the calibration consistent so your hands match the placement of the actual MFDs and ICP?
I have another video in which I explain all that's needed (driver, settings, etc). It's in Spanish, but just looking at what I do you can probably understand what's needed :)
thanks for the updates! Have you tired the F14 already? is it working for F14 now? From what I have heard, the leap motion is not supporting 3rd party mods.
The pointer thing using Fingers works with any module that has a clickable cockpit. The hands rendering and interaction, only works with ED modules for now.
Not for me. It's quite cumbersome to have to release the hotas and find the VR controllers while being blind, and then after using them finding a place to leave them while still being blind, and having to do that constantly is disruptive in moments where you have to act quickly. Before the Leap Motion, I was more confortable using a trackball than trying to use the VR controllers.
The shaking is an artifact of the recording field of view. That's the normal level of head movement, you just don't notice it in everyday life and when inside the vr headset, because of the bigger field of view and the stabilization of the eyes. When recording a smaller fixed and non stabilized rectangle inside that FOV, the shaking becomes more visible.
Buen vídeo gracias, tengo el leap desde que lo implementaros en DCS, pero tras varias actualizaciones perdí la motivación ya que era imposible de utilizar... quizás le de otra oportunidad... ¿Cómo está el tema de los botones rotatorios? ¿Los detecta ya mejor?
Los rotatorios todavía son raros de usar con las manos de DCS, pero con Fingers es muy fácil porque funciona de la misma forma que con el mouse (mantener apretado el click, y subir o bajar el cursor/mano).
@@gonvise no hace clicks con gestos, así que hace falta mapear algún botón. Por eso estoy también trabajando en una "botonera" para los clicks que quede en los dedos mismos: th-cam.com/video/rzRWZ1gR2Zg/w-d-xo.html
GOOD AFTERNOON, I AM ABOUT TO BUY 3D GLASSES BUT I WANT TO HAVE THOSE HANDS AS SHOWN IN THE VIDEO, IS QUEST 2 OR PICO 4 SUITABLE? AND BESIDES THIS ADAPTER?
Hi! No need to scream, hehe. I use a Leap Motion for the hand tracking, it's a separate device and not part of the VR headset. I don't have experience with using the headsets hand tracking, because I fly with Virtual Desktop, which doesn't yet support that way of hand tracking.
jaja perfecto. gracias por la respuesta. estoy armando un f16 la idea es poner Oculus pero dicen que el handtracking que tiene no es lo mejor, y lanidea era buscar alguna variable para que si sacarse la máscara se puedan usar bien las manos
DCS doesn't support that. The hands info is interpreted as relative to your head position inside the VR world, so if the sensor isn't in your head, your virtual hands would move absolutely out of sync with your real body.
In my case I'm using a front switch in the hornet grip from winwing for click and right click (it's a two way and apring loaded to the center), so my left hand is clicking while my right hand is pointing. And to show/hide the hands I use a couple of my stick buttons (winwing F16EX) that I find kind of hard to use in combat, but they're good enough for this, as I only use the DCS hands in calm situations.
@@fisadev thanks. Tried it but to me the leap with hands is just too much of a hassle tbh. Now i turn off the mouse in vr and assigned left and right mouse button to my joystick. Works fine mostly but for really nearby buttons to my left and right I would love to swap to the mouse (head won't turn that narrow) but ED needs to make a "mouse on/off" binding for that.
That would be nice, yes. But the feature we got is still quite useful. Before it was unusable, now it's usable, and your request would make it even better.
Hi! Fingers is the one moving the mouse cursor to where the hands are (assuming a front-facing mount). The LM drivers don't have that feature by themselves.
@@fisadev ah ok. I re-listened to your tip about turning off the lasers. I had mine disabled, but they were showing anyway. I toggled that setting, made sure they were off, and now it's working FAR better than before. That's an important setting. I noticed the right hand disappearing sometimes and that if I go into options and toggle the master leapmotion on/off it comes back. looks like the rotary knobs are the biggest challenge.. but this is now much better overall than reaching for sleeping VR controllers. thanks!
@@bryanmyers9977 Hlad to hear that! Regarding the disappearing hand, yes, many are having the same issue and it's some weird invisible interaction with the virtual stick. It's been reported in the ED formus too.
Hello, thanks for the comprehensive video! I am curious if you are using the Pimax specific hand tracker the fits just under the headset or are you using a different leap/ultra leap motion controller? Thanks
Thanks. Looks great. Tested it today since my HOTAS got delivered today as well... Problem: The Fingers application keeps crashing on my side. Any clue?
Oh, no idea. Does it work but then crashes? Or just crashes right away and never starts? If that's the case, then maybe you are missing the .net framework it requires?
@@fisadev It starts and shows the UI and than it closes the window without any error message... Do I need to copy the both files into a specific folder or something?
@@CagatayOezbay You just have to extract both files to any folder you want, and run the exe. That should be enough. If you were just running the exe from inside the zip file, then that's the issue. If you already had extracted them, then you should post an issue in their github repo, maybe they can help.
If anyone is bothered about the same problem of crashing on startup Fingers.... Make sure that the Bluetooth driver is installed and enabled. Just installing it is not sufficient. Bluetooth must be enabled! Thanks to the developer ;)
Hi! Thanks for making the video. Could you let me know if it works through gloves? If you are wearing some thin gloves. That’s how I like to fly and wondering about it. Thank you!!
Hola Juan soy un gran aficionado a la avicion, para hacerlo más real tengo las Vr...y lo de los guantes es una asignatura pendiente...tengo dificultad con el idioma. Me podrías indicar como realizar todo el proceso en castellano, si es que dispones de esa documentación, muchas gracias, comentarte que aca en la zona que resido practican la esgrima antigua completamente documentada y simulan en físico las técnicas de espadas, mediamano, florete, etc etc
Buenas! Tengo otra versión en español un poco más vieja y más detallada. La principal diferencia es que en esa versión en español explico cómo usar la app Fingers y no usar las manos de DCS directamente, por el problema que tenían, pero ahora ese problema está relativamente solucionado. Así que el cambio sería que si querés, podés dejar habilitado el soporte de Leap Motion de DCS, y mapear los dos botones que quieras para mostrar o esconder las manos (en la sección de controles > grupo UI Layer > grupo de VR). Lo demás, está todo explicado: th-cam.com/video/8Nd2RoA5-ts/w-d-xo.html
@@fisadev soy de Manresa cerca de Barcelona España y es mi señora la que domina el tema, hacen exhibiciones en ferias medievales y hacen quedadas con diferentes grupos de toda España.
I installed the 5.7.2 version of the Ultraleap software and followed your steps from this video (thank you for sharing Juan Pedro!). My hands are visible in DCS and displayed correctly. However, it takes a lot of tries to flip a switch (tested in the KA-50 III and the SU-25). Do you need the Fingers app to be able to use your hands to flip switches? Do I need to overwrite the Leap .dll file in my DCS installation with the one from either Ultraleap of from the OpenXR installation?
Fingers isn't required to be able to flip switches. Are you sure you have the laser pointer option disabled in DCS? And you don't need to override the libs.
How is the tactile feedback? I guess it’s a weird sensation since you’re not actually touching anything and the finger tips are very sensitive to touch.
I wonder if there's software that can utilize the quest 2s in built hand tracking. Would be really awesome to use this without having to spend more money.
Con las manos visibles, es muy difícil usarlos. Con el pointer de Fingers se usan bien fácil, simplemente haciendo click (con los botones del hotas que hayas mapeado para click), igual que si los usases con el mouse.
@@pabletesoy En mi caso tenía botones libres tanto en el stick como en el throttle, así que me mapeé click izquierdo y derecho en ambos, para poder usar ambas manos. Pero eso es gracias a que tengo un hotas con muuuchos botones, entiendo que no es el caso en hotas más normales.
I bought the LMC thanks to this video. I have to say, it's great when it works in DCS -- however my hands often disappear in-game and never come back (regardless if I hit the show/hide hands bind). I often have to restart the game or toggle settings to have them finally come back. They always look good in the actual LMC control panel. Any ideas on how to fix this from happening?
I started having this issue too, and I'm not sure of the cause. Though I suspect it may be related to having two apps trying to access the leap data (DCS and Fingers) at the same time. If I find the real cause or a solution, I'll post it.
@@fisadev I'm not using fingers and having the same issue. My theory is DCS is overriding the LMC with its own mouse cursor interaction, the same way I've heard pointctrl doesn't work with LMC because it uses the DCS mouse pointers (they apparently take the highest priority when deemed active)
@@PoorYurik Might be related to that then! Thanks for the info, because this means that I might be chasing the wrong problem when trying stuff like how I boot Fingers, etc.
@@fisadev I submitted this issue and additional info to both the Ultraleap discord (#help-and-support channel) and DCS discord (channel #dcs-bug-reporting-forum) with screenshots of our conversation. Fingers crossed.
@@fisadev A DCS forum post helped me figure out what the issue is. To verify if the solution works for you: enable hands control throttle and flightstick in the in-game Leap options under Special. Then see if the hands disappear. Cause: it appears that the hands are disappearing because the natural continuous input of the joystick and throttle are disabling the hands when those options are set to disabled (i.e. it disabled the hands whenever axis input on those devices is detected). As further proof, I got the right hand to continue working with hands control flightstick disabled by setting a large deadzone on my joystick axes. Once you try enabling flightstick/throttle control with hands, let me know if it makes the hands stop disappearing for you and I'll pass it on to the Leap and DCS discords.
@@ligmasack9038 Or hope soon ED can optimise DCS to utilise everything my current hardware could offer? Things in the 2023 and beyond video gave me that hope.
@@2612563 I'm running a Ryzen 9, w/ a 3080 FTW3 and 128GB's of RAM myself. Steam VR is the main problem with DCS VR (if you are playing through Steam) and I ended up going from 32GB's of Ram to the aforementioned 128GB's and it fixed most issues. RAM is the cheapest performance upgrade you can make.
That's not possible, sadly, because Meta decided to only provide the hand-tracking api to games running in the quest itself, not available for PC games.
@@Pablo_lens I don't have a Q2 here to try, but I **think** that you can enable hand tracking in the headset itself, and it simulates joysticks for the desktop apps. You won't get real fingers tracking like with the leap, but you will see a hand where your real hand is, and DCS will treat it like a VR joystick. I don't know how well the clicking will work, but maybe you can use them as pointers and map buttons for the clicks if that doesn't work well.
Right now I'm using buttons from my HOTAS (I have a Winwing stick and throttle, they have plenty of buttons). But I'm designing a device with just a couple of buttons to mount over my hand or in a finger (smaller and simpler than PointCtrl, no batteries and just two buttons)
@@fisadev I'd like to hear more about your idea for finger "clickers". I've found some ring style remotes for cell phones but they are all bluetooth so I doubt they would work for PC but the concepts are right.
@@MrLotengo I'm planning this: a small arduino usb stick with a couple of cables that go to my fingers. The arduino itself is in the usb port of the PC (it's a very small one with an integrated usb connector), only the cables and buttons at the end of the cables are in my hands. So I only need some type of ring/support/whatever to hold those two buttons in my hand, and the rest of the electronics are at the other end of the cable, not getting in the way.With a small velcro band I could keep the middle of the cable attached to my arm, so the cable itself isn't an issue getting tangled in stuff when I move. I have to build it and try it, maybe it works :)
@@fisadev You could use a wireless dongle to dongle connection from Pc usb to 2 receivers (1 on each hand) to register the clicks. 🙂 This eliminates any wired hands issue to the PC. May use a coin cell battery per hand for the power supply.
So you cannot twist knobs yet, correct? Also, I think it would be good if ED would make options in binding to state which bindings cannot be interacted with (instead of turning hands off), such as all the bindings you do have on your HOTAS.
With the hands technically you can, but I don't understand the logic of it. They do move, but as far as I can tell it's kind of random. With the pointer (Fingers) you definitely can and it's easy to do it (just like with the mouse).
Hola Juan, muchas gracias por el video. Debo decirte que tengo el dispositivo (para Pimax) desde que salió y constantemente pruebo si funciona... Con tu video trate una vez más, y esta vez si pero.... no funciona presionar el teclado numerico (UFC) como alguna vez funcionó. La unica forma es habilitando el pointer lo que no es optimo por lo que tu demuestras en tu video. Muchas gracias de todas formas.
@@fisadev En el JF-17, pero traté en el F-16 ya que recuerdo que hace algun tiempo (antes del DCS 2.7) cuando volaba ese avion, el Leap motion funcionaba relativamente bien hasta que con las actualizaciones nunca mas funcionó... hasta ahora que al menos se ven los guantes. Pensé que quizas con FingerApp podría, pero mal interpreté su uso y pensé que bastaba ejecutar ese programa, pero se necesitan los rings.
@@colmillo65 No se necesitan los rings para Fingers, en vez de usar los rings podés mapear dos botones de tu HOTAS para hacer click y click derecho. En el JF17 el soporte para tocar cosas con las manos nunca anduvo, porque eso es solo en cabinas de aviones hechos por ED. En el F16 sí funciona. Y fingers, con los clicks, funciona en todos, incluyendo el JF17.
@@fisadev Mmm, trataré de nuevo. Porque al ejecutar la aplicacion el puntero del mouse aparece en un area restingida a la derecha de la pantalla... Gracias Juan
![OUTDATED: SEE DESCRIPTION! [DCS and hand tracking: tutorial and review (Leap Motion)]](/img/n.gif)
Thanks for this update! I picked up a leap motion a couple of years back for really cheap on eBay. For the first year, I didn't use it for DCS because of how janky it was-- as you mentioned in a previous video, not having the ability to disable your VR hands cause issues with accidental inputs while using your hotas was a disaster (e.g., accidentally [and devastatingly] engaging landing gear on the hornet while using the throttle).
For a few months now, there has been a lot of work in the DCS forums on the fingers app in conjunction with bluetooth mice/espurino-based finger buttons that you would attach to gloves or rings. This essentially created a much less expensive and more obtainable pointCTRL system. The fingers app has made using a leap motion in this game so incredibly easy and extremely precise to the point where I no longer need button boxes or anything else other than my hotas, VR headset, and a couple of cheap bluetooth finger mice. Now, having the ability to physically flick switches with my fingers, yet disable my hands might entirely remove my need to wear bluetooth finger mice. Really excited to try this out!
Thanks for the update. I think this branch of usability is extremely important for the developing of the VR implementation in DCS, and I feel that ED is leaving this a little bit on the backburner of the plans for the future of the sim :(
Especly with the Quest 3 being out and having hand support.
Thank you very much for this video! Because of I it I just got my UltraLeap device. Haven’t tried yet though. But I think I’d really like it!
Great update! I’m so glad you posted this since my Leap Motion device has been sitting in the closet collecting dust. This looks very promising! So that I you for posting this! I also posted a link to this video on Twitter in case anyone is interested and hasn’t seen this. So great stuff! Thank you again for posting this update!🤙
I saw your last video and it kind of shy' d me away from getting this although I thought it was fantastic at the time . I think now I am ready to pull the trigger on it. Thanks for posting.
Hi Joan Gracias !! for the excellent INFO covering each detail . I immediatly ordered LEAP MOTION before it is selled out. The immersion before the update in DCS with the Laserpointer coming out the finger prevents me from buying leap motion, but now it is fantastic.
Just ordered this device, looking forward to use it
I'm soooo gonna try that as soon as I get the handtracking module for my Crystal! Looks dope!
Fantastic!
Thanks for the update on leap integration, I'm glad that ED are making tweaks to it.
I just ordered one. It looks awesome! Thanks for the video.
Tal vez, solo tal vez, empiece a considerar algo tipo Leapmotion si empiezan a meter estas pequeñas mejoras.
Buen video.
Ya están esas mejoras
Muchas Gracias! I didn't know about the button mapping and the fingers app. Will try your hints on my next sortie!
Since I picked up the Leap Motion device two years ago I've been testing it every couple of months to see if it is finally usable. It has great potential! But it is not as easy as you might think especially when it comes to rotaries and I haven't made it my primary input method yet.
And believe me: when you pull the fire extinguisher handle in the A-10C for the 10th time instead of changing the steerpoint it's really hard not to lose your temper 😅
I can totally relate to that, hahaha
Oh cool the VR version of your IHADS isn't blurred out by default, nice.
Good stuff. The next step would be to get haptic feedback when interacting with switches / Rotary knobs.
ummm... what's it gonna feed back to?
@@cuttheloopgloves
Yeah tried this tonight, works pretty well.
Wait a minute. So in theory you could program it to always enable the hand tracking if the joystick is centered at 0 . This way when flying you would only get hands when reaching away from the joystick.
Yes, maybe with Joystick Gremlin or something hehehe.
Muy bueno. Muchas gracias Juan. Ahora puedo comprar un LeapMotion para jugar DCS en VR !
it would be nice is there was also a keybind to use the laser for those hard to use areas. That way we can use palm up and palm down for left and right click
now if you have panels and get this to scale.. the Immersion! @$100 for the Leap Motion, thats a hell of an addon in VR
I would build multiple reed-switches inside the joystick/throttle and also a Leo Bodnar BBI-32 Button Box Interface and put strong magnets into some nice pilot gloves.
When theese magnets coming near of the reed-switches the Leo Bodnar BBI-32 Button Box Interface can make use of the "turn hands off" feature inside DCS.
This BBI-32 Button Box Interface can be well assigned inside DCS. I have many of them in use for other things and they are working quite well. Just an idea...
Mine has arrived. Trying it out tomorrow!
Super helpful video🤩 Thanks😊
I got hand tracking module for pimax crystal I installed all the software needed while in dcs I can see my hands but when I reach for the switches nothing happens... how to make it work??
What aircraft are you trying them on?
@@fisadev usually I use the f-18 ....why each plane is different??
@@essamahmod it only works with ED made aircraft, not the rest, that's why I was asking. How are your settings in the Leap Motion page of the Special settings tab?
i wish you make a video on how to setup hand tracking in dcs and make it work thank you@@fisadev
@@essamahmod I'll probably make one soon.
I'm trying it out in the hind. I have some questions and problems.
1. My right hand disappears and never returns when in the simulator. It's there at the start but then it is gone. I am using your recommendations for assigning commands for when you need hands on and off in the cockpit - I have these commands assigned to my hotas. Left hand stays solid and remains... right hand shows for a bit but then disappears. The right hand still functions as a mouse cross and is usable. Very odd.
2. How do I turn off the "laser pointers" from my hands?
3. The unit gets VERY hot when on for a short time, it's because it is an infrared light. I'm worried it will overheat my VR headset. Do you have mounts for an HTC Vive? Currently I am only using velcro alone to attach it to the VR headset.
4. Switches are not easy to engage but it does work.
Thank your for taking the time to respond.
Hi! Answers to each question:
1. It's happening to me too. At first I didn't notice because I mostly used the left hand. In another comment someone said they're reporting the bug to ED, let's hope they find the source!
2. That's in the VR tab of DCS's settings, to the right, a combo box where you can chose which hands have a laser pointer
3. You can try the mount I designed for the reverb, maybe it works there too? It keeps the Leap a little more separated from the headset: www.thingiverse.com/thing:5445093
Cheers!
Oh:
4. You might try to use your hands in an angle where the leap can sense them better, that helps a lot. Angle them a little upwards so the leap has a full view of your hand, preventing occlusion of some parts of it.
@@fisadev Thank you so much Juan!
Still got problems with my leap motion. Very often one hand disappears and I need going back to the special folder to make an on off action …also it is tedious using it for rotating buttons. In fact it is quite usefull mainly for the VAB of MFD and in front otherwise you have to carefully adapt your environment to prevent blockade by furnitures. Using the positioning movement inside the cockpit helps a lot. I am using some buttons for up down fwd aft to close the hand to the buttons to activate but using a trackball in place of leap motion is also very convenient for flight in VR, faster and more precise.
Is there any documentation on how to setup and use Fingers?. I downloaded it and ran it but it does not seem to be doing anything. I have leap motion working and the ability to turn the hand off and on works great. I have a HP Reverb gen2 VR head set, so I set fingers to Generic. The status shows connected but what are the RINGS for? When I get in to DCS the hands work (on and off) and I can switch things (not always accurately ) but when I turn them off and point, nothing happens. That's why I think fingers is not operational. I do have everything set up in DCS per your video (no pointing,etc.) Thanks for all your videos and any help would be greatly appreciated. Doc
After switching both hands off in DCS, you should be able to point with your fingers to move the blue cross. If that happens, then Fingers is running, that's it's job. To be able to click you need to map buttons in DCS, for click and right click, in the UI Layer section of controls. Use spare hotas buttons for that. And the rings are an extra, if you have one of those Bluetooth rings you can click with them instead, without having to map hotas buttons to click when using the pointer.
@@fisadev thank you for the quick reply. It must not be working then. I do have the on and off for the left and right hand track to a button but what do you mean by mapping a button for a right and left click? I have to map a button on my Hottis for a right and left mouse click? Is that what you mean? So actually, I have to bind four different keys to my Hodos, correct DVR left and right hand and a left and right mouse click. Is that correct again, thank you for your quick reply.
@@anthonydallalio5716 yes, that's correct, if you want to use both the hands and the pointer from Fingers, you need 4 buttons mapped. If you are too constrained in free buttons and have to choose only one mode, I suggest using just the pointer mode with fingers and disabling the DCS Leap support, because with that you can do everything (with the hands there will be stuff you can't do).
@@fisadev OK I think I’ve got it. Thank you again.
Big news in patch 2.9!!
DCS made great steps in adding 3 axis for leap motion and regular hands! unfortunally it currently only works on left hand. The same 3 axis for the right hand would be excellent aswell! For now i can work around it and use my left hand in my real simpit aligned with the virtual one which helps a lot in immersion! Also made the option that hands are "not active" which is really beneficial so you dont accidentally activate switches.
Cool!! I have to try the new settings :)
@@fisadevseems to only work on the left hand so far. But good they give it some attention. Hope it gets more traction.
What you mean with "3-axis" and regular hands? That the blue mouse crosshair is now moving 3D instead just around the cockpit as on flat surface?
how to you speed up the hand tracking movement I find it slow tracking when gloves are turned off
I'm not sure what you mean by slow tracking. The cursor should move at the speed you move your hands. Does it has lag?
@@fisadev yes it legs when I am in the menus, might be because I also have it hooked to a 42 inch screen
Hi, do you have a video or recommend one on how to setup leapmotion on the PC . I am confused on the various type of software and configurations for use on Dcs.
Finger app just don’t work for me I am using the leap motion dll not the one provided with the app but I guess it is more recent. The app stay permanently in connecting position with generic mode for my G2
How you connect the cable of the Ultra and the cable of the T LINK in the only one port of the headset ?
I don't do any of those things, hehe. When I did the video I was using an HP Reverb, which is completely different to the Quest which I'm guessing you assume I had. It doesn't connect via usb link but through a custom cable, the Leap can't even be connected to that headset at all, the headset doesn't have any usb ports. Since then I switched to another headset which is similar to the Quest, I'm using the Pico4. The Leap Motion is connected directly to the PC with a long USB cable (secured to the headset straps with a small velcro loop), and I don't use a link cable either for the headset, I connect it to the PC via wifi 6. I usually have the headset connected to a power source for infinite playtime.
@@fisadev Thank you very much for your answer …..I wish you a Happy new year
@@Sirokko58 You're welcome, happy new year to you too! :)
Una pregunta. Tengo el fingers puesto pero no se mueve nada en DCS cuando estoy en VR. Tengo las Varjo y no se si tendrá algo que ver con ello. Sabes si hay que configurar algo en el programa fingers?
Buenas! No sabría decirte si el hand tracking de las Varjo está soportado por la app y si hay que hacer algo extra. En el caso del Leap Motion "normal", no hay que hacer nada, es suficiente con tener los drivers instalados y abrir la app. Quizás sería bueno preguntarles directamente a los devs de Fingers, por las dudas (acá podés crear un issue para eso: github.com/glenmurphy/fingers/issues )
For some reason mine sucks. It works fine in the program but if I even try to point, my finger just bends and warps. I cant press any buttons either cuz of how unstable it is. I really want to use this because it looks awesome so if there are any solution please let me know.
Edit: I found out that the issue is the Gemini software and there doesn’t seem to be a fix. The other part of the issue is just the bad implementation of Leap Motion in DCS.
Amazing, thank you! Can DCS use the Leap Motion in "pancake mode", without a VR headset?
Sadly no, it's only supported in VR right now.
I own an Valve Index, and have recently been seeing a handful of my friends get into DCS - I also own a sad excuse for a flight stick with a twist yaw. Is there nothing that will allow me to run DCS with my physical VR controllers to interact with the cockpit buttons?
You don't need anything special! DCS supports VR controls by default. Just enable them from the DCS settings (in the VR tab).
@@fisadev I did manager to find those controls shortly after seeing this video and making the comment - I found them to be incredibly clunky, and a bit haywire, taking more than 5 minutes tryingto figure out how to close my canopy on the P-51 lol. - It's my own fault for not watching the video further in, in my haste to find a quick answer. Now I've watched further, I didn't realize that "No Pointer" setting would allow me to physically interact with the controls, much in the way that VTOL vr allows. I'll have to load the game back up and give it another shot. Thanks for the relpy!
You ever thought of using a finger mouse and mapping you mouse buttons to that and another for the laser?
I did! But I couldn't find one that wasn't too intrusive. So instead I started developing my own "finger buttons" with some small arduino boards and tiny buttons. I'm still working on it, but honestly I've been procrastinating a lot on that project, hehe. I need to design a good mount and 3D print it, because the electronics are done and work pretty well.
I'm also using the Fingers app instead of the laser, because it lets me use more apps aside from DCS.
I’m using a foot switch to disable/enable the hands. Works awesome
ok, time to buy leap motion then, thank you for the video
Just got the hand tracker for the Pimax8kx, so far I've found it next to useless. It can barely track my hands, using the UltraLeap visualiser it can barely make out my hands it would seem, if I put them in front of a high contrast source like a window it grabs them fine, but anywhere else it just refuses to track.
Did you have any similar issues?
hi! No, in my case it tracks them pretty well under normal lights and even low contrast when using black gloves with a black chair and simpit pannels in the background. Maybe you need better illumination? Or maybe a cleaning of the tracker's glass? Or maybe it's just that the pimax one isn't as good as a standalone leap motion?
I really don’t understand why ED doesn’t have the user place their hands on HOTAS in the controls menu and calibrate the gestures and range of motion of moving the stick and throttle to maximum extents so as to say “hey DCS when my hands are placed here in this particular grabbing gesture and move from here to here… It is stick and throttle movements and disable virtual hands please!”
What should obviously happen is that you could configure this for each individual aircraft to allow customizable profiles per aircraft to accommodate different grips and hardware setups and for it to be automatic so as to give the user complete and full immersion in DCS and not have to reach for some hardware like a mouse or button box or hand controllers, etc, etc…
Ultimately the idea being to replicate the actions of a pilot IRL in terms of hand interaction inside a cockpit.
They should allow to draw boxes in the virtual cockpit by the player when in the cockpit, where the virtual hands would not interact with the cockpit.
We have beatiful and working 3D cockpits, where we are sitting. let us draw box and move it around that space to define things!
(Let us click the button/switch in cockpit and then bind it to HOTAS, no more menus to scroll! Call it as "Interactive Binding mode" ™)
We could even have those zones defined for different common actions, like "Eject" by moving both hands to ejection handles!
There is the setting that when your physical controller movement is detected, your virtual hands are hidden. Or at least it use to be there.
Excellent Idea, will look into implementing it!
@@paristo Also another excellent idea!
@@theegg-viator4707 you are able to implement it somehow?
Joystick/throttle manufacturers should start putting capacitive sensors inside controllers to detect when the controllers are held/touched. With that we could configure virtual hands to show only when needed.
How do you map the finger gestures of the leap motion controls if I may ask? And for me it seems like that I can't really interact with the Buttons. Flightstick and Throttle are working although I have deactivated this setting in the Special settings of Leap Motion. Tracking of the fingers are fine in the Gemini Software.
When using the DCS hands and pointer you don't need to map them, just pick the settings you prefer in the Leap Motion settings page. But I don't use that. When using Fingers as a pointer, there are no gestures to map. Instead you need to map two buttons from your hotas or joystick, to the left and right click buttons. That's under the UI Layer group of controls mappings.
how do you turn knobs like lighting, hud intensity, etc with the fingers ? do you click and move your finger as you would do it with the mouse? I will defenatly replug my leapmotion and check this update. many thanks on sharing this video. I dont get why ED did not talked about it in their own video devellopment.
Yes, like that, just like the mouse. Regarding ED, maybe it's too low priority for them? I don't get that either.
Hmm. I got the on/off switch working, but I couldn’t get it to ‘click’ any switch or move any of the levers in DCS. I packed it away again in frustration.
I’ll check your links and the comments and see if I can figure out where I went wrong.
If you are trying to use the switches with the hands, then the problem is probably that you have the DCS pointers feature enabled, which breaks the hands interactions. If you are trying to click with the Fingers app pointer, then the problem is probably that you have no click and right click mappings, which are configured in DCS's controls (UI layer section).
@@fisadev Unfortunately, that's not the case. I disabled the pointers feature-that's on the VR menu. I enabled the 'finger crook' click mode on the other menu. Unfortunately it didn't seem to work.
I tried using Matt B's OpenXR addon for hand controllers but just wound up making it impossible to start DCS- giving me some kind of an 'unrecognized controller' message. Anyhow, I've removed the hand controller module from my Pimax 8KX and everything is working as it should again.I wonder if the problem has something to do with the Pimax version of the firmware? Anyhow, the hand control doesn't really do anything I can't already do with a mouse in DCS VR. It would be really useful in a sim like IL2 in which the mouse doesn't function in the cockpit.
Cheers
Dave
:( I just bought this thing two weeks later..... I can see my hands but I can't physically interact with anything. :(
Quick Question. When I click on the finger app it just disappears. I cant seem to get it to work in DCS. Leap works as leap does but when I hide my hands the lazer pointer moves to my headset instead of my hands. I am running OpenBeta with Windows 11. Does your Finger App stay up and running?
Fingers should open and stay running, so there mist be a problem with the app on your case. Do you have mnet framework installed? It depends on it.
YES!!!!!!!!!
With leap how do you turn dials? Also, how is the latency of moving your hands? When you say map button that means you are push a physical button like a mouse click?
do u know if theirs a way to set keybinds on the controller them self?
Hi! I not sure I understand your question. Do you mean mapping VR controller's buttons to things in DCS? Because what I show in the video is not using any VR controllers, those are my real hands being tracked by a device.
What chair do you use? Cual es tu silla para el simulador
This is my current setup: photos.app.goo.gl/3kFNefMCKiu4Xg4j6 . The chair is a custom design, I designed it and a friend carpenter made it for me, and then I added some of the metal extras.
will this work on Falcon BMS? thanks
Point Crtl Killer!! Amazing update!
I wish it was possible to disable the hands but still have them visible
That's it... Grabbing one.
It's great you can disable hand interactivity but I would prefer it if the hands were still rendered. I fly the F-16 in VR but I have a physical ICP and a pair of Cougar MFDs so I'd like to be able to still see what I'm interacting with; I just don't want the hands to also interact while I do that. Personally, I would need the hands to interact with everything else, such as aux and side consoles.
Exactly. I don't want the hands to disappear completely. Seeing the hands and being able to designate what it interacts with would make it much more practical for me. 100 percent on or 100 percent off just doesnt work for me.
About to get this exact setup. Is there not a setting where you can see the hands, but not have them interact with anything? I was wanting to just be able to see the hands to make it easier to manipulate my MFDs and ICP, but then use the mouse for everything else. Obviously it would be better to be able to still use the hands for manipulating virtual switches. Also, how easy is it to keep the calibration consistent so your hands match the placement of the actual MFDs and ICP?
is this still working on dcs 2.9?
How did you setup gloves? I have only bone hands
Are you talking about DCS? Or the Leap Motion test app?
Based on this vid I've just bought a Leap Motion from ebay, hopefully its easy to setup!!
i could never get dcs to recognize the leap. How is this possible!?
I have another video in which I explain all that's needed (driver, settings, etc). It's in Spanish, but just looking at what I do you can probably understand what's needed :)
thanks for the updates! Have you tired the F14 already? is it working for F14 now? From what I have heard, the leap motion is not supporting 3rd party mods.
The pointer thing using Fingers works with any module that has a clickable cockpit. The hands rendering and interaction, only works with ED modules for now.
Are the Index knuckles controllers fine instead of leapmotion?
Not for me. It's quite cumbersome to have to release the hotas and find the VR controllers while being blind, and then after using them finding a place to leave them while still being blind, and having to do that constantly is disruptive in moments where you have to act quickly. Before the Leap Motion, I was more confortable using a trackball than trying to use the VR controllers.
How do you use these with all that head shaking?
The shaking is an artifact of the recording field of view. That's the normal level of head movement, you just don't notice it in everyday life and when inside the vr headset, because of the bigger field of view and the stabilization of the eyes. When recording a smaller fixed and non stabilized rectangle inside that FOV, the shaking becomes more visible.
I m out of the subject 😂 but is their any software mapping for hand tracking on pico3/pico4 to start experimenting with flightsims?
I don't know much about the Pico headsets, sorry!
Buen vídeo gracias, tengo el leap desde que lo implementaros en DCS, pero tras varias actualizaciones perdí la motivación ya que era imposible de utilizar... quizás le de otra oportunidad... ¿Cómo está el tema de los botones rotatorios? ¿Los detecta ya mejor?
Los rotatorios todavía son raros de usar con las manos de DCS, pero con Fingers es muy fácil porque funciona de la misma forma que con el mouse (mantener apretado el click, y subir o bajar el cursor/mano).
¿Y hay forma en la app Fingers de hacer click con un gesto, o solo es posible mapenado un botón del joystick?
@@gonvise no hace clicks con gestos, así que hace falta mapear algún botón. Por eso estoy también trabajando en una "botonera" para los clicks que quede en los dedos mismos: th-cam.com/video/rzRWZ1gR2Zg/w-d-xo.html
is this possible to do with the built in cameras on the valve index?
Not that I'm aware of, but I suggest googling just in case.
GOOD AFTERNOON, I AM ABOUT TO BUY 3D GLASSES BUT I WANT TO HAVE THOSE HANDS AS SHOWN IN THE VIDEO, IS QUEST 2 OR PICO 4 SUITABLE? AND BESIDES THIS ADAPTER?
Hi! No need to scream, hehe. I use a Leap Motion for the hand tracking, it's a separate device and not part of the VR headset. I don't have experience with using the headsets hand tracking, because I fly with Virtual Desktop, which doesn't yet support that way of hand tracking.
Por las dudas, soy de Argentina también, así que podemos hablar en español :D
jaja perfecto. gracias por la respuesta. estoy armando un f16 la idea es poner Oculus pero dicen que el handtracking que tiene no es lo mejor, y lanidea era buscar alguna variable para que si sacarse la máscara se puedan usar bien las manos
te puedo escribir a algún número?
@@tmasimuladores youtube no me deja postear el número de teléfono acá. Pero me pueden encontrar en Twitter e Instagram con el mismo nombre de usuario.
Did you try to mount controller not on headset, but on sim rig or desk?
DCS doesn't support that. The hands info is interpreted as relative to your head position inside the VR world, so if the sensor isn't in your head, your virtual hands would move absolutely out of sync with your real body.
i've never used the FIngers Application (linked in github). What is the improvemenet? Something different from the ultraleap software/driver?
it's not an alternative to the driver, but an app that runs on top of it, adding the finger-as-a-cursor feature (that the driver doesn't do by itself)
@@fisadev ah! thank you
I tried this and works pretty well.
Shame it doesn’t work for MFS2020.
Works in the menu but not in game.
Now we just need native support for Quest 3 handtracking
based in your experience, what VR gloves are better for DCS?
Hi! Sorry, I haven't used any VR gloves yet. Only hand tracking using IR cameras (Leap Motion).
oh cool - ill check later
Love this. Ordered it right away.
Any recommendations on the choice of buttons for the keybindings.
In my case I'm using a front switch in the hornet grip from winwing for click and right click (it's a two way and apring loaded to the center), so my left hand is clicking while my right hand is pointing. And to show/hide the hands I use a couple of my stick buttons (winwing F16EX) that I find kind of hard to use in combat, but they're good enough for this, as I only use the DCS hands in calm situations.
@@fisadev thanks. Tried it but to me the leap with hands is just too much of a hassle tbh.
Now i turn off the mouse in vr and assigned left and right mouse button to my joystick. Works fine mostly but for really nearby buttons to my left and right I would love to swap to the mouse (head won't turn that narrow) but ED needs to make a "mouse on/off" binding for that.
couldn't we map the hand enable/disable by just pinching the index with the thumb ? this way we dont need a button.
Right now there's no feature for that in DCS, and I don't know of an app that lets me do that either.
Nice, but i dont need a key to show and hide hands but a key to enable and disable touch interactions of the hand. I want to always see my hands.
That would be nice, yes. But the feature we got is still quite useful. Before it was unusable, now it's usable, and your request would make it even better.
@@fisadevany updates? ^^
it's finally possible!!!
just choose "No pointers or touch" in DCS VR options@@fisadev
Hi Juan, what part does the Fingers app play in this? I wish I could get the kind of accuracy you are!
Hi! Fingers is the one moving the mouse cursor to where the hands are (assuming a front-facing mount). The LM drivers don't have that feature by themselves.
@@fisadev ah ok.
I re-listened to your tip about turning off the lasers. I had mine disabled, but they were showing anyway. I toggled that setting, made sure they were off, and now it's working FAR better than before. That's an important setting.
I noticed the right hand disappearing sometimes and that if I go into options and toggle the master leapmotion on/off it comes back.
looks like the rotary knobs are the biggest challenge.. but this is now much better overall than reaching for sleeping VR controllers.
thanks!
@@bryanmyers9977 Hlad to hear that! Regarding the disappearing hand, yes, many are having the same issue and it's some weird invisible interaction with the virtual stick. It's been reported in the ED formus too.
Hello, thanks for the comprehensive video! I am curious if you are using the Pimax specific hand tracker the fits just under the headset or are you using a different leap/ultra leap motion controller? Thanks
Thank you! I'm using a normal VR headset (HP Reverb G2) with a Leap Motion attached to it :)
Thanks. Looks great. Tested it today since my HOTAS got delivered today as well... Problem: The Fingers application keeps crashing on my side. Any clue?
Oh, no idea. Does it work but then crashes? Or just crashes right away and never starts? If that's the case, then maybe you are missing the .net framework it requires?
@@fisadev It starts and shows the UI and than it closes the window without any error message... Do I need to copy the both files into a specific folder or something?
@@CagatayOezbay You just have to extract both files to any folder you want, and run the exe. That should be enough. If you were just running the exe from inside the zip file, then that's the issue. If you already had extracted them, then you should post an issue in their github repo, maybe they can help.
@@fisadev Will get in contact with the guys. Thx.
If anyone is bothered about the same problem of crashing on startup Fingers.... Make sure that the Bluetooth driver is installed and enabled. Just installing it is not sufficient. Bluetooth must be enabled!
Thanks to the developer ;)
Hi! Thanks for making the video. Could you let me know if it works through gloves? If you are wearing some thin gloves. That’s how I like to fly and wondering about it. Thank you!!
Ok! I'll try and report back :)
Update: I just tried with black gloves, and it worked really well :)
@@fisadev thank you so much for trying it! My order is in already :)
We need some sort of usb pressure switch we could tape to it stick n throttle to enable and disable
I was thinking on building something to attach to my hands, both for that and also for clicks with the pointer.
Hola Juan soy un gran aficionado a la avicion, para hacerlo más real tengo las Vr...y lo de los guantes es una asignatura pendiente...tengo dificultad con el idioma. Me podrías indicar como realizar todo el proceso en castellano, si es que dispones de esa documentación, muchas gracias, comentarte que aca en la zona que resido practican la esgrima antigua completamente documentada y simulan en físico las técnicas de espadas, mediamano, florete, etc etc
Buenas! Tengo otra versión en español un poco más vieja y más detallada. La principal diferencia es que en esa versión en español explico cómo usar la app Fingers y no usar las manos de DCS directamente, por el problema que tenían, pero ahora ese problema está relativamente solucionado. Así que el cambio sería que si querés, podés dejar habilitado el soporte de Leap Motion de DCS, y mapear los dos botones que quieras para mostrar o esconder las manos (en la sección de controles > grupo UI Layer > grupo de VR). Lo demás, está todo explicado: th-cam.com/video/8Nd2RoA5-ts/w-d-xo.html
Sobre esgrima histórica: genial! De dónde sos? Yo estoy un poco alejado ya del tema, pero sigo haciendo un poco de práctica de corte igual.
@@fisadev muchas gracias me pongo en ello
@@fisadev soy de Manresa cerca de Barcelona España y es mi señora la que domina el tema, hacen exhibiciones en ferias medievales y hacen quedadas con diferentes grupos de toda España.
I installed the 5.7.2 version of the Ultraleap software and followed your steps from this video (thank you for sharing Juan Pedro!). My hands are visible in DCS and displayed correctly.
However, it takes a lot of tries to flip a switch (tested in the KA-50 III and the SU-25).
Do you need the Fingers app to be able to use your hands to flip switches?
Do I need to overwrite the Leap .dll file in my DCS installation with the one from either Ultraleap of from the OpenXR installation?
Fingers isn't required to be able to flip switches. Are you sure you have the laser pointer option disabled in DCS? And you don't need to override the libs.
super!! i have to try!
How is the tactile feedback? I guess it’s a weird sensation since you’re not actually touching anything and the finger tips are very sensitive to touch.
It does feel a little weird not having the tactile feedback, but I got used to it really fast.
I guess I have to take a serious look at the controller then. Right now I have a lot buttons but I can’t remember what they’re assigned to.
Is that VR headsets aways shaking this much?
This is an artefact of recording VR. It looks jerky but the experience in the headset itself is totally smooth.
I wonder if there's software that can utilize the quest 2s in built hand tracking. Would be really awesome to use this without having to spend more money.
Meta decided not to share the hands tracking info with desktop apps, only available for apps that run on the headset.
Not sure how well it works but it's out there.
Good news! Thanks!
?Que tal los rotatorios? ?se pueden rotar bien? Gracias!
Con las manos visibles, es muy difícil usarlos. Con el pointer de Fingers se usan bien fácil, simplemente haciendo click (con los botones del hotas que hayas mapeado para click), igual que si los usases con el mouse.
@@fisadev Al final acabarás utilizando solo una mano ?no? Por eso de tener que presionar botones del hotas…
@@pabletesoy En mi caso tenía botones libres tanto en el stick como en el throttle, así que me mapeé click izquierdo y derecho en ambos, para poder usar ambas manos. Pero eso es gracias a que tengo un hotas con muuuchos botones, entiendo que no es el caso en hotas más normales.
@@fisadev Ooook, muchas gracias!
?Hay mucha diferencia entre el Fingers y el Touch free ?
I bought the LMC thanks to this video. I have to say, it's great when it works in DCS -- however my hands often disappear in-game and never come back (regardless if I hit the show/hide hands bind). I often have to restart the game or toggle settings to have them finally come back. They always look good in the actual LMC control panel. Any ideas on how to fix this from happening?
I started having this issue too, and I'm not sure of the cause. Though I suspect it may be related to having two apps trying to access the leap data (DCS and Fingers) at the same time. If I find the real cause or a solution, I'll post it.
@@fisadev I'm not using fingers and having the same issue. My theory is DCS is overriding the LMC with its own mouse cursor interaction, the same way I've heard pointctrl doesn't work with LMC because it uses the DCS mouse pointers (they apparently take the highest priority when deemed active)
@@PoorYurik Might be related to that then! Thanks for the info, because this means that I might be chasing the wrong problem when trying stuff like how I boot Fingers, etc.
@@fisadev I submitted this issue and additional info to both the Ultraleap discord (#help-and-support channel) and DCS discord (channel #dcs-bug-reporting-forum) with screenshots of our conversation. Fingers crossed.
@@fisadev A DCS forum post helped me figure out what the issue is. To verify if the solution works for you: enable hands control throttle and flightstick in the in-game Leap options under Special. Then see if the hands disappear.
Cause: it appears that the hands are disappearing because the natural continuous input of the joystick and throttle are disabling the hands when those options are set to disabled (i.e. it disabled the hands whenever axis input on those devices is detected).
As further proof, I got the right hand to continue working with hands control flightstick disabled by setting a large deadzone on my joystick axes.
Once you try enabling flightstick/throttle control with hands, let me know if it makes the hands stop disappearing for you and I'll pass it on to the Leap and DCS discords.
I might have to get one of these now. I take it they work fine using a Quest 2 connected to the PC. Is the hand response fast and realistic?
thanks for the video, i tried using it but couldn't click anything, i see my hands but that's it
The most painful thing is the shimmering in VR and to try to find a helicopter in a jet. Apparently I can only see things after I die.
It sounds like you need to up your Graphics then.
@@ligmasack9038 Or hope soon ED can optimise DCS to utilise everything my current hardware could offer? Things in the 2023 and beyond video gave me that hope.
@@2612563 I mean you are asking quite a bit from an AMD Card...
@@ligmasack9038 RTX 3080, it is a AMD motherboard though you are half right.
@@2612563 I'm running a Ryzen 9, w/ a 3080 FTW3 and 128GB's of RAM myself. Steam VR is the main problem with DCS VR (if you are playing through Steam) and I ended up going from 32GB's of Ram to the aforementioned 128GB's and it fixed most issues. RAM is the cheapest performance upgrade you can make.
i have one and i never can use good this leap motion
do you use this "VR Developer Mount" attached to the VR headset?
No, I use a less intrusive mount that I designed and 3D printed myself: www.thingiverse.com/thing:5445093
Are they working on a way to use the quest 2 handtracking?
That's not possible, sadly, because Meta decided to only provide the hand-tracking api to games running in the quest itself, not available for PC games.
@@fisadev That's possibly the stupidest thing I've seen Meta do. I don't understand why they would do such a thing
@@Pablo_lens I'm not sure it's the stupidest (they do a lot of stupid stuff), but yeah, it's stupid :/
@@fisadev I’m really trying to get hand motion without having to pick up and put down the quest 2 controllers. Any tips that could help me?
@@Pablo_lens I don't have a Q2 here to try, but I **think** that you can enable hand tracking in the headset itself, and it simulates joysticks for the desktop apps. You won't get real fingers tracking like with the leap, but you will see a hand where your real hand is, and DCS will treat it like a VR joystick. I don't know how well the clicking will work, but maybe you can use them as pointers and map buttons for the clicks if that doesn't work well.
Great video ! May I know where did you bind the clics when using fingers app? Do you have an extra device for that ?
Right now I'm using buttons from my HOTAS (I have a Winwing stick and throttle, they have plenty of buttons). But I'm designing a device with just a couple of buttons to mount over my hand or in a finger (smaller and simpler than PointCtrl, no batteries and just two buttons)
@@fisadev You do not need the Fingers app when you are using the buttons from your HOTAS?
@@fisadev I'd like to hear more about your idea for finger "clickers". I've found some ring style remotes for cell phones but they are all bluetooth so I doubt they would work for PC but the concepts are right.
@@MrLotengo I'm planning this: a small arduino usb stick with a couple of cables that go to my fingers. The arduino itself is in the usb port of the PC (it's a very small one with an integrated usb connector), only the cables and buttons at the end of the cables are in my hands. So I only need some type of ring/support/whatever to hold those two buttons in my hand, and the rest of the electronics are at the other end of the cable, not getting in the way.With a small velcro band I could keep the middle of the cable attached to my arm, so the cable itself isn't an issue getting tangled in stuff when I move.
I have to build it and try it, maybe it works :)
@@fisadev You could use a wireless dongle to dongle connection from Pc usb to 2 receivers (1 on each hand) to register the clicks. 🙂 This eliminates any wired hands issue to the PC. May use a coin cell battery per hand for the power supply.
So you cannot twist knobs yet, correct? Also, I think it would be good if ED would make options in binding to state which bindings cannot be interacted with (instead of turning hands off), such as all the bindings you do have on your HOTAS.
With the hands technically you can, but I don't understand the logic of it. They do move, but as far as I can tell it's kind of random. With the pointer (Fingers) you definitely can and it's easy to do it (just like with the mouse).
you can, but you have to push the rotary around, rather than pinch and twist like you would IRL.
Quest 3 makes Leap Motion obselete. ED, please take advantage of Q3 hand tracking!
Hey is it working with track ir ?????????? Pls say yes :D
I didn't try the most recent updates in 2D, but in previous versions were vr-only. Will try again just in case.
Update: it still doesn't work outside VR
@@fisadev hmmm okay thank you, i hope it will work with track ir one day
excelente video !
Hola Juan, muchas gracias por el video.
Debo decirte que tengo el dispositivo (para Pimax) desde que salió y constantemente pruebo si funciona...
Con tu video trate una vez más, y esta vez si pero.... no funciona presionar el teclado numerico (UFC) como alguna vez funcionó. La unica forma es habilitando el pointer lo que no es optimo por lo que tu demuestras en tu video.
Muchas gracias de todas formas.
Hola! En qué avión estás intentando hacerlo? Porque en el F18 y F16 yo lo probé y sí funciona.
@@fisadev En el JF-17, pero traté en el F-16 ya que recuerdo que hace algun tiempo (antes del DCS 2.7) cuando volaba ese avion, el Leap motion funcionaba relativamente bien hasta que con las actualizaciones nunca mas funcionó... hasta ahora que al menos se ven los guantes.
Pensé que quizas con FingerApp podría, pero mal interpreté su uso y pensé que bastaba ejecutar ese programa, pero se necesitan los rings.
@@colmillo65 No se necesitan los rings para Fingers, en vez de usar los rings podés mapear dos botones de tu HOTAS para hacer click y click derecho.
En el JF17 el soporte para tocar cosas con las manos nunca anduvo, porque eso es solo en cabinas de aviones hechos por ED. En el F16 sí funciona. Y fingers, con los clicks, funciona en todos, incluyendo el JF17.
Acabo de reciclar en Specials (THUMB PRESSURE / INDEX BENDING / THUMB PRESSURE), y ahora si puedo usarlo en el F-16 y F-18, pero no en el JF-17
@@fisadev Mmm, trataré de nuevo. Porque al ejecutar la aplicacion el puntero del mouse aparece en un area restingida a la derecha de la pantalla... Gracias Juan
Is this your actual FOV???
No, the desktop mirror shows less than what you see in the headset :/