Flight Control By Speech Recognition - FlightZoomer 3 Feature Preview
ฝัง
- เผยแพร่เมื่อ 18 ต.ค. 2024
- FlightZoomer 3 allows to control the flight of your RC plane, your multicopter or your UAS by voice recognition.
The grammar of the voice commands is this (in EBNF):
digit = “zero” | "one" | "two" | "three" | “four” | “five” | “six” | “seven” | “eight” | “nine”;
activateAutopilot = (“activate autopilot” | “switch autpilot on”);
deactivateAutopilot = (“deactivate autopilot” | “switch autpilot off”);
turnRight = “turn right”, digit, [digit], [digit];
turnLeft = “turn left”, digit, [digit], [digit];
setSpeed = [“set”], “speed”, [“to”], digit, [digit], [digit], [digit];
startDescend = “descend”, [“to”], [“altitude”], digit, [digit], [digit], [digit], [digit];
startClimb = “climb”, [“to”], [“altitude”], digit, [digit], [digit], [digit], [digit];
tuneILS = (“tune” | “set”), “I L S”, [“receiver” | “frequency” | “to”], digit, digit, digit, “dot”, digit, digit;
activateAPPmode = (“activate” | “arm”), [“the”], (“approach” | “I L S”), [“mode”];
readBackAccepted = (“affirmative” | “accepted” | “positive”);
readBackRejected = “negative”;
correction = “correction”;
Meaning of the notation:
format: ruleName = chain of text portions, separated by commas
["some text"]: can be spoken or left away
("text a" | "text b"): one-of text portion
"text": terminal string
++ Release of the apps is imminent! ++ With launch discount the apps will be available for free! ++
Ich staune was alles möglich ist Wow, echt fantastisch. Braucht sicher viel bis sowas mit spracherkennung funktioniert, TOP.!!
Ja, das Ergebnis ist in der Tat ziemlich cool (wie auch beim PushbackZoomer, der ganz änhlich funktioniert), du wärst aber erstaunt wie im Grunde einfach sowas programmiert wird. Hier ist das Sprechen aber auch nur ein Inputkanal neben Touch, Maus oder Surface dial. Damit lassen sich Kopter und RC Flugzeug wie eine 787 fliegen. Die App gibts als Freeware im MS Store, inkl einem Simulation Trainingsmodus.
@@VideoBaschtler top.!!
Very impressive! Congrat!
cool video
That is really cool!
Echt Cool, selber fliegen macht dann schon mehr Spass :)) ich spreche aus Erfahrung.
Ja, Tom, ich weiss ich habe einige Videos von Dir gesehen! Diejenigen vom Loorholz wurden nur wenige Kilometer von meinem Wohnort aufgenommen (und wo auch mein Video oben aufgezeichnet wurde).
@@VideoBaschtler Die Welt ist klein ;-) eine Frage, wäre es möglich deinem system ZOOMER PUSHBACK die kommando für Gepäck anfordern damit Gepäck hinrollt und einläd sowie Catering Service mit einem Wort zuaktivieren? Geht das?? Das wäre der HAMMER..!! Wünsche ein schönes Weekend ich geh jetzt mein Geburtstag Feiern :)
1) Is source code available to be able to program custom grammars and behaviors?
2) Is it feasible to add video processing so copter or drone can do things such as "follow me" or "follow object" or be able to automatically avoid obstacles it can see?
Reply to 1): The supported commands as listed in the expanded comment above can not easily be extended. But the grammar itself could be rather easily made adjustable by letting the user pick a self defined SRGS XML grammar file from the file system. Also adding different languages should be doable. That way, the wording, that triggers the supported commands could be changed feely. It does require a small code change though, so in case of interest, I could provide it.
Reply to 2): These features unfortunately are not on my short list. Regarding obstacles avoidance FlightZoomer already supports safe IFR flying using the instruments alone even at low visibility. The Terrain map provides unrivalled situational awareness about the surrounding terrain (compared with other entry level GCS's).
@@VideoBaschtler Than you. I will assume from your replies that the UWP project is not open source and that there is no video processing currently in the project. To further define what I was eventually hoping for, would be a drone-robot that can be told what to do, with eventual video based object recognition, using Microsoft machine learning. Such that the drone could eventually be told things like "drone, watch me from 10 feet away, go". And the drone will take off and look around and self-map me and any obstacles in the area such as the tree and tree branches, and then track me as I climb a tree, avoiding both running itself into tree branches and positioning itself so that no tree branches are in it's line of sight to me. Or, "drone, get that car's license plate, go", and it would see where I was pointing to, see the car I was pointing to, fly over to it, maneuver to see the license plate, take a snap shot, and then fly back to me; all while dynamically avoiding any obstacles it can see, such as moving traffic.
Do you know when the app will be available ? I am disabled and this might be very helpful.
Thank you.
I am glad to announce, that release will be with days now!