3D Object Detection and Tracking using YOLO4 in Autonomous Vehicles
ฝัง
- เผยแพร่เมื่อ 9 ม.ค. 2021
- The video represents state-of-the-art 3D object detection, Bird's eye view localisation, Tracking, Trajectory estimation, and Speed detection using a basic surveillance camera and YOLOv4 Deep Neural Network framework.
This video is part of our research conducted at the University of Leeds, Institute for Transport Studies, UK
by Mahdi Rezaei and in joint collaboration with Mohsen Azarami and Farzam Mohammadpoor.
The preprint of this research is available at arxiv.org/abs/2109.09165 - วิทยาศาสตร์และเทคโนโลยี
![ไหล่อ่อน (Soft Shoulder) - Atom ชนกันต์ [OFFICIAL MV]](http://i.ytimg.com/vi/HUWl53msBQY/mqdefault.jpg)
Amazing article! Thank you so much for including a link to it
Glad you find it useful!
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
That's a cool idea. Never thought about 3D detection using YOLO. Waiting for the paper to read more details about this research work.
Thank you for your interest
Glad to let you know that the preprint of this research is now available at arxiv.org/abs/2109.09165
@@DrMahdiRezaei Thank you for your reply sir. I recently saw this preprint via your LinkedIn post. Great Work
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
@@DrMahdiRezaeiwhere can find the source code？
This project is fabulous 👍
Glad you liked it!
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
thank you
You're welcome
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
Very interesting. What are the computational requirements for the processing? Also, how domain specific are your methods, or how easly could your methods be applied to other domains, such as social video clips?
Thanks. We will publish the pre-print of our work soon and I would say most of your questions are answered there in details. You may check my Google Scholar page from time to time for publications update.
Glad to let you know that the preprint of this research is now available at arxiv.org/abs/2109.09165
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
Oh, very interesting for engineering traffic in urban.
Thanks for your interest and your comment!
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
Hi, The idea looks very interesting and thank you for this video. can this idea would be applicable to Micro areal vehicles with monocular camera?
The detection and tracking is possible, but the 3D estimation would not be possible without some extra modifications and geometric analysis. The height and angle of the areal vehicle is also required. The computational cost would be also higher because the areal vehicle is moving with a continuous change in its position and angle.
@@DrMahdiRezaei very helpful , Thank you!
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
Hello Mahdi Rezaei! This is pretty cool, Would you like to share how to locate the object on a map (bird's eye view)? Thank you :)
Hi Zulfa, onc we publish our work it might be available in our GitHub.
@@DrMahdiRezaei Thank you! can i get the GitHub address?
Glad to let you know that the preprint of this research is now available at arxiv.org/abs/2109.09165
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
This is really nice project. How you created this road map for bird eye view? and how this road boundaries and object bounding box is exactly matching on this bird eye view? can you please explain? Thank you.
Thanks for your interest. This is gained based on the fusion of CCTV ground image, satellite image, and road semantic segmentation. We will publish our preprint soon, hopefully in a couple weeks from now.
@@DrMahdiRezaei Thanks for your reply. It is like you take small portion of your CCTV ground image (4 src points for perspective transform) then that portion you mapped to satellite image(where we have to give destination 4 points). is it like that? can you please explain this thing....
Thank you..
Glad to let you know that the preprint of this research is now available at arxiv.org/abs/2109.09165
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
How did you do 3D object detection on Yolov4? Can you share a little idea?
It is based on combination of a mathematical modeling, displacements, angle of movement, and tracking. We will discuss this in our paper which is under progress and will be published in a few months.
Glad to let you know that the preprint of this research is now available at arxiv.org/abs/2109.09165
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
Great job, and I have doing the same job but I need a hight quality datasets, could you share the trainning datasets source?
Thanks for your interest. We have not used this video for training purpose. It is only used for testing. The video belong to the University of Leeds and it is protected under the UK General Data Protection Regulation (GDPR). You need to use other similar CCTV videos.
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
Hi ,it's really nice work! Can you share the MIO-TCD dataset ? Thanks！
It is not our dataset. Just Google it and it is there.
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
Hi Mr Mahdi, is there any paper related to your work? interested to read
We are currently working on it to publish it as a research paper. Not yet published.
Glad to let you know that the preprint of this research is now available at arxiv.org/abs/2109.09165
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
Do you have any github code available? It would be awesome to play around with real code. Amazing stuff you are doing out there!
Not yet
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
Hi, it is really cool! Can you share your published paper about this and perhaps with the github (if any)? Thanks!
Glad to let you know that the preprint of this research is now available at arxiv.org/abs/2109.09165
@@DrMahdiRezaei Thanks a lot!
You are welcome.
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
did u publish this work yet?
Hi Moodi, not yet but we will publish the pre-print of our work soon, as the journal review process may take ages. Please keep an eye on my Google Scholar page for publication updates.
Glad to let you know that the preprint of this research is now available at arxiv.org/abs/2109.09165
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
What a good idea, did source code will release soon ?
Thank you for your interest Didi. Currently we are discussing with some 3rd parties who are interested in commercialising this project. Therefore, unfortunately, we are not allowed to release the code at this stage.
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
Are you using lidar?
No, it is just a CCTV camera.
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
Very interested about your work. I am wondering the progress of your paper
Working on it with some extra features and developments
@@DrMahdiRezaei Thx! And when will we see your paper in preprint version?
Hopefully in a couple of weeks from now. Just performing some further experiments. Thanks for your patience.
Glad to let you know that the preprint of this research is now available at arxiv.org/abs/2109.09165
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
Will the code for this project be released anytime soon?
We are discussing with Leeds City Council. If they want it as a commercialised product, we may not be able to share it, unfortunately. However, we have already provided a good amount of details in our open access article. Hope that helps.
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
which dataset are you using?
This is based on a dataset collected in Leeds, UK as part of a joint project with EU.
@@DrMahdiRezaei is there any link which I can reference?
Not at this stage as we have not published our research. You may check later or subscribe to get notified about future updates.
Glad to let you know that the preprint of this research is now available at arxiv.org/abs/2109.09165
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
Is the paper out yet?
Not yet, we are working on it.
Ok, thanks a lot.
And good luck
Glad to let you know that the preprint of this research is now available at arxiv.org/abs/2109.09165
Great
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
it is public avaiable?
No yet, Hammad.
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.
So basically we can make a robot which detects human and:
If box_is_blue {
Kill
}
Well, this is not the purpose of this project :)
sir code is where?
We have not shared the code.
I am glad to let you know that the updated version of our aritcle is published in Elsevier "Expert Systems with Applications" plus the SOURCE CODE! See the descrption of our last video for more details.