Detection, Tracking and Prediction using only LiDAR for Autonomous Driving

แชร์
ฝัง
  • เผยแพร่เมื่อ 4 ก.ย. 2024

ความคิดเห็น • 30

  • @nurbekhalikulov8867
    @nurbekhalikulov8867 4 ปีที่แล้ว

    highly depth information using LiDAR. Well done

  • @mohamedahmedsayed9330
    @mohamedahmedsayed9330 ปีที่แล้ว

    Using transformers model in domain adaptation for lidar sensor
    any suggestion for this approach ?

  • @bradstewart7007
    @bradstewart7007 4 ปีที่แล้ว +2

    If this is just lidar, how does it see crosswalks. I assume those are from HD maps. There is no autonomous driving without solving the vision problem.

    • @Vamanation
      @Vamanation 3 ปีที่แล้ว

      Ofcourse its from some streetUI here but LiDAR can be used in case of retroreflective paint strips.

    • @bradstewart7007
      @bradstewart7007 3 ปีที่แล้ว

      @@Vamanation Perhaps, but that's only useful if every road has retroreflective paint strips. Waymo does a lot of its most impressive stuff with its cameras and AI. Tesla FSD beta understands it surroundings very well with cameras and radar, even if it's not 100% there on doing the right thing in every situation.

  • @saikiranpasupuleti5803
    @saikiranpasupuleti5803 3 หลายเดือนก่อน

    could you provide the code for object tracking for lidar data

  • @nurbekhalikulov8867
    @nurbekhalikulov8867 4 ปีที่แล้ว

    Is not it easier using radar instead LiDAR (or at least do sensor fusion) in order to get an advantage in extreme weather conditions or/else in the night mode?

  • @jin-heelee3267
    @jin-heelee3267 3 ปีที่แล้ว +1

    Hello, I wonder that multi-object tracking result comes from the UKF filter & Hungarian AL. Also, I would like to know your know-how, a paper or technical document that I can refer to for your great tracking technology.

    • @yukihirosaito7783
      @yukihirosaito7783  3 ปีที่แล้ว +1

      tracking is hangarians and pseudo-EKF. I use a simpler method than JPDA or MHT. I believe that know-how is very important when it comes to tracking.
      Tracking is currently being rewritten to be proper.

    • @jin-heelee3267
      @jin-heelee3267 3 ปีที่แล้ว

      @@yukihirosaito7783
      Thank you very much for your answer. I expect a new tracking algorithm.
      I have two questions. I wonder if 2D tracker is also developed in the current version, and cost of tracking algorithm of the current version.

  • @UStraveler10
    @UStraveler10 3 ปีที่แล้ว

    Is it work for quanergy M8 lidar?

  • @sudheerreddy2982
    @sudheerreddy2982 3 ปีที่แล้ว

    looks impressive, and I’ve to Predict the Pedestrian using only Lidar data. It would be really helpful if you could provide me with any suggestions ?

  • @demjohn1891
    @demjohn1891 3 ปีที่แล้ว +1

    Are you using the autoware framework?

    • @yukihirosaito7783
      @yukihirosaito7783  3 ปีที่แล้ว

      yes
      github.com/tier4/AutowareArchitectureProposal

  • @hangzhou4333
    @hangzhou4333 4 ปีที่แล้ว

    Hi, I was wondering does the prediction result come from the kalman filter? Or there is an separate algorithm for prediction

    • @yukihirosaito7783
      @yukihirosaito7783  4 ปีที่แล้ว +2

      Soon all code will be open source.
      Prediction is based on following papers.
      1. Optimal trajectory generation for dynamic street scenario in a frenet frame
      2. Vehicle trajectory prediction based on motion model and maneuver recognition

    • @keningchai6545
      @keningchai6545 4 ปีที่แล้ว

      @@yukihirosaito7783 ]with is your github name?

  • @user-zj5ny6dm1c
    @user-zj5ny6dm1c 4 ปีที่แล้ว

    Hello, did you using point pillars deep learning model?

    • @yukihirosaito7783
      @yukihirosaito7783  3 ปีที่แล้ว

      this is not point coud instance segmentation, not point pillars.
      However, I have recently found a better method and am in the process of changing it.

  • @newtechempire6785
    @newtechempire6785 ปีที่แล้ว

    can you provide the code? thanks

  • @markfuck2538
    @markfuck2538 3 ปีที่แล้ว

    useing kalman?

  • @subhashchandra2041
    @subhashchandra2041 4 ปีที่แล้ว

    Whats the cost ?

    • @yukihirosaito7783
      @yukihirosaito7783  3 ปีที่แล้ว

      Using gtx 1080, detection is 20msec, tracking is a few milliseconds.

  • @user-cv1uv5uw8k
    @user-cv1uv5uw8k 4 ปีที่แล้ว

    what used algorithm?

    • @yukihirosaito7783
      @yukihirosaito7783  3 ปีที่แล้ว +5

      detection is deep learning based point cloud instance segmentation.
      tracking is hangarians and pseudo-EKF. I use a simpler method than JPDA or MHT. I believe that know-how is very important when it comes to tracking.
      code is here : github.com/tier4/AutowareArchitectureProposal
      github.com/tier4/Pilot.Auto/tree/master/perception/object_recognition
      Tracking is currently being rewritten to be proper.