Deep learning Workshop for Satellite Imagery - Data Processing (Part 1/3)

แชร์
ฝัง
  • เผยแพร่เมื่อ 1 ต.ค. 2024

ความคิดเห็น • 96

  • @650AILab
    @650AILab  ปีที่แล้ว +9

    1/3. Data Processing for the Satellite Imagery (th-cam.com/video/3Xn21RT-y7Y/w-d-xo.html)
    - Data Preparation &Satellite Data Processing
    2/3. Deep Learning with Satellite Image Data (th-cam.com/video/UBzMgr6yfpw/w-d-xo.html)
    - Deep Learning Model Training, Prediction with model performance
    - Local Debugging
    3/3. Advance Deep Learning with Satellite Image Data (th-cam.com/video/i40ulpcacFM/w-d-xo.html)
    - Remote debugging with Weights & Biases
    - Model Saving and Reloading with custom metrics and loss function
    - Activation/Gradients outputs with heatmap,
    - Model Deployment application and Model Serving app on Hugging Face

    • @3minuteswithkarim
      @3minuteswithkarim ปีที่แล้ว

      Instead of using Dubai Dataset can i use Sentinel-2 3 months composit image for classification? can yoou share a video how to do it?

    • @betescience8553
      @betescience8553 9 หลายเดือนก่อน

      nice video

  • @rakeshkumarrout2629
    @rakeshkumarrout2629 ปีที่แล้ว +20

    you are one of the few influencer who are really adding values to the community.

    • @650AILab
      @650AILab  ปีที่แล้ว +2

      Thank you so much for your wonderful comment, appreciate it sincerely and such comments are the motivation behind keep creating such content.. Thank you one more time!!

  • @suhaibsalman9495
    @suhaibsalman9495 ปีที่แล้ว +2

    At 24:38 it should be "for i in range(1,9):" instead of "for i in range(1,8)" as there are 8 ids because python skips the last digit.

  • @anonymousgawd..3047
    @anonymousgawd..3047 4 หลายเดือนก่อน

    Sir can u suggest which type of hardware is okay for deep learning rtx ddr4 ram 8gb i7 processor is okay ?or i need more adavanced system

  • @ShivamkumarSingh-bm6bt
    @ShivamkumarSingh-bm6bt 29 วันที่ผ่านมา

    Hello sir,
    I need to integrate satellite data, Geospatial data like flood point and non flooded point
    As well ndvi nwdi etc in ML to trained my model
    Could you please help me out with this

  • @boussagmanmorad9473
    @boussagmanmorad9473 ปีที่แล้ว +3

    is this multispectral analysis ? cuz all i saw is RGB

    • @650AILab
      @650AILab  ปีที่แล้ว

      Thanks for your comment.
      The initial data may have been multispectral however when I was processing in my tutorial it was all RGB. I haven't performed any multispectral analysis in my workshop.

    • @marcusrocco8577
      @marcusrocco8577 ปีที่แล้ว

      @@650AILab Can you please tell me how initial data was multispectral? It was 3 channels right from the beginning,right?
      And also how would one go for multispectral analysis?
      Thanks! Your tutorials help me a lot

  • @ganeshragade4439
    @ganeshragade4439 3 หลายเดือนก่อน

    I want to do multifeature and multiscale high spatial resolution image segmentation is it possible by using U-net

  • @RizwanBaltee
    @RizwanBaltee หลายเดือนก่อน

    Sir I want to detect clouds to satellite images is this tutorial help to achieve this

  • @SandipRijal-yi2qj
    @SandipRijal-yi2qj ปีที่แล้ว +4

    Why can't I find you till now? You are amazing. Thank you very much.

    • @650AILab
      @650AILab  ปีที่แล้ว

      You are most welcome with this sincere comment, thanks for your feedback, appreciate it sincerely.

  • @juanpablolescanovillegas631
    @juanpablolescanovillegas631 3 วันที่ผ่านมา

    Great masterclass! Greeting's from Chile

  • @man9mj
    @man9mj 10 หลายเดือนก่อน +3

    Thank you so much for your contribution, effort and time. This channel is a valuable treasure on TH-cam.

  • @muhammadlufti2967
    @muhammadlufti2967 ปีที่แล้ว +2

    My training result shows a linier increasing of validation loss on epoch 50 to 100, but the training loss is decreasing through the training epoch, is it a sign of overfitting? and how do I overcome it? Note that I only used 1 dataset from Kagge, I haven't tried using 38GB satellite data (due to lack of storage). Thank you for the tutorial, waiting for the next part!!.

    • @650AILab
      @650AILab  ปีที่แล้ว

      Thanks for the comment...
      Yes, if your validation loss is not going down subsequently in the later part of training epochs, ether it is not generalizing or just overfitting.. You can play with model params as well as dropout rate (start with .1) to to make sure u can generalize your model well..
      Appreciate your comment and part 2/3 is out, please enjoy.

  • @ivankirillov187
    @ivankirillov187 ปีที่แล้ว +5

    Thanks for creating such an amazing tutorial, waiting for the next part.

    • @650AILab
      @650AILab  ปีที่แล้ว

      Thanks for your comment, Part 2 to ready and will be live by Wednesday 6:00 AM PST, enjoy.

  • @sajidabbas5187
    @sajidabbas5187 ปีที่แล้ว +1

    Hello sir, how to find the height and weight of the road from satellite images
    In deep learning?

  • @venkatasai1590
    @venkatasai1590 11 หลายเดือนก่อน +2

    You are simply legend sir thanks for these lectures sir.

  • @Katriya_entertainments-rj1fn
    @Katriya_entertainments-rj1fn 7 หลายเดือนก่อน

    Hello Sir
    If you can suggest some tutorial on how to create these multi label mask images for satellite data, that will be very helpful.

  • @_sonu_
    @_sonu_ ปีที่แล้ว +3

    I am really 💪😲🤳 excited for this project! ❤

    • @650AILab
      @650AILab  ปีที่แล้ว

      Thank you so much, sincerely appreciate it..

  • @s97_97_
    @s97_97_ ปีที่แล้ว +9

    I never comment normally on youtube videos, but the way you teach and walk through the code is awesome. Normally what people do is just write the final code and explain what is happening, but you code it as if someone would normally do it for the first time, printing to see the results, checking our logic on a single line and then making a function out of it.
    You are a great teacher!

    • @650AILab
      @650AILab  ปีที่แล้ว +5

      Appreciate your comment sincerely. I do because I enjoy it most sharing with folks like you.
      I have done the coding for living, built great products in past used by large global enterprises.
      I don't do it for clicks or advertisement revenue that's why If I do it, I do it with heart and enjoy doing it.
      Thanks.

  • @3minuteswithkarim
    @3minuteswithkarim ปีที่แล้ว +1

    Instead of using Dubai Dataset can i use Sentinel-2 3 months composit image for classification? can yoou share a video how to do it?

    • @venkatasai1590
      @venkatasai1590 11 หลายเดือนก่อน

      where can we find those data sets sir

  • @muddassiranwar3769
    @muddassiranwar3769 ปีที่แล้ว +3

    I am starting my thesis by creating a model that can predict LULC maps from a particular area from time series of the exact location in the past that can be used to train deep learning models that generate future developments in advance. I hope this Workshop will be of great help..thanks in advance

    • @650AILab
      @650AILab  ปีที่แล้ว +3

      Sounds great! I am glad that you find it useful and if you need more help just send me an email and I will be happy to assist you, no problem at all. All the very best for you and appreciate your comment.

    • @umairalikhan5624
      @umairalikhan5624 3 หลายเดือนก่อน

      May I know about this topic? Can you give me your email? I have some questions.

    • @MuhammadUsman-of1mc
      @MuhammadUsman-of1mc หลายเดือนก่อน

      Helo brother I want to talk with you about my fyp project plz reply me

  • @1milenac
    @1milenac ปีที่แล้ว +1

    hello, your video is very useful. I am still a newbie with neural networks but I learnt that for training the model, we need a great number of labelled datasets which I am currently missing. I do have access to Lidar and Hyperspectral imagery covering a specific area and was wondering if its a good idea to use CORINE land cover classes as labels and then make prediction of LCC using Lidar and Hyperspectral and maybe SAR? or the quality of training data (labels) could be too bad? Corine LC2018 is made from Sentinel and Landsat8. Kind regards

    • @650AILab
      @650AILab  ปีที่แล้ว

      Thanks for the comment and its a great use case. I am currently busy with some other engagements however if you have a simple prototype (even if it is not working, but at least it has data collection part working) I can extend it to make it work as you suggested. Please reach out to me at my channel email.
      Thanks again.

  • @layolaji5776
    @layolaji5776 ปีที่แล้ว +1

    Hey Avkash, Can you please explain why you are patching each image?

    • @650AILab
      @650AILab  ปีที่แล้ว

      Thanks for the comment, appreciate it sincerely.
      Not all the images are same size to start with so before all the images are going to processed for the model, patching is needed to make sure all the images are fitting based on source images.

  • @zhulili4788
    @zhulili4788 2 หลายเดือนก่อน

    when use patchify function to execute subset, why you doesn't consider overlap?

  • @rajibkhan8964
    @rajibkhan8964 ปีที่แล้ว

    why did after u did patched_image.shape,it showed (2,1,1,256,256,3),i understood the latter but i didn get the 2,1,1 ,can anyone please help?

  • @kulsoompanhwar190
    @kulsoompanhwar190 6 หลายเดือนก่อน

    Asalamalikum, sir I have a query regarding the Deep image output , when there were coordinates on earth how we present those values with map

  • @akahige9764
    @akahige9764 ปีที่แล้ว +2

    Great job! Thank you so much for this very helpful content.

    • @650AILab
      @650AILab  ปีที่แล้ว +1

      Thanks for the comment, appreciate it.

  • @Syed-kr6hd
    @Syed-kr6hd ปีที่แล้ว +1

    Sir how to get into the google colab please inform me

    • @650AILab
      @650AILab  ปีที่แล้ว

      Its very easy. you just need Google Gmail account and then please follow the given TH-cam video to get Colab Free working for you:
      th-cam.com/video/izlugRckG0Q/w-d-xo.html
      Good luck. Thanks for reaching out.

  • @Machine-learn
    @Machine-learn 11 หลายเดือนก่อน

    I have a question why we convert to RGB in mask images only when we use CV2.imread ??

  • @lucasgoiana
    @lucasgoiana 7 หลายเดือนก่อน

    Would you help me downloading the images ? It seems like there is no available link in the website provided

  • @CommaComa
    @CommaComa 6 หลายเดือนก่อน

    hey, can you suggest a way to find satellite images for training a deep learning model(wildfire detection)?

  • @tesfayesusyimenu3292
    @tesfayesusyimenu3292 3 หลายเดือนก่อน

    The full hands-on coding workshop is exactly what I needed to get started. Thanks for sharing this valuable content!

  • @azmainfaiak8111
    @azmainfaiak8111 21 วันที่ผ่านมา

    46:00

  • @azmainfaiak8111
    @azmainfaiak8111 21 วันที่ผ่านมา

    44:00

  • @azmainfaiak8111
    @azmainfaiak8111 21 วันที่ผ่านมา

    34:00

  • @azmainfaiak8111
    @azmainfaiak8111 22 วันที่ผ่านมา

    15:00

  • @angelbautista7996
    @angelbautista7996 ปีที่แล้ว +1

    BROOO thankyou so much, this really helped and the tutorial was really easy to use as well :)

    • @650AILab
      @650AILab  ปีที่แล้ว

      Thank you so much, I am glad you find it helpful, appreciate it.

  • @noumankhan2123
    @noumankhan2123 ปีที่แล้ว +3

    you are a Legend

    • @650AILab
      @650AILab  ปีที่แล้ว

      Thank you so much, appreciate your comment. Will try my best.

  • @azmainfaiak8111
    @azmainfaiak8111 21 วันที่ผ่านมา

    Very nice

  • @videosbuff
    @videosbuff ปีที่แล้ว

    At 33:42, there is inconsistency in the image size written in the code. Also, there is typo in the for loop. You are not taking the 8th tile.

  • @SalehaBegum-t8h
    @SalehaBegum-t8h 10 หลายเดือนก่อน

    How can I create a dataset with any satellite image like this dubai dataset?

  • @madhumitharamaswamy4760
    @madhumitharamaswamy4760 ปีที่แล้ว +1

    Hello sir thank you so much for this video series, youre doing a great service for the society.
    Is it possible for you to make a video on semantic change detection of satellite images using unet where we implement a dissimilarity decoder ?

    • @650AILab
      @650AILab  ปีที่แล้ว

      Thanks for your comment and and I will be happy to help you. Please reach out the me through my channel email. I will be happy to assist you.
      Please create a notebook to collect the data first and process it, make it ready for feeding into the network and rest I will take care of it. Thanks.

    • @madhumitharamaswamy4760
      @madhumitharamaswamy4760 ปีที่แล้ว

      sir what is you channel mail id?

  • @2SPEEDY99
    @2SPEEDY99 ปีที่แล้ว

    I am a complete beginner when it comes to all things deep learning. Can you go over some basic steps about how to apply the model to new images? Thanks.

  •  7 หลายเดือนก่อน

    can i do the same with drone arial imagery ?

  • @bhupendrakumar1753
    @bhupendrakumar1753 ปีที่แล้ว

    Thanks for clearing my basic on how to process images, mask and associate labels with them. @Prodramp do you also have any tutorial on how to do unsupervised learning on hyperspectral images ? Unsupervised modeling on satellite images will help me greatly because I have some hyperspectral images but they are not labelled.

  • @tilamisufff
    @tilamisufff ปีที่แล้ว

    Hello, I am a student from China, and my English level is not very good. So there is a question when listening to your lecture. Why do you need to convert BGR to RGB for masks images, but not for jpg images? This is translated by translation software. If the words or tone are not very good, I hope you will forgive me. Thank you for your selfless sharing!

    • @tilamisufff
      @tilamisufff ปีที่แล้ว

      The problem is about 45 minutes in the video. The code is this sentence
      if image_type == 'masks':
      image = cv2.cvtColor(image, cv2.COLOR_BGR2RGB)

  • @Machine-learn
    @Machine-learn 11 หลายเดือนก่อน

    thank you for this amazing tutorial but I tried and the color changed in the images and when I apply the BGR2RGB like mask the images now are the same like masks, can anyone conform that ?

  • @vernabaldos1458
    @vernabaldos1458 ปีที่แล้ว +1

    clear guide worked well with for sharing.

    • @650AILab
      @650AILab  ปีที่แล้ว

      Thanks for the comment, appreciate it sincerely.

  • @ayonsomaddar5858
    @ayonsomaddar5858 ปีที่แล้ว

    can i get the shape files so that i can access it in QGIS .

  • @kangmufqi7279
    @kangmufqi7279 8 หลายเดือนก่อน

    are you using colab pro?

  • @rangaweerasekara2996
    @rangaweerasekara2996 ปีที่แล้ว +1

    god bless u xdd

    • @650AILab
      @650AILab  ปีที่แล้ว

      Thank you so much, appreciate your comment.

  • @rahuldebdas2374
    @rahuldebdas2374 ปีที่แล้ว +3

    Nice. But you spent a lot of time on explaining the file system and how to manipulate that in Python unnecessarily. This confuses and deviates the focus of this lecture.

    • @650AILab
      @650AILab  ปีที่แล้ว +2

      You are so welcome! Appreciate your comment.

  • @hassangillani1464
    @hassangillani1464 ปีที่แล้ว

    I have to work on Tiff file formats, which is very confusing can you please tell me how I can use tiff format for all this workshop?

    • @650AILab
      @650AILab  ปีที่แล้ว +1

      Thanks for your comment, appreciate it.
      So if I am understanding it correctly your segmentation images are TIFF, is that right?
      - For TIFF segmentation image, you can use Python PILLOW library to extract each TIFF layer as PNG and then combine all the layers back to final PNG segmentation image.. If you could please share ~10 images and I can share code with you on how to get it all working with this exercise.

    • @hassangillani1464
      @hassangillani1464 ปีที่แล้ว

      @@650AILab Yes Sir the images are TIFF, I can definitely share the images with you, please let me know which way would you prefer one drive or google drive? and where I should send you the link?

  • @sonalikamble5929
    @sonalikamble5929 4 หลายเดือนก่อน

    Perfect sir

  • @nurainigama
    @nurainigama 8 หลายเดือนก่อน

    thank you are an inspiration

  • @tankformations1048
    @tankformations1048 ปีที่แล้ว

    Hello Dear Chauhan, i watch your tutorials about Deep learning but i want to know how to create dataset using Landsat imagery or Sentinel-2. Especially how to create mask and label of image Tile. I create tiles using Geotile. Thanks for your help

    • @650AILab
      @650AILab  ปีที่แล้ว

      Thanks for your comment and sorry for the delayed response as I was traveling. Please send me an email with the details about your Sentinal-2 output data format with a few samples. I will get back to you directly over email and once we have a solution I will create a separate video on this topic.

    • @tankformations1048
      @tankformations1048 ปีที่แล้ว +1

      @@650AILab thanks for your reply. I send you an email with data. I am very happy to hear you. See you soon.

    • @abdelatifbouroucha8253
      @abdelatifbouroucha8253 ปีที่แล้ว +1

      ​@@tankformations1048 Hello, I am new to deep learning, and I am currently working with Sentinel-2 data. I was wondering if you could share any experiences or projects related to deep learning and Sentinel-2 data that I can learn from. Thank you!

    • @maliniv8043
      @maliniv8043 11 หลายเดือนก่อน +1

      did you get a solution for this@@tankformations1048

  • @Parcha24
    @Parcha24 ปีที่แล้ว +1

    👌🏻 great

    • @650AILab
      @650AILab  ปีที่แล้ว +1

      Thanks for the comment, appreciate it.

  • @nikolsparrow5163
    @nikolsparrow5163 ปีที่แล้ว

    thank you so much for sharing this method with !

    • @650AILab
      @650AILab  ปีที่แล้ว

      Thanks for the comment, appreciate it sincerely.

  • @Dynamic_maps
    @Dynamic_maps 7 หลายเดือนก่อน

    Genuis

  • @issa_coder
    @issa_coder ปีที่แล้ว

    Thank you for your amazing lessons. I learned a lot!