CLIP, T-SNE, and UMAP - Master Image Embeddings & Vector Analysis

แชร์
ฝัง
  • เผยแพร่เมื่อ 19 ก.ค. 2024
  • Description:
    Start your Data Science and Computer Vision adventure with this comprehensive Image Embedding and Vector Analysis guide. Explore OpenAI CLIP embeddings for image clustering and duplicate detection, and learn essential concepts like T-SNE, UMAP, and MNIST. Follow our beginner-friendly Google Colab notebook to master the basics and kickstart your journey in Computer Vision!
    Chapters:
    00:00 Introduction
    01:23 Python Environment Setup
    01:58 Clustering MNIST images using pixel brightness
    09:00 T-SNE vs. UMAP
    10:40 Clustering images using OpenAI CLIP embeddings
    17:22: Using OpenAI CLIP embeddings to detect duplicates or close duplicates
    20:05 Conclusions
    Resources:
    🌏 Roboflow: roboflow.com
    🌌 Roboflow Universe: universe.roboflow.com
    📓 "Image Embeddings Analysis notebook": colab.research.google.com/git...
    📚 "What is OpenAI's CLIP and how to use it?" blog post: blog.roboflow.com/openai-clip
    🎬 "CLIP: OpenAI's amazing new zero-shot image classifier" video: • CLIP: OpenAI's amazing...
    Stay updated with the projects I'm working on at github.com/roboflow and github.com/SkalskiP! ⭐
    Don't forget to like, comment, and subscribe for more content on AI, computer vision, and the latest technological breakthroughs! 🚀
    ComputerVision #DataScience #ImageEmbeddings #OpenAICLIP #TSNE #UMAP #MNIST
  • วิทยาศาสตร์และเทคโนโลยี

ความคิดเห็น • 22

  • @hiropr4
    @hiropr4 ปีที่แล้ว +1

    Wow, super useful video, thanks a lot! 😮🙏

  • @lorenzoleongutierrez7927
    @lorenzoleongutierrez7927 ปีที่แล้ว +2

    Very useful and well commented video as usual ! . Really, you selected several important topics in one , such as embedding but also speaking about data distributions . Thanks for sharing and I’ll be attentive to the next one !, greetings from Chile 🇨🇱

    • @Roboflow
      @Roboflow  ปีที่แล้ว +3

      Thanks a lot! I needed some positive feedback today 🙏🏻

    • @lorenzoleongutierrez7927
      @lorenzoleongutierrez7927 ปีที่แล้ว +1

      @@Roboflow of course man, you deserve it!, keep the great job. cheers !

  • @patrickwasp
    @patrickwasp ปีที่แล้ว +1

    Does clip produce meaningful text labels for the embedding? Can you prompt it to change what the embeddings are?

    • @Roboflow
      @Roboflow  ปีที่แล้ว

      Yup! Take a look at this blog post: towardsdatascience.com/linking-images-and-text-with-openai-clip-abb4bdf5dbd2

  • @user-zx1yp3zr3b
    @user-zx1yp3zr3b ปีที่แล้ว +1

    Nice work brother I did my first computer vision project by your content. Also why dont you make videos on handwriting detection like in bamboo paper application since there there are no such videos on this hand written detection that is digital handwriting may be you will be first to do on this if you do this.

    • @Roboflow
      @Roboflow  ปีที่แล้ว

      No one asked for that before :) That is probably the reason. And thanks a lot for your kind words. It is awesome to hear I managed to contribute and motivate you to learn CV. As for your idea could you add it here: github.com/roboflow/notebooks/discussions/categories/video-ideas ?

  • @alexandrepenha4617
    @alexandrepenha4617 10 หลายเดือนก่อน +1

    Hi! very good video, thanks. I am having problems doing the plot in visual code, do you have some recommendation when using this app? Thanks in advance!

    • @Roboflow
      @Roboflow  10 หลายเดือนก่อน

      To be honest, I don’t use VS code. What’s the problem?

    • @alexandrepenha4617
      @alexandrepenha4617 10 หลายเดือนก่อน

      I am trying to plot the first HTML template and it displays anything.. apparently it is working because no errors are shown, it is only blank@@Roboflow

    • @mayankukani9600
      @mayankukani9600 2 หลายเดือนก่อน

      @@alexandrepenha4617 Were you able to resolve this ? Facing the same issue

  • @hamzashamaseen2171
    @hamzashamaseen2171 ปีที่แล้ว +1

    thank you a lot can you make a video about dinov2?

    • @Roboflow
      @Roboflow  ปีที่แล้ว

      I’m thinking about it 🤔

    • @hamzashamaseen2171
      @hamzashamaseen2171 ปีที่แล้ว +1

      @@Roboflow you don't need to think, just do it😂😉

  • @Ronariel
    @Ronariel ปีที่แล้ว +1

    Do you work with entrepreneurs?

    • @Roboflow
      @Roboflow  ปีที่แล้ว

      Could you elaborate on the question?

    • @Ronariel
      @Ronariel ปีที่แล้ว

      I have a personal project that I’ve been working on that involves computer vision and simple robotics. I was just asking if you are willing to work in a project like that?

  • @MyExRebirth
    @MyExRebirth ปีที่แล้ว +2

    Stupid comment, but, FIRST

    • @Roboflow
      @Roboflow  ปีที่แล้ว +1

      Congrats! 👏👏👏

    • @MyExRebirth
      @MyExRebirth ปีที่แล้ว +1

      @@Roboflow I'm new to AI and ML, but managed to train my first YOLOv8 model after editing & correcting almost 4000 annotations last night in 7-8 hours using the roboflow's annotation tool 😭 I know it's a costly business, but I wish there was a free or discounted plan with higher limits and features as an upgrade from the free plan for students.

    • @Roboflow
      @Roboflow  ปีที่แล้ว

      @@MyExRebirth sounds like a lot of work. I think we have some credits for students :)