Build Your Own Search Using Amazon OpenSearch Service [FULL COURSE in 15MIN]

แชร์
ฝัง
  • เผยแพร่เมื่อ 29 ม.ค. 2023
  • Want to build your own search solution? The Amazon OpenSearch Service on AWS could be the solution for you. OpenSearch is a distributed, community-driven, Apache 2.0-licensed, 100% open-source search and analytics suite used for a broad set of use cases like real-time application monitoring, log analytics, and website search. OpenSearch provides a highly scalable system for providing fast access and response to large volumes of data with an integrated visualization tool, OpenSearch Dashboards, that makes it easy for users to explore their data. OpenSearch is powered by the Apache Lucene search library, and it supports a number of search and analytics capabilities such as k-nearest neighbors (KNN) search, SQL, Anomaly Detection, Machine Learning Commons, Trace Analytics, full-text search, and more. In this Video I take you through the steps to set up your first domain.
    LINK TO GITHUB TUTORIAL RESOURCES:
    💾 Code Repo: github.com/johnny-chivers/ama...
    SUPPORT THE CHANNEL:
    ☕ Buy Me A Coffee: www.buymeacoffee.com/johnnych...
    🖥️ My VPN: go.nordvpn.net/aff_c?offer_id...
    ▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬
    00:10 - Intro
    01:12 - OpenSearch Service Theory
    02:50 - Navigate To OpenSearch
    03:33 - Create Search Domain
    05:39 - Add Single Document to Index
    08:17 - Upload Mulitple Documents to Index
    10:10 - Search Index Via API
    11:22 - Search Index Via UI
    13:43 - Delete Cluster To Clean Up Resources
    14:07 - Outro
    OTHER USEFUL LINKS:
    ℹ️ My Website: johnnychivers.co.uk
    🔗 Linkedin: / johnny-chivers
    💻 OpenSearch: github.com/opensearch-project...
    😎 About me
    I have spent the last decade being immersed in the world of big data working as a consultant for some the globe's biggest companies.My journey into the world of data was not the most conventional. I started my career working as performance analyst in professional sport at the top level's of both rugby and football. I then transitioned into a career in data and computing. This journey culminated in the study of a Masters degree in Software
    Enjoy 🤘
  • วิทยาศาสตร์และเทคโนโลยี

ความคิดเห็น • 35

  • @waqasshah6331
    @waqasshah6331 ปีที่แล้ว

    Happy that you are back! Keep these tuts coming

  • @rafaelmartinsdecastro7641
    @rafaelmartinsdecastro7641 11 หลายเดือนก่อน +1

    Good stuff, way better, and much clearer than going through AWS's docs.

  • @baptizeishere
    @baptizeishere 11 หลายเดือนก่อน

    Excellent tutorial Johnny

  • @assetwolf
    @assetwolf 8 หลายเดือนก่อน

    Super video, very clear and helpful.

  • @ToddCunningham
    @ToddCunningham ปีที่แล้ว

    awesome, as always. Thank you

  • @jfpimentel
    @jfpimentel 11 หลายเดือนก่อน +1

    Great tutorial, it was pretty handy. Thanks!

    • @JohnnyChivers
      @JohnnyChivers  11 หลายเดือนก่อน

      Glad it was helpful!

  • @khandoor7228
    @khandoor7228 ปีที่แล้ว

    Good topic Johnny!

  • @TheOfficialMovmnt
    @TheOfficialMovmnt 9 หลายเดือนก่อน

    Great video 🔥

  • @user-ch1hk5ii8p
    @user-ch1hk5ii8p 3 หลายเดือนก่อน

    Awesome !!! Johnny...

  • @wiseman9960
    @wiseman9960 หลายเดือนก่อน

    Liked and subscribed 🤟

  • @iyiempire4667
    @iyiempire4667 8 หลายเดือนก่อน +1

    your video is great. does opensearch is diffrent than cloudwatch or we can do same things in cloudwatch too?

  • @user-tt1li5ew1l
    @user-tt1li5ew1l ปีที่แล้ว +1

    amazing
    I have a .csv and a .json file with many records, is there a way to consume them all at once?

  • @Dennis-dx5qp
    @Dennis-dx5qp 6 หลายเดือนก่อน

    Hi! How do you determine how many shards you want to use? I want struggling to be able to change it dynamically, when shards are too few. I was also wondering if this is also possible to be set with cloudformation?

  • @sebastianmeckovski9980
    @sebastianmeckovski9980 5 หลายเดือนก่อน

    good stuff. Could you make a video on how ot sort geo-points by distance from given location?

  • @crade47
    @crade47 หลายเดือนก่อน

    amazing

  • @jamesmcmahon2504
    @jamesmcmahon2504 8 หลายเดือนก่อน

    I wanted the OpenSearch Service to be in the same VPC as my EC2 instance, so rather than a publicly accessible instance I set the OpenSearch instance to be within that VPC. When I putty in to my EC2 instance and attempt to do the first curl, I get no response. Any thoughts how to debug this?

  • @nishvanth
    @nishvanth ปีที่แล้ว +1

    Your channel is so underrated. Thank you Johnny. Bought you a coffee. Can you suggest which one should I choose for Data Engineering, Mac or Windows?

    • @JohnnyChivers
      @JohnnyChivers  ปีที่แล้ว

      Thanks you!
      You’ll find yourself using a lot of Linux in data engineering. Mac is unix based, and can run bash, so you can get a near Linux experience. Windows now offers Linux for the windows sub system, which offers a good experience… so really it’s personal preference at this stage.

    • @nishvanth
      @nishvanth ปีที่แล้ว

      @@JohnnyChivers Thank you Johnny.

  • @therus000
    @therus000 3 หลายเดือนก่อน

    Great
    what the way to use policy to delete index's? can u explain that please?

  • @615rip2
    @615rip2 3 หลายเดือนก่อน

    can you teach how to use the pipeline to syncrhonize data from rds?

  • @ShahzadRasul-uo7gu
    @ShahzadRasul-uo7gu 3 หลายเดือนก่อน

    How can I create automated backups of Opensearch in S3 on a cronjob?

  • @danhoward2075
    @danhoward2075 ปีที่แล้ว

    Does OpenSearch have the ability to loose/fuzzy search?

  • @user-gf3xy2fb7u
    @user-gf3xy2fb7u 4 หลายเดือนก่อน +1

    hello, I tried following those steps but on my own json data, I keep getting this error : curl: (3) URL rejected: Port number was not a decimal number between 0 and 65535 , do you have any idea why? and thank you for this video !

    • @balthasarsaubot1454
      @balthasarsaubot1454 3 หลายเดือนก่อน

      hello, did you solve this issue ? i encounter the same error.

  • @prempant6428
    @prempant6428 ปีที่แล้ว

    How can you use your own data for this? Currently, I have a Dynamo DB which is where I store my data, how can I incorporate this with my dynamo service?

    • @Boldpest_
      @Boldpest_ ปีที่แล้ว

      DynamoDB streams

  • @meirgoldenberg5638
    @meirgoldenberg5638 11 หลายเดือนก่อน

    These instance types are not displayed for me. Only the "large" options are present.

    • @meirgoldenberg5638
      @meirgoldenberg5638 11 หลายเดือนก่อน

      I had to choose Domain without Standby

  • @bestquotes2765
    @bestquotes2765 7 หลายเดือนก่อน

    What is the use of it?

  • @sahilkishnani5522
    @sahilkishnani5522 ปีที่แล้ว

    Is this free to use?

  • @user-mh2kc5jc5k
    @user-mh2kc5jc5k 4 หลายเดือนก่อน

    As beautiful as your face is, it's a little too zoomed in for this video. Great content, thank you for sharing

  • @Salmankhan-qt8uy
    @Salmankhan-qt8uy 5 หลายเดือนก่อน

    Came here after learning ELK