Build Your Own Search Using Amazon OpenSearch Service [FULL COURSE in 15MIN]

Want to build your own search solution? The Amazon OpenSearch Service on AWS could be the solution for you. OpenSearch is a distributed, community-driven, Apache 2.0-licensed, 100% open-source search and analytics suite used for a broad set of use cases like real-time application monitoring, log analytics, and website search. OpenSearch provides a highly scalable system for providing fast access and response to large volumes of data with an integrated visualization tool, OpenSearch Dashboards, that makes it easy for users to explore their data. OpenSearch is powered by the Apache Lucene search library, and it supports a number of search and analytics capabilities such as k-nearest neighbors (KNN) search, SQL, Anomaly Detection, Machine Learning Commons, Trace Analytics, full-text search, and more. In this Video I take you through the steps to set up your first domain.
LINK TO GITHUB TUTORIAL RESOURCES:
💾 Code Repo: github.com/joh...
SUPPORT THE CHANNEL:
☕ Buy Me A Coffee: www.buymeacoff...
🖥️ My VPN: go.nordvpn.net...
▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬
00:10 - Intro
01:12 - OpenSearch Service Theory
02:50 - Navigate To OpenSearch
03:33 - Create Search Domain
05:39 - Add Single Document to Index
08:17 - Upload Mulitple Documents to Index
10:10 - Search Index Via API
11:22 - Search Index Via UI
13:43 - Delete Cluster To Clean Up Resources
14:07 - Outro
OTHER USEFUL LINKS:
ℹ️ My Website: johnnychivers....
🔗 Linkedin: / johnny-chivers
💻 OpenSearch: github.com/ope...
😎 About me
I have spent the last decade being immersed in the world of big data working as a consultant for some the globe's biggest companies.My journey into the world of data was not the most conventional. I started my career working as performance analyst in professional sport at the top level's of both rugby and football. I then transitioned into a career in data and computing. This journey culminated in the study of a Masters degree in Software
Enjoy 🤘

[@rafaelmartinsdecastro7641]

Good stuff, way better, and much clearer than going through AWS's docs.

[@waqasshah6331]

Happy that you are back! Keep these tuts coming

[@nishvanth]

Your channel is so underrated. Thank you Johnny. Bought you a coffee. Can you suggest which one should I choose for Data Engineering, Mac or Windows?

[@JohnnyChivers]

Thanks you!
You’ll find yourself using a lot of Linux in data engineering. Mac is unix based, and can run bash, so you can get a near Linux experience. Windows now offers Linux for the windows sub system, which offers a good experience… so really it’s personal preference at this stage.

[@nishvanth]

@@JohnnyChivers Thank you Johnny.

[@jfpimentel]

Great tutorial, it was pretty handy. Thanks!

[@JohnnyChivers]

Glad it was helpful!

[@615rip2]

can you teach how to use the pipeline to syncrhonize data from rds?

[@kapilagarwal2911]

But the information is to useful, Thanks Johnny!

[@iyiempire4667]

your video is great. does opensearch is diffrent than cloudwatch or we can do same things in cloudwatch too?

[@baptizeishere]

Excellent tutorial Johnny

[@DanielSandovalDeLaTorre]

amazing
I have a .csv and a .json file with many records, is there a way to consume them all at once?

[@sebastianmeckovski9980]

good stuff. Could you make a video on how ot sort geo-points by distance from given location?

[@assetwolf]

Super video, very clear and helpful.

[@Dhanasekaran-t2e]

Awesome !!! Johnny...

[@therus000]

Great
what the way to use policy to delete index's? can u explain that please?

[@vs7035]

Great content thank tou

[@Dennis-dx5qp]

Hi! How do you determine how many shards you want to use? I want struggling to be able to change it dynamically, when shards are too few. I was also wondering if this is also possible to be set with cloudformation?

[@jamesmcmahon2504]

I wanted the OpenSearch Service to be in the same VPC as my EC2 instance, so rather than a publicly accessible instance I set the OpenSearch instance to be within that VPC. When I putty in to my EC2 instance and attempt to do the first curl, I get no response. Any thoughts how to debug this?

[@wiseman9960]

Liked and subscribed 🤟

[@vaibhavjain1in]

Hey there, if I am already have OpenSearch running and if I want to add another domain, do I need to do anything else to have a similar setup as the existing cluster?

[@khandoor7228]

Good topic Johnny!

[@ToddCunningham]

awesome, as always. Thank you

[@ShahzadRasul-uo7gu]

How can I create automated backups of Opensearch in S3 on a cronjob?

[@mimich-q3c]

hello, I tried following those steps but on my own json data, I keep getting this error : curl: (3) URL rejected: Port number was not a decimal number between 0 and 65535 , do you have any idea why? and thank you for this video !

[@balthasarsaubot1454]

hello, did you solve this issue ? i encounter the same error.

[@soultanmuhammadalbar2311]

I think it's SecurityGroupEgress problem

[@NewnessOfNature]

Does OpenSearch have the ability to loose/fuzzy search?

[@TheOfficialMovmnt]

Great video 🔥

[@crade47]

amazing

[@HamzaHasham-u3z]

As beautiful as your face is, it's a little too zoomed in for this video. Great content, thank you for sharing

[@meirgoldenberg5638]

These instance types are not displayed for me. Only the "large" options are present.

[@meirgoldenberg5638]

I had to choose Domain without Standby

[@bestquotes2765]

What is the use of it?

[@prempant6428]

How can you use your own data for this? Currently, I have a Dynamo DB which is where I store my data, how can I incorporate this with my dynamo service?

[@Boldpest_]

DynamoDB streams

[@sahilkishnani5522]

Is this free to use?

[@kapilagarwal2911]

Can you please zoom out little bit, It's too scary !

[@Salmankhan-qt8uy]

Came here after learning ELK