วีดีโอ

Thank you. The source code is available in Github: github.com/mycloudtutorials/generative-ai-demos/tree/master/bedrock-chat-with-pdf

@@MyCloudTutorials thank you so much..i was able to download..but am actually getting strange errors on windows..is there anyway i contact you..not a developer per se...

Why was it rejected? Could you re-apply and mention that you are evaluating the model? If not, then you may need to use llama model but have to change the request / response accordingly in user.py

@@MyCloudTutorials Seems like once we provide the details regarding why we require the model...we can't edit those details again. Initially I mentioned random information in the company details, purpose etc... So I created another account and requested the model with appropriate purpose...then it was accepted

Glad to hear it! Thanks so much!

Cost will be applied every time you use any model from bedrock (or openAI or any hosting platform). So you paid initial cost for Embedding your content and stored in a vector store. Every time a user queries, you are converting that query into a vector embedding (using the same model that you initially used) so a little cost is involved, then you make the search, find the similar document and send this all together to a LLM. There will be inferencing cost for input and output tokens from LLM at this point. I hope this clarifies. Thanks

I am glad you liked the tutorial. About the case you mentioned: You can merge both admin and user application. A little different approach can be taken. I am assuming you have the user logged in (so you can get their id) You can ask user to upload the pdf and show them "processing" kind of spinner, while you generate the embeddings and create vector index. If you need to store their vector index, you can always make a subfolder in S3 with their userid and may be assign this processing a job For example, s3://<userid>/<jobid - unique for the pdf>/<index files> You may want to consider saving this meta information to a Database like DynamoDB or Mysql so you know where to load the index from for this particular user. You can ask them to upload to S3 and trigger an event that creates the index. There are several possible ways to solve this, it depends on the use case and business requirements. Please let me know your thoughts! Thanks

I have used PineCone and OpenSearch (ElasticSearch on AWS) for multiple documents indexing. Basically for similar topic, you want to create one index and append the embeddings & content in that index. I haven't used FAISS for such case, but if it does support then I will use one db file otherwise how will I load into one searchable index (I am not sure). I might try doing something and share if I find some solutions. Thanks

It depends on the use case, data and computing resources at your disposal. For example, some embedding models outputs vectors of length 4096, some smaller ones 1536 or even 768. 4096 will have more hyperplanes I would assume than 768 but it will be more compute intensive to index and retrieve. There could be more reasons as well, like loss of accuracy etc.

You should put some debug (print) in the get_response method and see where the issue is. May be the LLM didn't respond with data. Thanks

@@MyCloudTutorials Thanks for the reply. I was using the same model for embeddings and the llm <facepalm>. I have updated that and its working now.

Glad it was helpful! Thanks.

What happens when you try to run the connection command in a terminal? Try and see if if you can make it work there. Thanks

Hello @everythingwhatyouwanttokno2488 , thanks for note. I tend to disagree and think it's on case basis. Yes, I understand Sagemaker endpoint is very popular, but if ECS, and EKS work, then there is no limitation on why lambda can not work. In case of ECS and EKS, you need to have the task running all the time (unless using fargate), where as if you are using the same docker container image for Lambda or ECS, it shouldn't matter. You can always keep Lambda function warm using a ping call from an event bridge scheduler. Serverless is a paradigm shift. Please do share if you have any case where ECS/EKS work but lambda with container doesn't work. The only limitation I can see is 15 mins timeout for lambda and 29 seconds for API gateway to Lambda integration. But if any use case for prediction is making a user wait for more than 29 seconds on browser (Or 15 minutes to lambda function url) then it should be more async integration for such cases. it would take similar long time to respond from Sagemaker / ECS /EKS end points as well. Thanks

I am glad you liked it.Thanks

@@MyCloudTutorials @palgorithm 0 seconds ago Hi, my request for anthropic claude model rejected. How to use that model then? I provided random details in the use case (company, website etc...)

There was an issue with this video's volume, will be careful for others. Thanks for feedback

Sorry about the volume, will try to check again prior to uploading other videos

Yes I don't think why not. You have 2 options: 1) If you are already using PostGreSql, then you can use pgvector extension to make it a vector data store. 2) If you do not want to use that, or not using PostGreSql and still want to vectorize your data and store in a vector index, you can certainly do that. Steps will be something like: 1. Let's assume you are using ElasticSearch as Vector store 2. Read from table(s) , sql query, get the data 3. Call an embedding model with the column(s) of data you need to generate the embedding for. 4. Create a JSON object with plain text and embedding data. 5. Make Api calls to Elastic search to index the data On querying side: 1. Convert the query into embedding using the same model that you used to create the embedding while indexing 2. Run similarity search on Elastic Search. I am going to make a tutorial on something similar soon. Stay tuned. I will add a comment here with the same when ready. Thanks

Langchain has Contextual memory. Please check this: js.langchain.com/v0.1/docs/modules/memory/ I will make a video soon, once ready, I will put a link in this comment. Thanks

Well, if you do not want to use RAG (like I showed in this video) then you will have to take a Foundation Model and train it with your data. So, yes, it's possible but it would require more resources, time etc (depending upon the base model you choose and your data). For continuously moving data, RAG works out better as you don't have to constantly fine tune the models as and when data is available. Another thing to think about is cost. Once you train and create a custom model, you have to host it somewhere (whether cloud or in data center) which will incur some cost. I hope it helps. Thanks

Could you check if the folder and file exist and has data locally? Before this line s3_client.upload_file(...), you can print the path, read the file locally and check the size. Most likely there is a typo somewhere. Thanks

Please check if you have allowed access to Foundation Model you are using. You have to request the model access (mostly given instantly) in AWS console. Also check if you are using right AWS region, as the models access approval is Region specific. Also check the model_id, confirm there is no typo, extra space or special characters. Thanks

Could you confirm that you have the Dockerfile (I think it's case-sensitive) in the directory? You should have it, if you cloned from this repo: github.com/mycloudtutorials/generative-ai-demos/tree/master/bedrock-chat-with-pdf/Admin Please check. Thanks

Thanks issue fixed.

Hello, I am glad you liked the video. What do you mean by reading the CSV file from S3 using Bedrock? Are you referring about Bedrock Knowledgebase where files located in S3 are read, and their vector embeddings are stored in Amazon Open Search index? Could you elaborate? Also, what is BBDD? Thanks

@@MyCloudTutorials Hey, i would be interested in the case you mentionned, working with the knowledgebase. Also would be great to include a lambda that auto-syncs the base, with an s3 upload trigger connected. Also, conversation memory would be an interesting topic, not sure if it is automatically included when working with bedrock, but there are langchain pakages that make it easy. If you got time, i would also love to see the response from bedrock beeing saved to an s3 as well. Thanks in advance!

@@MyCloudTutorials hello ! Thank you very much for taking the time to respond. Now that I've looked around your entire channel, I mean doing exactly the same thing you did in this video, th-cam.com/video/KFibP7KnDVM/w-d-xo.html (name: Chat with your PDF - Gen AI App - With Amazon Bedrock, RAG, S3, Langchain and Streamlit [Hands-On]), but for files with CSV formats. Have a good day, greetings

The idea is that you can interpret the data coming out of the CSV file in S3, but using Bedrock to protect data leakage

Knowledgebase is totally doable. But from what I have seen, it takes an S3 bucket's content, create vector embedding and store in ElasticSearch (Amazon Open Search). I didn't see an example on what happens when you add more files to S3. In that case definitely a lambda trigger, which can perform similar steps. That would be a good tutorial to make, I will add to the TODO list and add a comment here when ready. Thanks

Hi @KeerthanaPriyaDevaraj Do you have AWS Cli installed and setup with IAM credential that has access to Bedrock? If not, Please follow AWS documentation for installing AWS Cli from here: docs.aws.amazon.com/cli/latest/userguide/getting-started-install.html If you already have an IAM user created, create access_key and secret_access_key in the IAM console and download the credentials. Use `aws configure` command to setup the CLI. Also, make sure that you have the models access enabled in the Bedrock console. I hope this helps. Thanks

Is possible lambda aws ?

Very much possible in Lambda. If you are using langchain with Lambda, you need to include that as dependency. I shall make a video on how to do it in lambda, no ETA as of now, but I will surely tag you when I post a video on that. Thanks

​@@MyCloudTutorialsI'm trying, but I have an error: "Unable to import module" for "langchain community", I generated a layer in the lambda function, but it doesn't work, I'm waiting for your video, thanks

Thanks! I am glad that you liked it.

@@MyCloudTutorials I request you to make more videos on AWS and DevOps so it will be useful learners like us. Iam waiting for more videos

Thank you!

Hi @honmane humble I have a separate video on VPC peering. Please check it out at th-cam.com/video/q4EZbIBCOJE/w-d-xo.html Thanks

Glad it was helpful!

Thanks Bharat. I will make more videos for sure.

I am super glad that you found the video helpful. Please share with your friends, post links to your social media, help me spread the word. Thank you

Glad you liked it. Thank you!!

Thank you, trying to make these videos as and when I get time

I am glad you liked it.

Second part (VPC Peering) can be watched here th-cam.com/video/q4EZbIBCOJE/w-d-xo.html Thanks

Are you using Amazon Linux 2 AMI to create these instances? Or some other instance type? It seems to be a permission issue, where sshd process is only allowed for SUDOers. While searching I found www.golinuxcloud.com/run-sshd-as-non-root-user-without-sudo/ It may be useful, or atleast provide some clues. Thanks

Thank you! I am glad it was helpful.

I am glad you liked the video. And yes, thanks for the suggestion for zooming when using the commands. If you miss the commands, I have them in the git repo as well (link in the description) I don't know if there is any such diagram showing connectivity between VPC, Subnets etc. One thing, you can create the VPC infrastructure using CloudFormation and then you can atleast have some form of diagram.

I am glad you liked it. Thanks so much!

I am glad you liked it. Thanks so much!

Thank you! Just published VPC Peering Video, you can check it at th-cam.com/video/q4EZbIBCOJE/w-d-xo.html

Thanks! I am glad you liked it.