Real Time AWS Data Engineer Project

[@kishorpatil7005]

Good teaching and efforts

[@santhoshkumar-lv7vy]

super explanation ................🙏🙏🙏🙏🙏 guruji

[@pranavkorke3627]

Bhaiya G aur laoo aise projects❤️

[@krishnakumarkumar5710]

Great brother 🙏 please add these kind of project and mean while atleast explain fre new project scenarios along with approach to problem statement

[@madhubanti123]

Hi..
Could you also show how to deploy the code in production please..

[@Reeelstalkies]

Thanks bro, completed this project successfully , could we mention this project on resume so this could help us getting jobs ,Will complete all topics in playlists hope will get placed

[@learnbydoingit]

Yes that is the intention of making this video

[@MythiliPriya-s9u]

what u mention in the project like project name

[@rohithreddysureddy9151]

wouldn't this operation cause recursive lambda triggering since we are writing to the same bucket?❓

[@learnbydoingit]

Yes good catch think about the solution part here

[@bapandey8079]

⁠@@learnbydoingitWill put the output in different bucket

[@johnsonrajendran6194]

While creating the trigger for the lambda function we can also specify the prefix/suffix of the file which is needed to trigger the lambda.
In this case, example we can set prefix as employee.csv while creating the trigger.
So lambda will only be triggered if a file named "employee.csv'" is uploaded in that s3 bucket

[@krishnakumarkumar5710]

Bro please tell me the list of AWS services I can use for practice on free fire?
Like Lambda, S3, dynamodb, Athena etc.please provide the list. I am following you since long and want to implement it on aws please reply

[@learnbydoingit]

If you have created free account this project u can practice and once done u can delete that service

[@krishnakumarkumar5710]

@@learnbydoingit actually I Wanted to explore glue and streaming service of AWS, can I use them?

[@BOSS-AI-20]

@@krishnakumarkumar5710 did you used them ?

[@suryanarayanmishra7582]

I am unable to get that agg file in my S3 bucket kind tell me what should i do now

[@learnbydoingit]

Pls debug it's difficult to tell where it's going wrong ...pls do check lambda ..check log and then move further

[@known-td9vc]

please attach S3 full access policy to the role and try. I too faced the same issue it working after this.

[@OkunlolaTawakalitu]

You can check the timeout in permission under configuration and increase it to a max of "15mins 0 sec" if it's less.

[@AliAkbar-cl1wt]

Dear im facing timeout error/exception. after performing all steps

[@learnbydoingit]

Timeout ?

[@AliAkbar-cl1wt]

@@learnbydoingit dear perform all steps like lambda function.
When i see the cloud watch log then log shows me timeout.message .and agg file does not create at my s3 bucket.

[@abhinavsinha9277]

@@AliAkbar-cl1wt go to lambda then configuration and then in general config change the timeout from 2seconds to 1min or 2min

[@andangmomfor6300]

Where is the lambda code?

[@learnbydoingit]

Added in description

[@kiranaddakulla]

Please provide a code

[@learnbydoingit]

Description it's there

[@avinash7003]

lambda script please

[@learnbydoingit]

Just uploading with data