Creating a Serverless Apache Kafka(MSK) publisher using AWS Lambda

[@ATHARVA89]

hi @knowledge amplifier do you have any video related to testing in data engineering? if not could you suggest some resources

[@KnowledgeAmplifier1]

Hi @ATHARVA89, you can refer this video -- th-cam.com/video/EVJm3aL7ftY/w-d-xo.htmlsi=ATOAHV5JO34xSO-C , for more testing related resources , you can refer medium.com/@samzamany/unit-testing-in-data-engineering-a-practical-guide-91196afdf32a

[@rushikeshkarkhanis7915]

Great tutorial, you explained with Security group configuration. Most of the videos on youtube have public access, which can be vulnerable.
Thanks for sharing knowledge.

[@KnowledgeAmplifier1]

You are welcome Rushikesh Karkhanis! Happy Learning

[@ay9523]

I am not sure why it is coming "errorMessage": "Unable to import module 'lambda_function': No module named 'kafka'" ?
I have tried with S3 and direct uploading .zip file to lambda layer

[@abhishekdubey-p9n]

you r running loop for Provisioned in lambda can i do with serverless cluster for same i have tried by adding client property's and all but facing some issues (Address family not supported by protocol) and some more pls help me out on this
And special thanks for this great video

[@vipinsharma-jt3qt]

Nice tutorial, it would be really helpfull if you can create some tutorial on mutilple zookeeper and kafka broker using docker compose with scheme registy with avro in Python. Done research online but didn't find any solution, If you can do that reallly helpfull. keep creating wonderfull content @KnowledgeAmplifier1.

[@prabhuofficial6072]

i creted msk cluster and how to use it in nodejs

[@KhalidKhan-kr5it]

Nice video..I tried but getting error... "errorMessage": "NoBrokersAvailable",
"errorType": "NoBrokersAvailable",when i run the producer code from cmd it works fine but not with lambda function

[@ankithashetty2202]

Even I am facing this issue, were u able to fix this?