I have a question my friend what happen is that I have 2 csv ein my bucket and when I want to execute my crawler in my tables I see both csvs no the name of my bucket as you , do you think some steps are missing ? . Thx
Hi, very nice video, but is there any way to provide database name and table in glue as a input in step function instead of hard coding it inside script? Same question for crawler also, can we provide s3 object as a input?
Very helpful but anyone can assist I am getting the below error "error":"States.Runtime" "cause":"Invalid path '$.Crawler.State': The choice state's condition path references an invalid value." }
Do you know / use a good documentation to see how the json response always looks like? Because this is required to then refer to e.g $.Crawler.State thx
Hello Daniel Weikert, you can check aws documentation ( docs.aws.amazon.com/step-functions/latest/dg/welcome.html ) or else simple way is to use pass block to check respose and then further code accordingly as I explained in this video 😊
you are the hero! I was stuck at the crawler step for so long because it gets stuck if you select "wait for callback" option. This was genius!
Glad to hear the video is helpful to you @beauchifulbaby8145! Happy Learning
how can i know the json output without executing the state machine?
Hi my friend I have a question , the code that you put inside of glue job , that codes convert cvs to parquet , right?
@josemanuelgutierrez4095 yes correct
@@KnowledgeAmplifier1 Thanks you my friend ,I like your videos , those videos help me to improve my skills a lot :v
@@josemanuelgutierrez4095 glad to hear that .. Happy Learning
Great video! Well prepared with examples, it helped me a lot
Glad to know the video is helpful to you Fares Tabet! Happy Learning :-)
Thank you!
You are welcome buddy ! Happy Learning
I have a question my friend what happen is that I have 2 csv ein my bucket and when I want to execute my crawler in my tables I see both csvs no the name of my bucket as you , do you think some steps are missing ? . Thx
Hi, very nice video, but is there any way to provide database name and table in glue as a input in step function instead of hard coding it inside script? Same question for crawler also, can we provide s3 object as a input?
@@VinayGanesh-nk2lk yes, you need to create script file and save it in s3 bucket, and forward that key to glue
@@VinayGanesh-nk2lk will share on Monday, remind me once if I forget
Very helpful but anyone can assist I am getting the below error
"error":"States.Runtime"
"cause":"Invalid path '$.Crawler.State': The choice state's condition path references an invalid value."
}
Do you know / use a good documentation to see how the json response always looks like? Because this is required to then refer to e.g $.Crawler.State
thx
Hello Daniel Weikert, you can check aws documentation ( docs.aws.amazon.com/step-functions/latest/dg/welcome.html ) or else simple way is to use pass block to check respose and then further code accordingly as I explained in this video 😊