Hi, this is great. Can we avoid importing Schemas in some way? I have copy activity which can take dynamic path for source json and destination Azure SQL table. I have 10 Json and I can use same copy activity for all if I can avoid import schemas in some way. One way will be import json data in file to a table with varchar(max) field and then Parse Json in Azure SQL using stored procedure dynamically. 1 Stored procedure for all json. However, I prefer to do more things in ADF rather than in Database.
Will this work if you copy from blob storage with multiple JSON files but each same schema? Will All the files in the blob storage pass through the pipeline and become one SQL DB?
Hi sir, the video was very informative. However, what should one do if we were supposed to insert the json text as a whole string object in a single column in database table ?
Hi, great video. Can we do it for avro files also means in place of json files if we use any avro formate file then is it will work same as working for JSON?
Hi, thank you for the video. It is possible to read the hyerarchical JSON and write the information in many different table in one passage of the pipeline?
how to add the validation before copy activity. Like suppose for any attribute in the json file, i want its length to only be 5, its should give an error if less or more than 5. How can we add that kind of validations in azure data factory
I love u man
U r always sharing good things with great explains
So nice of you. Thank you dear
Hi, this is great. Can we avoid importing Schemas in some way? I have copy activity which can take dynamic path for source json and destination Azure SQL table. I have 10 Json and I can use same copy activity for all if I can avoid import schemas in some way. One way will be import json data in file to a table with varchar(max) field and then Parse Json in Azure SQL using stored procedure dynamically. 1 Stored procedure for all json. However, I prefer to do more things in ADF rather than in Database.
Hello Abhishek, have you done this? I'm having same scenario , please let me know if it worked for you!
Will this work if you copy from blob storage with multiple JSON files but each same schema? Will All the files in the blob storage pass through the pipeline and become one SQL DB?
Hi sir, the video was very informative. However, what should one do if we were supposed to insert the json text as a whole string object in a single column in database table ?
Hi, great video. Can we do it for avro files also means in place of json files if we use any avro formate file then is it will work same as working for JSON?
What if json file added with extra columns and that we need to upload in next batch in same table?
What if he bested json and what to load in sql? Schema in source is not fixed? How can we do that?
Hi, thank you for the video. It is possible to read the hyerarchical JSON and write the information in many different table in one passage of the pipeline?
got any link? i am also looking for reading hierarchical Json. if so pls help
how to add the validation before copy activity. Like suppose for any attribute in the json file, i want its length to only be 5, its should give an error if less or more than 5. How can we add that kind of validations in azure data factory
No idea as of know. have to dig.
@@TechBrothersIT Can you please check it and let me know please
When I try to load. It is saying that direct load is not possible using copy command and asking me to enable staging
what is ur source? for some sources you have to enable staging such as snowflake.
@@TechBrothersIT Adls gen2
I am unable to land the array column into TableStorage :(
I have a video on that. check the playlist
how to convert database in XBRL to Azure ?