hey dude just finished your github playlist and thanks for making it in such an organized way, understood everything! its just a matter of time before one of your videos blow up on youtube and you become popular lmao. definitely deserve more views!!
I have a Qn - I understand DBT cloud is designed for enterprise level use cases with UI and customizations, on the other side is DBT Core meant to use only for local and single machine or it can even be used at larger(enterprise) scale with appropriate configurations? have you come across any such usecase where core is used at production level. your knowledge is much appreciated. thanks
Good question - and yes I have seen dbt Core used in a Production environment. Mainly for the more tech-savvy teams that want to add more customization outside of what dbt Cloud offers. One example might be adding a SQL linter to the project. I imagine with time dbt Cloud will allow more customization features like this in the future, but for now there are some limitations on that front. Above all, I often see a combination of both cloud and CLI used and it's up to the developer to pick what they prefer for day-to-day development. Hope that helps!
Hi Kahan, I have imported a dbt project from github into another dbt project as a package, Is there any way to secure the package with key pair? So that it can be imported as package only if we have the key pair. Thanks in advance.
Quick Question. I had dbt cli installed and was using that and had pushed my code to github. Can I just import the github project in dbt cloud or do I have to run dbt init ? Thanks
Mike, if you don't mind, I am trying to create a copy of a table from SQL server in Redshift, can I use DBT for that or would something like DMS be better?
I would actually recommend a data extraction tool such as Airbyte, Fivetran or Stitch for something like that. dbt would be used to transform data after it's already landed in Redshift, not to move data between different systems.
Hey kahan, im an executive chef, but wanted to change my Career into data engineering... would be possible without getting a degree.. being a chef is mentally and physically demanding... always thinking while in tour feet.. been doing this for 20yrs and im in that part of my life that screams is time to change and by reading about data engineering sounded fun and something that i could excel.. so my question is.. how can i do this without going back to school or getting a degree for it?
Looking for help with your team's data strategy? → www.kahandatasolutions.com
Looking to improve your data engineering skillset?→ bit.ly/more-kds
hey dude just finished your github playlist and thanks for making it in such an organized way, understood everything! its just a matter of time before one of your videos blow up on youtube and you become popular lmao. definitely deserve more views!!
Thanks Piyush! Really appreciate the support and glad to hear the videos have been helpful for you.
Bro, super cool explanation, loved it. Thanks for your efforts
Appreciate it! Thanks for watching
@@KahanDataSolutions ❤
I have a Qn - I understand DBT cloud is designed for enterprise level use cases with UI and customizations, on the other side is DBT Core meant to use only for local and single machine or it can even be used at larger(enterprise) scale with appropriate configurations? have you come across any such usecase where core is used at production level. your knowledge is much appreciated. thanks
Good question - and yes I have seen dbt Core used in a Production environment. Mainly for the more tech-savvy teams that want to add more customization outside of what dbt Cloud offers. One example might be adding a SQL linter to the project. I imagine with time dbt Cloud will allow more customization features like this in the future, but for now there are some limitations on that front. Above all, I often see a combination of both cloud and CLI used and it's up to the developer to pick what they prefer for day-to-day development. Hope that helps!
Hi Kahan, I have imported a dbt project from github into another dbt project as a package, Is there any way to secure the package with key pair? So that it can be imported as package only if we have the key pair.
Thanks in advance.
Please make a video on how to integrate dbt core/cloud with airflow and work together
How far can we get with the free version?
Our code is in Bitbucket. Does that not work with DBT cloud?
Hi, are you planning to do some tutorial videos dbt with Spark ?
I'm not super familiar w/ Spark (haven't had to work w/ it before). So likely not soon but perhaps in the future.
Quick Question.
I had dbt cli installed and was using that and had pushed my code to github. Can I just import the github project in dbt cloud or do I have to run dbt init ?
Thanks
You should be able to import the existing GitHub project in dbt cloud.
What are your thoughts on taking the analytics engineering role as a stepping stone to data engineer? I know DBT is key for analytics engineers.
I think that's a natural progression and a great route to take!
Mike, if you don't mind, I am trying to create a copy of a table from SQL server in Redshift, can I use DBT for that or would something like DMS be better?
I would actually recommend a data extraction tool such as Airbyte, Fivetran or Stitch for something like that.
dbt would be used to transform data after it's already landed in Redshift, not to move data between different systems.
@@KahanDataSolutions thanks Mike, I had since watched your video on Airbyte, I will try that.
Great
Thanks!
Hey kahan, im an executive chef, but wanted to change my Career into data engineering... would be possible without getting a degree.. being a chef is mentally and physically demanding... always thinking while in tour feet.. been doing this for 20yrs and im in that part of my life that screams is time to change and by reading about data engineering sounded fun and something that i could excel.. so my question is.. how can i do this without going back to school or getting a degree for it?
Well, nothing is impossible. Just give it a try. :)