Let’s Dumb-Proof Data Pipelines

แชร์
ฝัง

ความคิดเห็น • 2

  • @TheVijaynegi
    @TheVijaynegi 2 ปีที่แล้ว

    where we can create/keep this config file.in databricks project ?
    so when we push project to Devops ,the config file will move too?
    or manually I have to keep config file in DevOps REPO everytime and changed that config path in my code?

    • @ganeshchand
      @ganeshchand 2 ปีที่แล้ว

      It depends on your deployment model. But generally speaking, you'd want to keep the application specific config file along side the application code. The deployment related config file (e.g cluster configuration, job configuration, etc), you'd want to maintain that in a separate repo which is typically managed by your CI/CD tool.