this is perfect tutorial loved it... But I have 1 question . 1. can we submit batch jobs with custom environment variable using python and using cloud functions.(automated way). if yes , can you please point me to the docs or any tutorial if you have created.
It is possible. Take a look at this documentation page for creating batch jobs with Python. cloud.google.com/batch/docs/samples/batch-create-container-job?hl=en#code-sample You can add your environment variables in runnable.environment cloud.google.com/php/docs/reference/cloud-batch/latest/V1.Runnable
This was quite an insightful video did not know Cloud run jobs and Batch jobs are two different products. Do you know why the logs are indicating "ERROR" severity instead of "INFO" as logged by your script?
Thanks. There's a lot of overlap between Cloud Run Jobs and Batch Jobs. I think they should consolidate these two features. The only notable difference right now is the 1h timeout for Cloud Run Jobs. Regarding logs ending up in error. This is because the logging agent in Batch sends everything that is printed to stderr to Stackdriver as an error entry and by default the Python logging client prints to stderr. You can change that by doing something like logging.basicConfig(level=logging.INFO, stream=sys.stdout). The other option is to use the google.cloud.logging library but the lines will not be linked from the job events.
![โรงเรียนดัดสันดาน นักเรียนเถื่อน..!! [โรงเรียนไดเม่]](http://i.ytimg.com/vi/vRKPeXn4Fl4/mqdefault.jpg)
Subscribed just for the hand-on and no filler content! Excellent video!
Thank you 🙏
this is perfect tutorial loved it...
But I have 1 question .
1. can we submit batch jobs with custom environment variable using python and using cloud functions.(automated way).
if yes , can you please point me to the docs or any tutorial if you have created.
It is possible. Take a look at this documentation page for creating batch jobs with Python.
cloud.google.com/batch/docs/samples/batch-create-container-job?hl=en#code-sample
You can add your environment variables in runnable.environment
cloud.google.com/php/docs/reference/cloud-batch/latest/V1.Runnable
HI, for the cloud batch jobs, what permissions or roles are needed to create container jobs?
This was quite an insightful video did not know Cloud run jobs and Batch jobs are two different products. Do you know why the logs are indicating "ERROR" severity instead of "INFO" as logged by your script?
Thanks. There's a lot of overlap between Cloud Run Jobs and Batch Jobs. I think they should consolidate these two features. The only notable difference right now is the 1h timeout for Cloud Run Jobs.
Regarding logs ending up in error. This is because the logging agent in Batch sends everything that is printed to stderr to Stackdriver as an error entry and by default the Python logging client prints to stderr. You can change that by doing something like logging.basicConfig(level=logging.INFO, stream=sys.stdout). The other option is to use the google.cloud.logging library but the lines will not be linked from the job events.
@@vladsavecoding4111 It's not working, any suggestion?
@@vladsavecoding4111 logging.basicConfig(level=logging.INFO, stream=sys.stdout) didn't work.
can we use GPU in batch??? i can not find GPU tabs like in compute engine, so weird!
Never tried but looks like it is possible cloud.google.com/batch/docs/create-run-job-gpus