Try this solution in your free account and do let me know if you have any questions. One thing that keeps me motivated is more subscribers, please click on that thing :).
There is no other better/easy way to learn stackdriver logging, pub/sub topic, cloud functions, decoupling, event based trigger all in one simple 10 mins video. I come across your channel when I was looking for "Google Cloud OS Login". Now I am keep checking to learn more GCP services in a simple way with better clarity.
Good stuff, thanks for sharing. keep it up. looking for the complete series to prepare for gcp certs in detail. just subscribed happy to find your channel. 😀
Thank you so much for the video sir..............i have to implement a solution for my company where i can pick the logs during 5xx alert occured and save it to cloud storage. is there any related video or blog of your's ......if, please share the link.
Have a doubt can you please here me ? Have to Extract a multiple data of different data types at time ... How to take it .. and how to send the values to different columns of table
thanks for your helpful video. what do you suggest to do in case i would like to export all the audit logs to external web server? i would like to get all the audit logs and save them in my private db
Thank you :). This is what you can do: store the logs in GCS bucket from stackdriver and create a cloud function to insert into DB. Or Trigger a function directly and write insert query after you process the log.
@@CloudAdvocate so what is the use the subscription? also i have already code that handle the logs from un- managed k8s before saving them- there is a way to reuse it? use the trigger mean that each log will be send separately - isnt it? i think its overhead.. i prefer to collect batch of logs and send them , even as part of a file/zip
So the subscription is to get the real time messages from stackdriver and you can process them take action using your subscriber. Either you could use CF or if you want to batch process you can go with pull and get process them. If you are not using stackdriver and shipping the logs from your K8's to database by yourself then you don't need to do this. I am trying to understand your use case :).
@@CloudAdvocate i will try to explain. In unmanaged k8s you can directly send the audit logs from the api server. In managed cluster i dont have a way to change the master and send it directly. So i must find a way to send it from the stackdriver. I tried to use push option in the subscription and add my web server url. But i didnt find a way to add the caBandle in the push option. I would like to send batch of logs each time
Thank you so much for the video sir g, saved me from going through lots of docs. You are great. Love watching your videos. Could you please help me with two things: 1. could you please share the requirement.txt for this function also and if possible version of oauth2client compatible in that requirement.txt 2. My requirement is to get logs whenever a firewall allowing public access is created or previous is updated to allow public access, could you please point out to some links where I can see commands for doing steps up to triggering cloud function.
Getting Below error executing the python cloud function (instance_labels_fun.py ), Function execution took 134 ms, finished with status: 'crash' Could you provide your support
@@CloudAdvocate a Nice Sharing, would you mind share the available github link again, I want to study for integrate the alerts with pubsub then made the custom webhook payload to my own endpoint, thank you
![โรงเรียนดัดสันดาน นักเรียนเถื่อน..!! [โรงเรียนไดเม่]](http://i.ytimg.com/vi/vRKPeXn4Fl4/mqdefault.jpg)
Try this solution in your free account and do let me know if you have any questions. One thing that keeps me motivated is more subscribers, please click on that thing :).
There is no other better/easy way to learn stackdriver logging, pub/sub topic, cloud functions, decoupling, event based trigger all in one simple 10 mins video. I come across your channel when I was looking for "Google Cloud OS Login". Now I am keep checking to learn more GCP services in a simple way with better clarity.
Thank you Sree.
Very simple but much greater clarity on Logging, pub/sub, log sink, and use of cloud functions . Thank you sir!!
Very nice and helpful topic. Would like to see more such videos.
Thanks for such a good explanation. Can you please make a video on Alert in GCP when pods go into deadlock state.
Good stuff, thanks for sharing. keep it up. looking for the complete series to prepare for gcp certs in detail. just subscribed happy to find your channel. 😀
Thanks for the kind words.
@@CloudAdvocate Lets connect via linkedin if possible can you share the link ?
www.linkedin.com/in/chaitanya-gk
@@CloudAdvocate sent you the request...
Thank you so much for the video sir..............i have to implement a solution for my company where i can pick the logs during 5xx alert occured and save it to cloud storage. is there any related video or blog of your's ......if, please share the link.
Have a doubt can you please here me ? Have to Extract a multiple data of different data types at time ... How to take it .. and how to send the values to different columns of table
thanks for your helpful video. what do you suggest to do in case i would like to export all the audit logs to external web server? i would like to get all the audit logs and save them in my private db
Thank you :). This is what you can do: store the logs in GCS bucket from stackdriver and create a cloud function to insert into DB. Or Trigger a function directly and write insert query after you process the log.
@@CloudAdvocate so what is the use the subscription? also i have already code that handle the logs from un- managed k8s before saving them- there is a way to reuse it? use the trigger mean that each log will be send separately - isnt it? i think its overhead.. i prefer to collect batch of logs and send them , even as part of a file/zip
So the subscription is to get the real time messages from stackdriver and you can process them take action using your subscriber. Either you could use CF or if you want to batch process you can go with pull and get process them. If you are not using stackdriver and shipping the logs from your K8's to database by yourself then you don't need to do this. I am trying to understand your use case :).
@@CloudAdvocate i will try to explain. In unmanaged k8s you can directly send the audit logs from the api server. In managed cluster i dont have a way to change the master and send it directly. So i must find a way to send it from the stackdriver. I tried to use push option in the subscription and add my web server url. But i didnt find a way to add the caBandle in the push option. I would like to send batch of logs each time
Did you try pull instead of push. I think it sends in the batch of 10 messages.
How to learn write the cloud function code. I don't know python
Hi GK, I was able to deploy the function successfully but when I create a new instance the label was not created for it, Could you please help?
I don't get GCE VM Instance option in my Legacy Log Viewer :/
Can someone help?
Thank you so much for the video sir g, saved me from going through lots of docs. You are great. Love watching your videos. Could you please help me with two things:
1. could you please share the requirement.txt for this function also and if possible version of oauth2client compatible in that requirement.txt
2. My requirement is to get logs whenever a firewall allowing public access is created or previous is updated to allow public access, could you please point out to some links where I can see commands for doing steps up to triggering cloud function.
Even if you do not get time for replying, thanks for saving my time
I haven't used oauth Keshav and I totally forgot what I have put in the requirements.txt :(. I will let you know if I happen to use this again.
@@CloudAdvocate thanks it's done
Now I am stuck with the question that is there a way of preventing anyone from disabling Stackdriver API
Is there any step by step process to sync application and data logs to pubsub and then push them to Splunk on-premise?
No I don't have it at the moment.
Getting Below error executing the python cloud function (instance_labels_fun.py ),
Function execution took 134 ms, finished with status: 'crash'
Could you provide your support
Same error
Package bohot kum hai testing mai, increase krni hai salary - devops mai switch krlu batao sir
Yes Vishal, it will help you. Salary pakka increase hoga.
How instance receives messages ?
where is link for your function code?
Will add that :) thanks
@@CloudAdvocate can you add it today or right now? I need for some demo
@@RelaxationBoost Added the link in the description. FYI - github.com/cloudadvocate/google-cloud/blob/master/instance_labels_fun
@@CloudAdvocate a Nice Sharing, would you mind share the available github link again, I want to study for integrate the alerts with pubsub then made the custom webhook payload to my own endpoint, thank you