I've tried to find instructions on how to run and self-hosted runners on GitHub, that covers what's here. I've not been able to. For example, it wasn't until I watched this video that I learned that self-hosted runners can work on repositories, organizations, and enterprises. I had thought it only worked against a repo. Can you please supply a link to that documentation on GitHub?
FYI If you're installing the GitHub self-hosted runner on a Windows machine, and you want to create it as a Windows service, then you must run the CLI as Administrator. I didn't do that, because I didn't know, until I got to the question where it asks if I wanted to run the GitHub self-hosted runner as a service. At that point, it bombed. Thanks, GitHub, for leaving out important details like that.
Hey @rodfalanga3770, that is my bad for not mentioning that in my video. The official documentation does have that listed: docs.github.com/en/actions/hosting-your-own-runners/managing-self-hosted-runners/adding-self-hosted-runners#adding-a-self-hosted-runner-to-a-repository
Hi Mickey Gousset, Its a good session and thanks for that. I think you have configured it in the HOME directory, which will be accessible to you only. How to install it at some common place in a common Linux machine/VM so that all who have access to that machine/VM can access the runner? GitHub runner does not allow SUDO due to security reasons.
I know you asked this forever ago, but our team uses AWS codebuild for this and a shared GH repo. It doesn't offer the flexibility of accessing a common VM, but it meets security requirements.
even though runners are available at organization , getting the message "Waiting for a runner to pick up this job..." . Runners are available and they are active/idle . FYI, used correct labels.
I only hear the spoken audio out of my left earphone while watching this video, yet the music comes out of both. You might consider tweaking your mic setup if you haven't done so so that the voice recording comes out as stereo sound
Mickey, this is an excellent video. It answers an important question I've been wondering about GitHub self-hosted runners. But I've got a question about ports. A few years ago, I tried doing the same thing using Azure Pipeline, with what they call self-hosted agents. The thing that we never got to work was opening the ports necessary for the Azure Pipeline self-hosted agent to communicate back to Azure DevOps. There must be a comparable situation here with GitHub self-hosted runners. Is there a list of ports that the security team must open for the self-hosted running to communicate back to GitHub?
You need port 443 opened as the agent does long polling to GitHub. There are also some urls that the agent needs to be able to hit. Those are in the docs somewhere. But 443 and maybe 80 are all you need
I couldn't able to connect to the SonarQube server which locally hosted and I'm trying to use the self-hosted runner for the first time and I couldn't able to address why the sonar-scanner couldn't able to connect to the sonarqube server( I tried this stunt thinking about the security). please help me, the connection is established when I expose the server to internet and the github actions in running on a cloud. the repo I'm currently working at is private and the mentioned connection is established when I worked in a public repo. P.S: I don't have any knowledge about the docker stuffs ... I'm new to this 🙂 please help me !!!
I have a disability where I can only hear from my right year. I could not hear anything except for some music at random points in the video. Is that intended?
Very interesting. Please If I want to run python script for my local machine from GitHub action will hosted runner be useful in this situation? Thank you
To be able to run multiple jobs you will need to install multiple agents. You can do that on the VM by installing them to different folders. But make sure the vm has enough resources
Getting this error always. How could I solve it? Error: The process 'C:\Windows\System32\actions-runner-2\_diag\_actions\actions\setup-node\v3\externals\7zr.exe' failed with exit code 2
Can you please explain how to refresh token? TBH - I would like to be the runner available ALL the time. So whenever there is a push to my master branch, I want to trigger an action and deploy new version. Now I cant do it - token gets expired after only 1h. I have an idea to write a script in a VM to call github API for the token, restart the runner with the new token, do it each hour. But does it really needs to be so overhelming? Thinking about moving off to jenkins
Are you trying to create your own ephemeral self-hosted runner solution? The GitHub official solution for that is github.com/actions/actions-runner-controller. However, if you are trying to create your own, then you need to make an API call to get a short lived registration token: docs.github.com/en/rest/actions/self-hosted-runners?apiVersion=2022-11-28#create-a-registration-token-for-a-repository You can always just have a VM that is always available that you are running say in AWS or Azure. In that case, all you do is install the runner software. The token doesn't expire on you, meaning that the runner will keep working. I might need more details on what you are trying to do. If you want to email me at mickeygousset@github.com I'll see if I can answer them.
Hi Mickey , Jay here I have created a Public repo which is already live & wanted to hide my API credentials on that Repo . Is their any way to do it cause its already live right now ?? I just want to hide that line of code where it has mentioned my Private API key
I have couple of questions related to self hosted runners. 1. I have configured self hosted runner and i always wanted to be active so that my other team members can use it. But when my laptop is not turned on, other people who are running the pipeline, it is going to queue. Any idea on how to overcome that? 2. Lets say I create 3 individual self hosted runners in 3 of my team mates machines. I need github pipeline to pick the one which is online not the one which is offline. Is it possible and how do we do that.?
1. You need to install that runner on a machine that is always going to be one and available 2. All three machines will have a label, say "self-hosted". When you build the workflow file, you use that label in the runs-on command. Then Actions will find a free machine with that label and use it.
@@MickeyGousset Thanks for the reply brother. I have given runs-on: self-hosted in ci.yml file and have 3 selfhosted runners. Sometimes it is picking the one which is active and sometimes it is picking the one which is offline and waiting in the queue. Not sure how to overcome that
Hi, After all these steps, I am not able to access os.environ value which in worker log shows as access denied because it's checking environment value in /proc/id/environ on which linux user doesn't have permission to. Also after setting value in .bashrc file using export, it's reading value from /proc only and not .bashrc file and now I am stuck to execute the action and pipeline is waiting in infinite loop and had to cancel no choice to continue. Please let me know what I can do next here?
I’m not sure off the top of my head. Do you have a repo you could add me to (mickeygousset) where I could take a look, or a public repo that is forkable?
Error Log [2023-08-04 01:56:08Z WARN JobExtension] Ignore exception during read process environment variables: Access to the path '/proc/15980/environ' is denied. [2023-08-04 01:56:08Z INFO JobExtension] Inspecting process environment variables. PID: 16193 (pytest) pyest call which tries db connection but before that it fetched config string from os.environ which fails because this user do not have permission to /proc/id/environ but why ec2 or github is creating proc folder in root and not in user level folder
UNIT_TESTING_DB: str = os.getenv( "UNIT_TESTING_DB", "postgresql+psycopg2://user:pass@localhost:5432/my_db", ) Both Worker and Runner is stuck in infinite loop at this point
Hi Mickey, I follow step install self-host runner at Enterprise, Yes installable. But i can not run workflow call my self-host and show error "Waiting for a runner to pick up this job..." show it like that I create uner enterprise and allow organization all to use
Two things to check: Make sure at the org level you have set it to allow your repo access. You should see the runner listed in your repo under settings | Actions at the repository level if it has access Also make sure your run-as statement matches a label on your runner
@@MickeyGousset I set allow my repo access, check all permission. But still can't use Before i add self-host under organization, it works and move self-host to enterprises and no longer works
Actually when I run task during Xcode process terminal asks me about Mac password. Can I configure something like sudo perm access without type password every run?
![[Live] : ONE FIGHT NIGHT 25 วันนี้!! "อเล็กซิส vs รีเกียน"](http://i.ytimg.com/vi/suVr9a6BM2g/mqdefault.jpg)
fantastically explained.
Thank you!
My left ear loved this video.
Yep I messed up this audio and a couple of others, sorry about that
😂
@@MickeyGousset kinda funny, but your video was great, thanks for explaination
The instructions on GitHub are quite straight-forward but I found this video useful to get a sense for how they would work before I commit to them
I've tried to find instructions on how to run and self-hosted runners on GitHub, that covers what's here. I've not been able to. For example, it wasn't until I watched this video that I learned that self-hosted runners can work on repositories, organizations, and enterprises. I had thought it only worked against a repo. Can you please supply a link to that documentation on GitHub?
FYI
If you're installing the GitHub self-hosted runner on a Windows machine, and you want to create it as a Windows service, then you must run the CLI as Administrator. I didn't do that, because I didn't know, until I got to the question where it asks if I wanted to run the GitHub self-hosted runner as a service. At that point, it bombed. Thanks, GitHub, for leaving out important details like that.
Hey @rodfalanga3770, that is my bad for not mentioning that in my video. The official documentation does have that listed: docs.github.com/en/actions/hosting-your-own-runners/managing-self-hosted-runners/adding-self-hosted-runners#adding-a-self-hosted-runner-to-a-repository
Sir, thanks for the crystal clear explanation.
Loved it.. Beautifully explained.Good job!
Great video on Self-hosted runners, got me going in no-time
hello, thanks for the video, could you create the same insctruction but for installing and use runner in docker, please?
Hi Mickey Gousset, Its a good session and thanks for that. I think you have configured it in the HOME directory, which will be accessible to you only. How to install it at some common place in a common Linux machine/VM so that all who have access to that machine/VM can access the runner? GitHub runner does not allow SUDO due to security reasons.
I know you asked this forever ago, but our team uses AWS codebuild for this and a shared GH repo. It doesn't offer the flexibility of accessing a common VM, but it meets security requirements.
even though runners are available at organization , getting the message "Waiting for a runner to pick up this job..." . Runners are available and they are active/idle . FYI, used correct labels.
Has your repository been granted access to the runners?
Appreciate ths.. i learned.
Subscribed!
Thanks Mickey Mousset! 😻
thank you so much for this ! really helped ease my workflow!
Oh hold on, I need to put my headset on my forehead, give me a sec. xD
I only hear the spoken audio out of my left earphone while watching this video, yet the music comes out of both. You might consider tweaking your mic setup if you haven't done so so that the voice recording comes out as stereo sound
Yep I screwed this audio up. I've fixed in my more current video. Thank you for letting me know!
My left ear really enjoyed this.
Heh t
Thank you for this overview!
Simple and efficient, thanks 👍
very helpful!
Mickey, this is an excellent video. It answers an important question I've been wondering about GitHub self-hosted runners.
But I've got a question about ports. A few years ago, I tried doing the same thing using Azure Pipeline, with what they call self-hosted agents. The thing that we never got to work was opening the ports necessary for the Azure Pipeline self-hosted agent to communicate back to Azure DevOps. There must be a comparable situation here with GitHub self-hosted runners. Is there a list of ports that the security team must open for the self-hosted running to communicate back to GitHub?
You need port 443 opened as the agent does long polling to GitHub.
There are also some urls that the agent needs to be able to hit. Those are in the docs somewhere. But 443 and maybe 80 are all you need
@@MickeyGousset thank you
How do I refresh the token when it expires?
thank Mickey , it's a great course !
My left ear loved your video !
Ha! Yes, I have a couple of videos that I really screwed the audio up on. Sorry about that. I’ve gotten better in my newer videos.
You will need to script that or look at something like actions runner controller
I couldn't able to connect to the SonarQube server which locally hosted and I'm trying to use the self-hosted runner for the first time and I couldn't able to address why the sonar-scanner couldn't able to connect to the sonarqube server( I tried this stunt thinking about the security). please help me, the connection is established when I expose the server to internet and the github actions in running on a cloud. the repo I'm currently working at is private and the mentioned connection is established when I worked in a public repo.
P.S: I don't have any knowledge about the docker stuffs ... I'm new to this 🙂
please help me !!!
I want to automatically connect the runner rather than going to the server manually.
I need to runner connected on automatic not manually.Kindly provide best solution
I have a disability where I can only hear from my right year. I could not hear anything except for some music at random points in the video. Is that intended?
Great information
Very interesting. Please If I want to run python script for my local machine from GitHub action will hosted runner be useful in this situation? Thank you
my left ear enjoyed this video
Great video.
Please help to set parallel job processing for the self-hosted runner.
To be able to run multiple jobs you will need to install multiple agents. You can do that on the VM by installing them to different folders. But make sure the vm has enough resources
if my deployment via docker-compose and i need to restart the docker-compose located in /opt/ how can that be made ?
Getting this error always. How could I solve it?
Error: The process 'C:\Windows\System32\actions-runner-2\_diag\_actions\actions\setup-node\v3\externals\7zr.exe' failed with exit code 2
thanks for sharing, is runner can install for 2 repository/project on 1 host? frontend repo and backed repo
Can you please explain how to refresh token? TBH - I would like to be the runner available ALL the time. So whenever there is a push to my master branch, I want to trigger an action and deploy new version. Now I cant do it - token gets expired after only 1h.
I have an idea to write a script in a VM to call github API for the token, restart the runner with the new token, do it each hour. But does it really needs to be so overhelming? Thinking about moving off to jenkins
Are you trying to create your own ephemeral self-hosted runner solution? The GitHub official solution for that is github.com/actions/actions-runner-controller.
However, if you are trying to create your own, then you need to make an API call to get a short lived registration token: docs.github.com/en/rest/actions/self-hosted-runners?apiVersion=2022-11-28#create-a-registration-token-for-a-repository
You can always just have a VM that is always available that you are running say in AWS or Azure. In that case, all you do is install the runner software. The token doesn't expire on you, meaning that the runner will keep working.
I might need more details on what you are trying to do. If you want to email me at mickeygousset@github.com I'll see if I can answer them.
Hi Mickey , Jay here
I have created a Public repo which is already live & wanted to hide my API credentials on that Repo . Is their any way to do it cause its already live right now ??
I just want to hide that line of code where it has mentioned my Private API key
use secrets
Only left ear audio 😢
Yeah I messed that up. Sorry about that.
@@MickeyGousset no worries, thanks for the great walkthrough in this video 🙌🏽
In my github repository page under settings i cannot see the actions tab on to my left side
If you are working under your company’s enterprise account, then they may not have turned on actions for you.
Hey! Is there any way to check what labels were applied to a particular runner instance?
You can see it in the Web Browser by going to settings | Actions | Runners and looking at the runner information. You can also pull it using the APIs
Thanks a ton 🙏🙏🙏
Great!
I have couple of questions related to self hosted runners.
1. I have configured self hosted runner and i always wanted to be active so that my other team members can use it. But when my laptop is not turned on, other people who are running the pipeline, it is going to queue. Any idea on how to overcome that?
2. Lets say I create 3 individual self hosted runners in 3 of my team mates machines. I need github pipeline to pick the one which is online not the one which is offline. Is it possible and how do we do that.?
1. You need to install that runner on a machine that is always going to be one and available
2. All three machines will have a label, say "self-hosted". When you build the workflow file, you use that label in the runs-on command. Then Actions will find a free machine with that label and use it.
@@MickeyGousset Thanks for the reply brother. I have given runs-on: self-hosted in ci.yml file and have 3 selfhosted runners. Sometimes it is picking the one which is active and sometimes it is picking the one which is offline and waiting in the queue. Not sure how to overcome that
is this self-hosted runner need ssh open connection?
No self hosted runners use https to connect to GitHub
Brilliant 🙂
My left ear really enjoyed this. My right ear kinda felt left out.
Ha!
I’m about to create all brand new self hosted runner content. You will be happy to know I’ve fixed the audio issues 😎
@@MickeyGousset Looking forward to it!
All the knowledge is in the left part of my brain, jk but thank you for this!
Hi, After all these steps, I am not able to access os.environ value which in worker log shows as access denied because it's checking environment value in /proc/id/environ on which linux user doesn't have permission to. Also after setting value in .bashrc file using export, it's reading value from /proc only and not .bashrc file and now I am stuck to execute the action and pipeline is waiting in infinite loop and had to cancel no choice to continue. Please let me know what I can do next here?
I’m not sure off the top of my head. Do you have a repo you could add me to (mickeygousset) where I could take a look, or a public repo that is forkable?
@@MickeyGousset test:
# needs: start-runner
# needs:
# - build
runs-on: [self-hosted, Linux, X64]
continue-on-error: true
defaults:
run:
working-directory: .
steps:
- name: Checkout
uses: actions/checkout@v3
with:
fetch-depth: 0
- name: Install python dependencies
shell: bash
run: |
source /home/githubuser/actions-runner/_work/bin/activate
pip3 install --upgrade pip
pip3 install -r requirements.txt
pip3 install -r requirements.dev.txt
- name: Set Environment Variable
run: |
echo "UNIT_TESTING_DB=${{ secrets.UNIT_TESTING_DB }}" >> $GITHUB_ENV
- name: Run pytest & coverage
continue-on-error: false
run: |
echo "export UNIT_TESTING_DB=${{ secrets.UNIT_TESTING_DB }}" >> ~/.bashrc
source ~/.bashrc
pip3 install pytest-cov
pytest tests --cov=app --cov=services --cov-report xml
Error Log
[2023-08-04 01:56:08Z WARN JobExtension] Ignore exception during read process environment variables: Access to the path '/proc/15980/environ' is denied.
[2023-08-04 01:56:08Z INFO JobExtension] Inspecting process environment variables. PID: 16193 (pytest)
pyest call which tries db connection but before that it fetched config string from os.environ which fails
because this user do not have permission to /proc/id/environ
but why ec2 or github is creating proc folder in root and not in user level folder
UNIT_TESTING_DB: str = os.getenv(
"UNIT_TESTING_DB",
"postgresql+psycopg2://user:pass@localhost:5432/my_db",
)
Both Worker and Runner is stuck in infinite loop at this point
Hi Mickey, I follow step install self-host runner at Enterprise, Yes installable. But i can not run workflow call my self-host and show error "Waiting for a runner to pick up this job..." show it like that
I create uner enterprise and allow organization all to use
Two things to check:
Make sure at the org level you have set it to allow your repo access. You should see the runner listed in your repo under settings | Actions at the repository level if it has access
Also make sure your run-as statement matches a label on your runner
@@MickeyGousset I set allow my repo access, check all permission. But still can't use
Before i add self-host under organization, it works and move self-host to enterprises and no longer works
@@PatcharaMeesawad interesting that it works at the org level but not the enterprise. I’ll have to think on that
@@MickeyGousset thank you mickey
Hi Mickey, I can setup multiple self-hosted runners on a single host ?
Whether self hosted virtual machine consume my 2000 minutes limit?
Self hosted runners do not consume minutes. You can have as many self hosted runners as you want.
@@MickeyGousset GitHub secret keys can be the same? or I need additional configure?
@@Devlogowy GitHub secrets work the same whether you use hosted or self hoted runners
@@MickeyGousset Thanks for answers :) Time to code
Actually when I run task during Xcode process terminal asks me about Mac password. Can I configure something like sudo perm access without type password every run?
How to bring self-hosted offline runners online?
First check and make sure the agent in the runner is actually up and running. If it is then try restarting it.
amazing video... but so painful to watch while wearing headphones
thank you so fuckin much man!
Спасибою Хорошая подача материала. Если улучшиться звук. будет здорово
>>>>>>>>>>>>>>>>>>>>>>>>>>>>