Mega Real-time End to End DevOps CI/CD Project | Git | Jenkins | Nexus | SonarQube | HandsOn Lab - I
ฝัง
- เผยแพร่เมื่อ 5 ก.ย. 2024
- #docker #kubernetes #ansible #git #linux #jenkins #dockerfile #k8 's #nexus
📠📱You can book a paid call for mock interview , career suggestion and Devops suggestion with me then you can refer below form 📃📑.
forms.gle/cuSH...
Click here to watch 2nd part : • Mega Real-time End-to-...
In this video below are the things we have achieved..
Prerequisites:
1. Nexus
2. Sonarqube
3. Maven Installed
------------------------------------------------------------------------------------------------------------------------------------------------
1. Application Overview
2. Git use cases
3. Jenkins Job Creation
4. Maven UNIT TEST
5. Maven Integration TEST
6. Maven Building jar/War files
7. SonarQube Configuration
8. Sonarqube-webhook Configuration
9. Static code Analysis
10. QualityGate Status
11. Nexus Repo Overview
12. Release Repo creation
13. Snapshot repo creation & Configuration
14. Error Debugging
15. Multistage DockerFile
16. Docker Image Build
17. Docker Image Push
18. To be continued...
For jenkins installation:
----------------------------------------------------------------------------------
www.digitaloce...
for docker installation
www.digitaloce...
Nexus Installation
--------------------------------------------------------------------------------
www.howtoforge...
Files used in this Lab:
--------------------------------------------------------------------------------
github.com/vik...
▬
Full Terraform course
► • Terraform explained - ...
Complete Real-time Docker Project
► • End to End DevOps Proj...
Complete Real-time Kubernetes project
► • Complete Real-time Dep...
Complete DevOps Project
► • Complete CI/CD Project...
▬▬▬▬▬▬ Connect with me ▬▬▬▬▬▬
INSTAGRAM
► bit.ly/3fPHLuz
LINKEDIN
► bit.ly/3FSLQbZ
FB
► bit.ly/3nRKYOB
Hey guys,
One of the more awaited video is here, that covers extremely important tools and it's configuration.
Check the description for the topics covered.
Switch to 1.5x for better experience !!
brother first of all we need 3 common vedios in depth
vedio 1 networking for devops --depth me ekdum bastion , jump ip subnet whtver source gocloudarchitects youtube 2 protocols only bgp ospf direct connect etc
vedio 2 common cloud concepts but strictly via comparative study azure aws both 4 -5 hours vedio
vedio 3 linux and shell 4-5 hurs single vedio focus on log , sar awk and network hardening linux and shell obvious , not one one linux o=commands some shell daily sceanrios , pulumi lambda , no sql installation for all 3 stage prod and dev parallell installation 3 d=env
==========================================
projects
maven -------------secops 2 concepts --k8
gradle......................same
mern------------------------
ms build------------------------azure devops chane from jenkins once in one flow
mlops flow
python deploy..........................same
etc
all in githun whatver mean commanda etc best via github and paste gthub link in each vedio description
@@swandev8916 th-cam.com/video/VlEexmM9Hlo/w-d-xo.html
Hello bhaiya. Can you plz let me know why 2 jar files are created(springboot-1.0.0.jar and Uber.jar) after running the build stage(mvn clean install)
@anand i wanted to make the final jar name as meaningful. So if you'll see I'm pom.xml you'll get tags
thank you so much bro for sharing this vedio
Great project Sir,
Completed the full project. I cannot thank you enough. You are an angel.
Keep up the good work!!!!
Thanks Avishek 😊
Hats off to the Hardwork you've put in the video 😊 !!
Waiting for more..
I have completed this project successfully and learnt many things 🤩
Thank you sir for this wonderful project and explanation 😀
I will add this for my to watch later, currently I am practicing JS. Thanks a lot, appreciated course !
Thanks you Simeonov :)
Very clearly explained and the way you present with patience and showing the practical way to build up a end-to-end pipeline could be easily understandable by the beginners very easily. I haven't seen recently any such videos with this worth content. Keep going ahead and looking forward!!
Hey thanks for the beautiful comments 😊.
Glad it added value to your personal goals and learnings.
Thanks a lot for these amazing hands on projects. God bless you 🙏
Gald you liked it 😊 !! Keep learning keep rocking. Do share with your friends.
Very nicely explained. Each stage is clear. Pl send the notes so that the procedure can be practised hands-on
Sent
Sir, once again thanks a lot for providing really beneficial projects, kindly add helm and Argo cd projects in this series.
Gald you liked it 😊 !! Keep learning keep rocking. Do share with your friends.
Good tutorial, i complete it and it was amazing. I am following your channel, keep up your good work
Awesome, thank you!
wonderful presentation , create another video with end to end including K8s deployment (or) from this stage you can append that part of deployment
This is very good and great video , one and only really great and usefully every developer....thanks
So nice of you
This video is containing lot's of information that we should know. thank you so much bro for sharing wonderful video like this im full fidaa of this 🙂
Many many thanks
You are amazing.. best explanation with best experience..
Please keep making project videos like this..
Thanks and sure
I just wanna say
*thank you man*
for this valuable content.
Very nice and informative video thank you sir for sharing knowledge.
Most welcome
Nice Video, we really appreciate your hardwork. Informative. Thanks a lot brother 🙏. Please make videos.
Glad you found it helpful 😊 !! Thanks for your kind words.
Thanks a lot for amazing real-time devops project🙏🙏🙏
Gald you liked it 😊 !! Keep learning keep rocking. Do share with your friends.
Great learning here . Could you also show us the project including docker and kubernestes EKS provisoned through rancher ?
really great explanation.. superb..
Glad it was helpful!
Thanks a lot for providing real time project knowledge .
So nice of you
Il est toujours la Jenkins ? Ben dis donc ! Bravo !
Amazing Work Bro!! Actually, I'm looking for a video like this.
Glad to hear that!
Thank you. But Need clear information about each one tool like jenkins,git,maven,sonar cube etc...
I'm soon going to start interview series, will cover all the basics to advance topics there. Stay tuned
Wonderful Project. Thank you!!!
Glad you like it!
Good video for realtime project idea, keep doing videos bro...
Thank you, I will
Can you please create a playlist for this Mega project with all relevant videos
thank u so much sir this project is very useful to me
You are most welcome
i believe we should use SonarQ before building an application find vulnerabilities
i am waiting second part of this amazing video
Coming soon
Very helpful
Great Video
Thank you , please make 2nd video.
As soon as possible
Pls put a video about unit testing and integration testing which are using on devops project
extraordinary video but voice should be more
Thanks, noted !!
Thak you for this video . Mr Devops please what causes HTTP ERROR 403 No valid crumb was included in the request in Jenkis? and how can I fix it?
oh man ! it's Great
Nice explanation. I have query regarding GATES. can we use gates in each steps of the CI process?
Upload servers setup and brief configuration part..
th-cam.com/video/VlEexmM9Hlo/w-d-xo.html
Hi, I really liked the way how you explain things and here is my question:I have mac and the project is made on windows, its quite hard to to do the same things on mac so what would you recommend me in my case?
Thanks
If you have any suggestions.
Pls make 2nd part also
thanks you
super
Hello Sir,
I appreciate that each and every step is up to date and working perfectly. Wonderful session and expecting such more lab videos from your channel.
❓❓❓❓❓❓❓❓
I am using windows for this hands-on. Do I need to install Docker Desktop or Docker CLI for build completion of docker part?
Thank you 😊 !!
Yes if you're don't have aws account access, you've to install docker on local.
you have done great jobs, but always start from scrach like jenkins, sonarqube, nexus installation also how many VM's you have which VM's you installed all those tools
Please check it's 2nd part.
Bro can you please create a video for devops java project by using Git , Jenkins, ECR, EKS ..try to use maximum amazon services in the project
Noted !!
Nice explanation bro....
Thanks a lot 🙏
Welcome!
Great Works Sir❤
Thanks ✌️
Sound quality is very poor even on 100% volume :(, thanks for Good content!
Feedback’s are appreciated, thanks
hello sir, glad to see the way you have explained the project, but while watching this video one thing shook my mind what if I want to try out using different servers for each package how do I do it?
What do you mean by different servers for each package? Could you please elaborate more
@@MrDevOps sure I mean Jenkins and maven in one server, nexus in one and sonar cube in other, and then all added as Jenkins client agents to perform as one unit
@@amanjeetsingh2096 Depends on what platform you are using. with aws-cloud you can create ec2 instances holding this service then use security group to allow traffic across those instances. The same goes for vagrant-cloud if you are working on your local desktop.
very useful video,
Glad it was helpful!
kindly help us with one nodejs sample project sir
Why Did you use Openjdk Here in Second Stage of dockerfile?
Just completed building this pipeline. Excellent video. One query am trying to reduce the size of docker image but not able to reduce more than 440MB. Please suggest
Use alpine images & write RUN commands parallely.
Google for the best practices for writing a dockerfile
@@MrDevOps thanks 👍. Now brought down the image size to 190MB still researching.
Eks,agrocd ,helm chart ... please include
Hi Sir, Its a great content can you please help me out in the last but one stage docker build..
What's the issue?
@@MrDevOps the build is not successful or fail but it's running like that only... And the docker images are building but they are not tagged... Am stuck here could you please help me out. Thanks in advance!
This is very informative. Can you please do Angular/React in one of your upcoming videos
Sure, stay tuned.
@@MrDevOps Thanks
Hi All. I watched the video and tried to execute on my own. the first three stages i.e git, unit testing and integration testing worked fine. But when i added the build stage(mvn clean install) the pipeline gets stuck. It keeps on running for around 30 minutes without any error output. Can anyone suggest what to do
How to trigger gitlab pipeline when commit to other branches except develop and master, also while merge to master branch?
The below code is not working
rules:
- if: $CI_COMMIT_BRANCH != “master”
- if: $CI_COMMIT_BRANCH != “develop”
- if: $CI_MERGE_REQUEST_TARGET_BRANCH_NAME == “master"
For doubt clarification write me at vikashashoke@gmail.com
2nd part please
Hi Vikash, Can you plz updated jenkins file as we discussed in video and Docker file. It will helpful ...Thanks in Advance
Could you please elaborate more..?
In Jenkins files all steps are not available wht we discussed in video , plz chk it once
This mega project is of 2 part ..
@@MrDevOps part 1 link plz
@@MrDevOps - Okay , In github your pushed code in different branch.
pls dont delete or dont make tis video private
th-cam.com/video/VlEexmM9Hlo/w-d-xo.html CheckOut for more..
make same poc 1 .net 2 mern 3 java 4 python 5 mlops flow 6 gradle android all kinds what do you think also gke aks eks different diffeent , dededicated 2 hour session docker file create how
In jenkins server u have install maven or not
How it know the jenkins maven is there or not
Does the maven , sonarcube, nexus, jenkins should be installed on the ec2 instance ?? I mean all this tools must be installed on one single ec2 instance right ??
Yeah you can just for practice, take a powerful instance type who can take the load of all. But better go for multiple.
@@MrDevOps t2 micro wont work ??
@@daminilanje5523 no
Hi where is the continuation of this video? Can you please comment the link, I tried to find it but I could not.
th-cam.com/video/MpRd_nJEx_8/w-d-xo.html
hello, thank you for this well explained project!
well I have an error during the stage of building the image using docker
the output "unable to resolve docker endpoint: open /certs/client/ca.pem: no such file or directory'
any help please!
What's the os you're using ?
How to add in nexus version.propertites
While running these job in Jenkins in ec2 free tier instance during unit test it is taking too much time and then suddenly Jenkins stop working, can u tell me reason?
You have to use t2 medium or higher instance
Can we pushed Tagged images to Nuxus repo and pull it from nexus for deploying on miceroservices? does in real world do we push in docker hub or Nexus?
Depends mostly nexus or ecr.
@@MrDevOps Thank you for prompt response 😊
you didnt showed nd not mentioned whtat plugins need to be installed
If you want to learn from scratch to advanced, join membership to access private contents
pipeline and project are same and pipeline output also same but when i checked my nexus repo it's not showing that jar,md5,sha1 files. it says no component/assest found in repository.
If Jenkins job falling at nexus level stage, check Nexus configurations.
@@MrDevOps no jenkins does not fail
Bro...in real time same way of project we build...!? ....or else
Yes we can
hey mr devops i have one question can we do static code analysis before building the code as soon a checkout happens?
Obviously you can, Ideally it should be done before mvn building.
@@MrDevOps Thank you ❤️
hi @Mr. DevOps. During the execution of quality gate analysis i found this error.
"hudson.remoting.ProxyException: net.sf.json.JSONException: Invalid JSON String"
can you help me out to solve this issue.
Which image you're using to launch instance?
@@MrDevOps AMI - ubuntu 22.04, t2 medium
the latest one for both jenkins and sonarqube
Hi our installed maven version and your code maven version is not matching.. Pls update source in repo
That shouldn't be an issue, if still facing downgrade your maven version.
Sir iam an engineering final year student i wanted to go for devops in future so , can i use this real time project as my major project ?
I got the acceptance from my college related to devops project....
So i just need u r guidence to complete this project ,
So how can i get in touch with you
Yes, use it without any 2nd thought, write me at vikashashoke@gmail.com :)
Hi guys, where can i find the video for terraform where eks infra is built .
th-cam.com/play/PLLu1bCv5AByG0ycZcjTmqW9bWw_2meKEO.html
Thanks brother..
Hi Mr.DevOps, last stage in the Pipeline i.e, docker image build stage is running recursively. Could you pls help me here?
Could you pls be clear & elaborate more
@@MrDevOps I followed this tutorial and was able to run the pipeline. But in last stage i.e, while pipeline is running, last stage is running for long time without stopping. I wrote the Dockerfile as you mentioned. I stuck at 1:30hr
@@MrDevOps I followed this Tutorial and was able to complete till last before stage. But while running last stage i.e, ‘Docker Image Build’ stage, that particular stage is running non-stop running the same layers of Dockerfile again and again. I wrote the Dockerfile as per your suggestions provided in the Tutorial
is it ok to leave the nexus url and credentialid in a repo ?
Yes obviously u can do refinements.
hi @Mr. DevOps I have installed maven in my Jenkins server, but still sh mvn is not building please help with how to install maven
What's the error?
@@MrDevOps script returned exit code 127
Reinstall maven, because it's not finding mvn because it's not been properly installed.
@@MrDevOps ok
@@kgayen96 did u resolve this issue?I'm getting the same error
@mr devops I have configured home path for maven but build is getting failed...any suggestions or input
What's the error you're getting?
@@MrDevOps can I have your email id, I'm doing again today from scratch, if error occurs I will send it with screen shot
and Thankyou so much brother, so much learning and never ever find like this project
@@MrDevOps I'm getting this error bro
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-resources-plugin:3.2.0:resources (default-resources) on project springboot: The plugin org.apache.maven.plugins:maven-resources-plugin:3.2.0 requires Maven version 3.1.0 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
What is the procedure for book a mock interview?
Check video description, you'll get a link for registration.
Hi sir how to integrate that pipeline code with Jenkins
Hello sumanth, could you elaborate more ?
Got it sir
I just missed the pipeline script with scm
Great, trying troubleshooting a lot before asking. It'll help u always
Hello, Mr. Devops I am following your projects Thank you for the Amazing Project.
in an above project, my pipeline runs smoothly till static code analysis. facing problems with quality get status stage
ERROR ==>Checking status of SonarQube task 'AYUhD5VqXR2ymY2NRaCQ' on server 'sonar_Server '
plz help me
Re-check again the personal access token of Sonarqube and credentials of SQ in Jenkins.
@@MrDevOps thank you so much..its working now ... problem in the configuration
__ip:9000/ while copying sonar qube URL there slash add-in last that is causing the issue sonar is no responsing back to Jenkins
Sir I have the script on jenkins pipeline for sending the email but it's working due to the update on Gmail. Can I please send you an email to walk you out through the issue?
I understood your query due to new update of Gmail you're unable to send email updates.
@@MrDevOps Yes, for now it's work i had to do some extra configurations thank you sir. By the way I wanted to ask you, do you have a video about NgRok (detect pushes automatically from github?) or a video about the problem of sonarcube always displaying coverage 0%
Bro how to gain experience in devops
Hey akhil, please check my any latest video description to connect with me.
Where would I write a code?
Vs code
can we do this locally
Yes you can do, but itll be time consuming.
@@MrDevOps yeah but I want to do this could u help me
Ppppppp
@ mr.DevOps [ERROR] Failed to execute goal org.apache.maven.plugins:maven-resources-plugin:3.2.0:resources (default-resources) on project springboot: The plugin org.apache.maven.plugins:maven-resources-plugin:3.2.0 requires Maven version 3.1.0 -> [Help 1]
[ERROR]
Tried with Maven latest version 3.8.5 and 3.8.6
Not able to find out 3.1.0 maven version............Please help
Which Ubuntu image version you're using?
@@MrDevOps I'm doing with ec2-linux server.
Go for Ubuntu 20 for this project RN.
@@MrDevOps hi Vikash can you provide me which versions we have to use in maven and is that t2 micro is enough for jenkis server...please confirm and help. I'm doing this for last three days and stuck in mvn test
To the the above project smoothly choose Ubuntu 20 version and run the maven shellscripts from below link: no specific version required
Only t2 micro isn't required because going forward you'll do the Sonarqube installation too, so better go for t2.medium
github.com/vikash-kumar01/installation_scripts/blob/master/Maven.sh
Amazing content
How you resolve docker image build issue
Same issue that am face
Paste the error here ..