Hi Jagadeesh, Thank you for the detailed explanation. I am facing below issue, please help me out. [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 01:43 min [INFO] Finished at: 2019-12-10T14:28:16+05:30 [INFO] ------------------------------------------------------------------------ Recording test results ERROR: Step ‘Publish JUnit test result report’ failed: Test reports were found but none of them are new. Did leafNodes run? For example, C:\Users\icon\.jenkins\workspace\CMSNew\Automation\target\surefire-reports\TEST-TestSuite.xml is 20 min old TestNG Reports Processing: START Looking for TestNG results report in workspace using pattern: **/testng-results.xml testng-results.xml was last modified before this build started. Ignoring it. testng-results.xml was last modified before this build started. Ignoring it. Saving reports... Found matching files but did not find any TestNG results. [ZapiTestResultReporter] [INFO] Examining test results... Build result is FAILURE null Problem parsing JUnit test Results. Error parsing surefire reports. Please ensure "Publish JUnit test result report is added" as a post build action Build step 'Publish test result to Zephyr for JIRA' marked build as failure Finished: FAILURE
Hi Jagadeesh, ur way to briefing is really easy to understand. Got a picture in mind about the flow..thank you..please let me know if you have any clue on how to get the api keys ( secret and access) for trail account.. because I have searched and couldn't able to find it and I'm stuck in validation part in jenkins.
Hi I try this integration but when run the job only one test case is include in the test cycle why another test cases is not include in the test cyle the test clase have 10 test cases
Hi @jagdeesh I need to integrate selenium with Jira for updating the test case status as paa fail but in our project we dont have jenkins we are executing our test cases in AWS Ec2 instance so is it possible to integrate
Hi Jagadeesh, I dont know if you'll see this message. This video is very informative, but is it possible for you to share the github link to your public projects?
Hi @Jagadeesh, found a query while watching above video. I have Jira including their plugin Zephyr and ZAPI. I am running my code from Jenkins as shown in the video. My code is in Java+TestNG and I have not added a Junit Plugin for Jenkins. My tests runs fine but console output shows: Build result is SUCCESS null Problem parsing JUnit test Results. Error parsing surefire reports. Please ensure "Publish JUnit test result report is added" as a post build action Build step 'Publish test result to Zephyr for JIRA' marked build as failure Finished: FAILURE On Jira it still shows Unexecuted. Need your help here. Many Thanks !!
i have question if we execute testng framework how to automatically trigger automation testng results report to zephyr in jira , it has to trigger execution status automatically in zephyr by exectuing our automation scripts, how to do it can anyone explain it please
Hi, thanks so much for your tutorial... I'm new in this world... I have a problem, in my target folder is not any testrepor.xml. So I don't know how to continue.
Hi Jagadeesh, thanks for the video. I see Zephyr plug in is a trial version and free for 7 days only. What happens after that? Do we have to purchase it if at all we need to continue using it?
Hi @Jagdeesh ...thanks for the video.. I am trying to connect my local jira instance to Jenkins.I have installed Zephyr and Zapi add ons in jira.but I am not getting the option to generate the keys in JIRA.Also,I am not getting any option to add Zephyr base url in Jenkins.I am able to connect Jenkins and Jira though and can see my project name and testcyle name but not able to proceed.Could you pls help.
Hi @Jagadeesh, Thanks for the video. I am facing invalid user credentials issue upon clicking Test Configuration in Manage Jenkins - > Zephyr For JIRA - Test Management Configuration, but I have keyed in valid credentials only. Do you have any recommendations here?
Hi Jagadeesh Thanks for the video, one scenario like we need to update the screenshot to every test step, is it possible? Eg: Home page(after login success) test step and logout page test steps are there. I need to attach those two screenshots to my test steps automatically. Please guide me
@@JagadeeshJayachandran - Thanks for reply , as dev team/ stake holders are expecting like whenever test case failed we need to attach a screenshot for particular test step
@jagadeesh can we map the test cases using test case IDs by appending the test case ID to the test method name? Ex. TC25 is my test case ID, I'll name the corresponding test method as TC25_mytestmethod. Is there any option to do that?
Hi Jagadeesh, I hope you will help me in this. I have learnt selenium webdriver with Java, I can work on TestNG, Data driven Framework, pom. I joined a company saying I have 2 years experience in automation. They didn't mention anything about API testing, in interview or interview call letter. But now one manager called and asked us(some other new joiner and me) to automate jira using API. She said yes as she have exp in API. We need to work on it tomorrow. What should I do now. Should I tell him that I didn't work on API before. Please give me suggestion.
Hi Mounika, yes you should tell them that you have not worked with APIs before, therefore you might need more effort than planned" be specific about the expected delivery time. Coming to the learning part, you can definitely learn through working directly rather than learning everything first and kick starting the work, because these learning concept never ends. So don't worry get help from others and google of course and with a little bit of additional effort you can complete this work. So I would say Don't explicitly tell them that you don't know, tell them you need to explore because you haven't worked on it before, since you have automation background you can do it.
Thank you Jagadeesh for uploading the video, it's very helpful. Can you please help to resolve below issue - Integration between Zephyr and Jenkins is working fine. When we click on Test configuration it is "Validated Successfully". Now the problem for is when a new job is created and under Post-Build actions -> Publish test result to Zephyr for Jira, it is not popping up Projects that are created in Jira. In Project Name it is showing No Projects. JIRA URL is fine, it is showing whatever we have configured Manage Jenkins -> Configure System. Please suggest us how to fix this problem.
Hi @jagadeesh, I want integrate zephyr/zapi with Azure DevOps. So that I can push my result files which are in the form of .xlsx & .png files. So Can u tell me zephyr supports .xlsx file, .xlsx file is used for test driven framework so we are reading test data from .xlsx file & writing the result pass/fail after comparing with expected result. I m using python-selenium without any framework like pytest.
Thank you so much for tutorial. We are using Robot framework to automate scripts. Can we use same process to integrate with Robot Tests-Jenkins-Zephyr integration. Please share your contact/mail address to reach you to explain our framework & reporting structure.
@@JagadeeshJayachandran Yes, we are using Python packages and Robot keywords to develop scripts. We installed all packages on Python3.x and scripts written using robot inbuilt keywords. For example *** Test Cases *** Login Page open browser ${SiteUrl} ${Browser} Input Text ${username} nouser@test.com sleep 30 sec Input Text ${psw} nopsw click button ${sigin} close browser command to run above script is, cmdprompt>robot filename.robot We will get the .xml & .html files as a reports after execute the above command. Can we use .xml file to update the test status in Zephyr by using Zapi plugin ?. Please ping/reply to my mail id basheervit@gmail.com to have detailed explanation. We are happy to have 1:1 chat to explain about our project framework structure details.
@@JagadeeshJayachandran yes. It is working now. we added --xunit file.xml at the time running robot script. Now my new question. For failed tests we will get message in xml file, right. Is it possible to append that error message to Failed zephyr test ???.
#Jagadeesh very nice explanation that Used my project ... super bro
Hi Jagadeesh,
Thank you for the detailed explanation.
I am facing below issue, please help me out.
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:43 min
[INFO] Finished at: 2019-12-10T14:28:16+05:30
[INFO] ------------------------------------------------------------------------
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: Test reports were found but none of them are new. Did leafNodes run?
For example, C:\Users\icon\.jenkins\workspace\CMSNew\Automation\target\surefire-reports\TEST-TestSuite.xml is 20 min old
TestNG Reports Processing: START
Looking for TestNG results report in workspace using pattern: **/testng-results.xml
testng-results.xml was last modified before this build started. Ignoring it.
testng-results.xml was last modified before this build started. Ignoring it.
Saving reports...
Found matching files but did not find any TestNG results.
[ZapiTestResultReporter] [INFO] Examining test results...
Build result is FAILURE
null
Problem parsing JUnit test Results.
Error parsing surefire reports.
Please ensure "Publish JUnit test result report is added" as a post build action
Build step 'Publish test result to Zephyr for JIRA' marked build as failure
Finished: FAILURE
In entire video, where did u show the results in JIRA?
How to integrate zypher with selenium.....what code we have to write in eclipse and what dependency we have to add without using Jenkins...?
Hi Jagadeesh, ur way to briefing is really easy to understand. Got a picture in mind about the flow..thank you..please let me know if you have any clue on how to get the api keys ( secret and access) for trail account.. because I have searched and couldn't able to find it and I'm stuck in validation part in jenkins.
Hi, Thanks for your kind words. Did you manage to install zapi plugin, please?
@@JagadeeshJayachandran yes ... installed
@
Jagadeesh do you have an API documentation on how to pass results in JIRA by sending it via API call?
Hi I try this integration but when run the job only one test case is include in the test cycle why another test cases is not include in the test cyle the test clase have 10 test cases
Hi @Jagadeesh, How to integrate Selenium cucumber framework with Jira Zephyr?
@mayur, I have not tried with cucumber, but as long as you are using Jenkins to run the build it should work.
Hi @Jagadeesh, Can you please give a link to the xml report you are generating using surefire ?
Hi @jagdeesh I need to integrate selenium with Jira for updating the test case status as paa fail but in our project we dont have jenkins we are executing our test cases in AWS Ec2 instance so is it possible to integrate
Can we use the same process for integrating Selenium(Python- Pytest Framework) with JIRA using ZAPI ?
Hi @jagadeesh ,Can I get .xml file, I want to check the format of that file, or can you share the link of github if there is this code present.
Hi Jagadeesh, I dont know if you'll see this message. This video is very informative, but is it possible for you to share the github link to your public projects?
Hi @Jagadeesh, found a query while watching above video. I have Jira including their plugin Zephyr and ZAPI. I am running my code from Jenkins as shown in the video. My code is in Java+TestNG and I have not added a Junit Plugin for Jenkins. My tests runs fine but console output shows:
Build result is SUCCESS
null
Problem parsing JUnit test Results.
Error parsing surefire reports.
Please ensure "Publish JUnit test result report is added" as a post build action
Build step 'Publish test result to Zephyr for JIRA' marked build as failure
Finished: FAILURE
On Jira it still shows Unexecuted. Need your help here. Many Thanks !!
Hello @Ramit Dhamija, I am also facing same issue, did you find the solution??
Hi @Jagadeesh, I have getting the "Could not establish the connection
" error. When entering the Jira Cloud credential.
Sorry could reply on time, hope this is fixed
i have question if we execute testng framework how to automatically trigger automation testng results report to zephyr in jira , it has to trigger execution status automatically in zephyr by exectuing our automation scripts, how to do it can anyone explain it please
Hi, thanks so much for your tutorial... I'm new in this world... I have a problem, in my target folder is not any testrepor.xml. So I don't know how to continue.
Thanks, to get the XML file, please update your project to Maven with TestNg. You should have maven surefire plugin in your POM.xml
Refer this link to set up plugin: maven.apache.org/surefire/maven-surefire-report-plugin/usage.html
Hi Jagadeesh, thanks for the video. I see Zephyr plug in is a trial version and free for 7 days only. What happens after that? Do we have to purchase it if at all we need to continue using it?
Yes we have to purchase unfortunately
Hi @Jagadeesh,
Is the same method followed in jira server too using zephyr and zapi??
Hopefully Yes.
Hi @Jagadeesh! How did you do the update using ZAPI API?
You need to generate the Key from jira, were you able to do that?, if you can tell where you stuck at, I can help.
how can we get this project code
Hi @Jagdeesh ...thanks for the video.. I am trying to connect my local jira instance to Jenkins.I have installed Zephyr and Zapi add ons in jira.but I am not getting the option to generate the keys in JIRA.Also,I am not getting any option to add Zephyr base url in Jenkins.I am able to connect Jenkins and Jira though and can see my project name and testcyle name but not able to proceed.Could you pls help.
Are you trying with Jira cloud or Jira server?
Hi @Jagadeesh, Thanks for the video. I am facing invalid user credentials issue upon clicking Test Configuration in Manage Jenkins - > Zephyr For JIRA - Test Management Configuration, but I have keyed in valid credentials only. Do you have any recommendations here?
Did you try entering email I'd?
The same issue. Did you solve the problem?
@@ukraniane did you solved it
If invalid user credentials persists, please raise a ticket at www.getzephyr.com/support
@@JagadeeshJayachandran Thanks
Hi Jagadeesh
Thanks for the video, one scenario like we need to update the screenshot to every test step, is it possible?
Eg: Home page(after login success) test step and logout page test steps are there. I need to attach those two screenshots to my test steps automatically. Please guide me
Hi Krishna, I have not tried this scenario, let me give a shot.
@@JagadeeshJayachandran - Thanks for reply , as dev team/ stake holders are expecting like whenever test case failed we need to attach a screenshot for particular test step
I have a doubt on the process of integration Selenium and TestRails
What's the doubt, please.
My doubt is which dependencies exactly to add on my POM file, TesNG listeners implementation, I have been trying but I cannot get it.
@@lisandrofernando8533 your code is working?
Not yet, can you bring a demo with TestNG integration with TestRails?
@jagadeesh is there any way to execute the test cases without narrating the test case summary according to the project structure
If you are not narrating then it would create a new test case.
@jagadeesh can we map the test cases using test case IDs by appending the test case ID to the test method name? Ex. TC25 is my test case ID, I'll name the corresponding test method as TC25_mytestmethod. Is there any option to do that?
@@deepakp5523 you can do that, I am sure it would work.
@@deepakp5523 Yes, you need to write your test methods and package name in a way that appears as a scenario.
@@JagadeeshJayachandran is it the only way to map?
Hi Jagadeesh, I hope you will help me in this. I have learnt selenium webdriver with Java, I can work on TestNG, Data driven Framework, pom. I joined a company saying I have 2 years experience in automation. They didn't mention anything about API testing, in interview or interview call letter. But now one manager called and asked us(some other new joiner and me) to automate jira using API. She said yes as she have exp in API. We need to work on it tomorrow. What should I do now. Should I tell him that I didn't work on API before. Please give me suggestion.
Hi Mounika, yes you should tell them that you have not worked with APIs before, therefore you might need more effort than planned" be specific about the expected delivery time. Coming to the learning part, you can definitely learn through working directly rather than learning everything first and kick starting the work, because these learning concept never ends. So don't worry get help from others and google of course and with a little bit of additional effort you can complete this work. So I would say Don't explicitly tell them that you don't know, tell them you need to explore because you haven't worked on it before, since you have automation background you can do it.
@@JagadeeshJayachandran thank you so much for your time and help, I will do the same.
Thank you Jagadeesh for uploading the video, it's very helpful.
Can you please help to resolve below issue -
Integration between Zephyr and Jenkins is working fine. When we click on Test configuration it is "Validated Successfully".
Now the problem for is when a new job is created and under Post-Build actions -> Publish test result to Zephyr for Jira, it is not popping up Projects that are created in Jira. In Project Name it is showing No Projects. JIRA URL is fine, it is showing whatever we have configured Manage Jenkins -> Configure System. Please suggest us how to fix this problem.
That's wierd, will look into this.
I am also getting the same problem. any solution?
Ok this has been fixed. while configuring the Zephyr, we need to provide API token generated in JIRA . i was passing JIRA username and password
Hi @@JagadeeshJayachandran @Anand N, I am facing the same issue, did anyone find a fix?
@@Anu-uz7ko Hi Anu, Sorry to hear that you couldn't integrate, could you check with JIRA help desk, could be some issue with your ID.
Hi @jagadeesh, I want integrate zephyr/zapi with Azure DevOps. So that I can push my result files which are in the form of .xlsx & .png files. So Can u tell me zephyr supports .xlsx file, .xlsx file is used for test driven framework so we are reading test data from .xlsx file & writing the result pass/fail after comparing with expected result. I m using python-selenium without any framework like pytest.
Or can you provide your email or contact number if possible.
Hi , can we do this for BDD framework
Yes, as long as you have a report configured in jenkins.
Hi jagadeesh,
Im geeting error:ssl exception...could you please help me
On which screen you are getting this error,please?
@@JagadeeshJayachandran jenkins configure system page.....when i do test connection
@@JagadeeshJayachandran jenkins configuration page
Is it possible for you to share me the screenshot pls? or I guess you need to raise a ticket in www.getzephyr.com/support
@@JagadeeshJayachandran hi that error is gone.....now im getting invalid credentials error
can u make video of data generator poc in automation
Could you add more details please
@@JagadeeshJayachandran like data generator source for database in automation test data generator
@@aanchalsrivastava8550 will check ✅
Thank you so much for tutorial. We are using Robot framework to automate scripts. Can we use same process to integrate with Robot Tests-Jenkins-Zephyr integration. Please share your contact/mail address to reach you to explain our framework & reporting structure.
Are you using Python?
@@JagadeeshJayachandran Yes, we are using Python packages and Robot keywords to develop scripts. We installed all packages on Python3.x and scripts written using robot inbuilt keywords. For example
*** Test Cases ***
Login Page
open browser ${SiteUrl} ${Browser}
Input Text ${username} nouser@test.com
sleep 30 sec
Input Text ${psw} nopsw
click button ${sigin}
close browser
command to run above script is, cmdprompt>robot filename.robot
We will get the .xml & .html files as a reports after execute the above command. Can we use .xml file to update the test status in Zephyr by using Zapi plugin ?. Please ping/reply to my mail id basheervit@gmail.com to have detailed explanation. We are happy to have 1:1 chat to explain about our project framework structure details.
@@Barsath1000 Have you configured Jenkins?
@@JagadeeshJayachandran yes. It is working now. we added --xunit file.xml at the time running robot script. Now my new question. For failed tests we will get message in xml file, right. Is it possible to append that error message to Failed zephyr test ???.
@@Barsath1000 you have to replace your report with surefire report, please check the video again.