I would have loved to have had this video like 6 months ago. I instead kinda fumbled my way through figuring this out on my own. It's great that there is a video on it now for people in the future to find if they want to do this.
@@ES-DE_Frontend It should definitely help, especially with what to name the image folders, and where to save the .xml files and image folders after everything is done. These were things I kinda had to figure out my self after scraping a few games using the built-in scraper and then digging through the ES-DE files.
@@ES-DE_Frontend thank you! Games that weren't scraped because there was no data in the database? Or games that you skipped? Do you know if anyone has a use for this?
would suggest to check screenscraper.fr to see (1) if they have an entry for the game you are interested in and (2) how they have it named when looking for a match.
followed everything here... but i am not getting the media folder. I get the other file in my roms folder after scraping, but no media folder... I even tried to MAKE the "media" folder first, and it is always empty after scraping... any ideas? the path is correct, as per what you had in the video. EDIT: Imispoke. there is no Gamelist file. What i did, was jsut selected the "ROMS" folder in ES DE which has many of the rom foldersinside filled with games. it found all the folders (even the empty ones) but when I started to scrape, everything looked normal as to the video. sop I am not sure why nothing will write for me... I went thru the whole library already, so will it ping the server again? or are the files cached somewhere? EDIT 2. I restarted the program in ADMIN priv and selected only one folder as a test and it is working so selecting the "roms" folder, or not running as admin goofed it up... EDIT 3: It has to be the ADMIN PRIV. its working normal now.
@ES-DE_Frontend for some reason... my dataset folder to put the metal data files are in a different local then in your video....hmm... maybe an update to ESDE?
I have quick question, I'm using retrobat, in the configuration wizard (FRONT END SELECTION) I just select recalbox in my setup? What's the difference between choosing the other 3 options? I'm sorry for so many questions I'm new to this. Thank you for another great video 👍
Sorry I am not that familiar with Retrobat but I do at least think it uses a variant of EmulationStation. So with that in mind it is possible that the Recalbox option in the wizard will work for your case as well. But best to try to find the discord or forum for Retrobat and try to ask there. Sorry i'm not able to be of more help than that (ES-DE is a separate project so this video focuses purely on ES-DE specifics).
retrobat is going to be closer to recalbox out of the box than ES-DE is, as I believe retrobat still looks for the images and .xml files in the console folders the same as recalbox.
@@ES-DE_Frontend I'm so sorry.. I asked because retrobat seems to be connected in some way. I've also been thinking just switching to es de. . seems less complicated and more friendly user for a beginner like me. thanks for answering my questions❤ and will look forward to your videos in the future👍
@@DonaldWymanthan you so much for replying. it was really confusing since there is no option for es de or retrobat. I still have a lot to learn. thank you so much for your answer👍
@@esteban_dido_1 No problem. The reason the Recalbox option works for these 2 is that recalbox, es-de, and retrobat is that they are all forms of emulation station. Recalbox is a whole operating system That uses emulationstation as the main interface, whereas the other 2 are just forks of emulation station to be used in whatever OSs they support(I think retrobat is windows only).
skraper is much faster than the built in scraper with es-de. quick note - you can run the built in es-de scraper first to create the downloaded_media and gamelists folders then just point each media type to those folders using the skraper UI instead of manually inputting a wrong folder then moving afterward.
Do you plan on increasing the overall thread support on the Android app itself? My current setup is for Pegasus and I've been manually moving stuff around. To use Scraper would essentially mean going back to the start again. I've put over all my media and re-ran a scrape through the app but its dreadfully slow even though I pay for 6 threads.
i think it will depend on your situation (size of library, if you have the device, etc). the internal scraper is quite good though and has a nice set of options. we have a video on that here th-cam.com/video/js_m_jVnX2s/w-d-xo.htmlfeature=shared
yes it can! the good news is the output from this process is universally useable across all es-de platforms (the xml and media files work the same across all es-de platforms)
@@ES-DE_Frontend skraper uses the same sources than screen scraper? Do you have a tutorial to manually add game art not found on these sources? Thanks!!
and here is a link to our tutorial on manually adding metadata/images ES-DE: How to edit and manage game metadata th-cam.com/video/RWA4wK7pEko/w-d-xo.html
Im using Retrobat, Batocera, Recallbox, Retropie, ArkOS, R-Cade, Emuelec.... Theyre all the same, and works fine. Why ES-DE needs to be different? Feels really bad.
@@ES-DE_Frontend Different approach? Different use cases? Its the same old emulationstation. I cant just copy and paste my library from other emulationstation, so theres no point in use ES-DE over Daijisho, and Daijisho is free. Feels really bad and stupid, because Its the same emulationstation modified to be worse. And on Windows we have Retrobat, witch is great.
@@metaljason77 retrobat is a decent alternative but feels bloated and over enginereed. Aldo terrible documentation. Dajisho is android only, so it's useless.
@@ErnestHemingwayy Nope. As i mentioned, works exactly like all the others(Batocera, Recallbox, Ark OS, Emuelec, etc...). You can even use the same scraped files without the need to change anything. Its a more pure Emulationstation experience, and more compatible than the ES-DE. You install it, and it works, simple as that.
That's cool, is it possible to configure Skraper to recreate the downloaded_media folder and/or create a separate folder on an SD that ES-DE can use rather than the above?
sadly not that i have found - would be a good suggestion for the skraper team though. we're hoping they are interested in helping create a more direct configuration.
@@ES-DE_Frontend It is possible by using specific configuration for each system. Tedious but doable. The fastest way is to edit manually the skraper.config.json file I think. Each overriden system is contained between an {"Overriden" } tag so it relatively easy to do one system then copy/paste it and mass replacing the folder path (just take care of the file extensions tag which diffear from system to system). Not saying that it is painless but it is a one time job so worth it imho. In fact only the "Medias:" and "OutputFile:" tags need to be replaced.
ES-DE's built in scraper is solid (and I like that its native and can be used while using the app). That said we have seen a few use cases where it may make sense to use an external program like Skraper. For example; lets say you want to prepare your media ahead of getting your device. A program like Skraper could allow you to get all your metadata/media prepared ahead of time. Another common one is ES-DE's built-in scraper must stay open while you are scraping; so if you have a large library then Skraper could be a nice alternative to scraping outside of ES-DE so you can play games while Skraper is doing its job =)
This video is actually more thorough, detailed and better explained than anything I found directly related to Skraper itself.
wow, thank your kind words. very happy to hear that 😊
I would have loved to have had this video like 6 months ago. I instead kinda fumbled my way through figuring this out on my own. It's great that there is a video on it now for people in the future to find if they want to do this.
Sorry I wasn't around back then =) but i'm also glad this looks like it will help others based on your experience.
@@ES-DE_Frontend It should definitely help, especially with what to name the image folders, and where to save the .xml files and image folders after everything is done. These were things I kinda had to figure out my self after scraping a few games using the built-in scraper and then digging through the ES-DE files.
Great video !! Congrats !
Thanks you that help me for my anbernic rg 406v
Thank you! I use Skraper all the time, this will be useful! I'd love to be able to scrape android apps.
Is there a way to add that cool background music to the Android ES-DE that the Batocera/Knulli builds have?
not yet but its on our backlog
@ES-DE_Frontend Awesome, thank you!
Thanks for the great video! Quick question. What does the option "save non-scraped roms into file" do? And why do you specifically turn it off?
it creates a separate text file that stores the name of files that were not scraped. i turn it off because i don’t use it as part of my set up.
@@ES-DE_Frontend thank you! Games that weren't scraped because there was no data in the database? Or games that you skipped? Do you know if anyone has a use for this?
Need help to config the Ps3 scraper. It not detecting any games. the games are in folder format with game.ps3 in the name. what should i do?
would suggest to check screenscraper.fr to see (1) if they have an entry for the game you are interested in and (2) how they have it named when looking for a match.
followed everything here... but i am not getting the media folder. I get the other file in my roms folder after scraping, but no media folder... I even tried to MAKE the "media" folder first, and it is always empty after scraping... any ideas? the path is correct, as per what you had in the video.
EDIT: Imispoke. there is no Gamelist file. What i did, was jsut selected the "ROMS" folder in ES DE which has many of the rom foldersinside filled with games. it found all the folders (even the empty ones) but when I started to scrape, everything looked normal as to the video. sop I am not sure why nothing will write for me...
I went thru the whole library already, so will it ping the server again? or are the files cached somewhere?
EDIT 2. I restarted the program in ADMIN priv and selected only one folder as a test and it is working so selecting the "roms" folder, or not running as admin goofed it up...
EDIT 3: It has to be the ADMIN PRIV. its working normal now.
What avbout metadata? The Descriptions do not seem to be in this.
do you know how also to get the meta data text as well? everything worked but that
hmm odd that didnt work it should download based on the steps and set up i walked through in the video
@ES-DE_Frontend for some reason... my dataset folder to put the metal data files are in a different local then in your video....hmm... maybe an update to ESDE?
I have quick question, I'm using retrobat, in the configuration wizard (FRONT END SELECTION) I just select recalbox in my setup? What's the difference between choosing the other 3 options? I'm sorry for so many questions I'm new to this. Thank you for another great video 👍
Sorry I am not that familiar with Retrobat but I do at least think it uses a variant of EmulationStation. So with that in mind it is possible that the Recalbox option in the wizard will work for your case as well. But best to try to find the discord or forum for Retrobat and try to ask there. Sorry i'm not able to be of more help than that (ES-DE is a separate project so this video focuses purely on ES-DE specifics).
retrobat is going to be closer to recalbox out of the box than ES-DE is, as I believe retrobat still looks for the images and .xml files in the console folders the same as recalbox.
@@ES-DE_Frontend I'm so sorry.. I asked because retrobat seems to be connected in some way. I've also been thinking just switching to es de. . seems less complicated and more friendly user for a beginner like me. thanks for answering my questions❤ and will look forward to your videos in the future👍
@@DonaldWymanthan you so much for replying. it was really confusing since there is no option for es de or retrobat. I still have a lot to learn. thank you so much for your answer👍
@@esteban_dido_1 No problem. The reason the Recalbox option works for these 2 is that recalbox, es-de, and retrobat is that they are all forms of emulation station. Recalbox is a whole operating system That uses emulationstation as the main interface, whereas the other 2 are just forks of emulation station to be used in whatever OSs they support(I think retrobat is windows only).
skraper is much faster than the built in scraper with es-de. quick note - you can run the built in es-de scraper first to create the downloaded_media and gamelists folders then just point each media type to those folders using the skraper UI instead of manually inputting a wrong folder then moving afterward.
great tip, thank you
now we need one for the bezel project because it is made for retropie you need to do it manually
Do you plan on increasing the overall thread support on the Android app itself? My current setup is for Pegasus and I've been manually moving stuff around. To use Scraper would essentially mean going back to the start again. I've put over all my media and re-ran a scrape through the app but its dreadfully slow even though I pay for 6 threads.
there are no plans to increase the amount of threads in app
Would it be easier to use the scraper function in ES-DE?
i think it will depend on your situation (size of library, if you have the device, etc). the internal scraper is quite good though and has a nice set of options. we have a video on that here th-cam.com/video/js_m_jVnX2s/w-d-xo.htmlfeature=shared
is there a place i can get notified for a new version of skraper?
i believe they have a channel screenscraper discord
@@ES-DE_Frontend screenscraper not skyscraper
can this be applied foe the ES-DE from android as well?
yes it can! the good news is the output from this process is universally useable across all es-de platforms (the xml and media files work the same across all es-de platforms)
@@ES-DE_Frontend skraper uses the same sources than screen scraper? Do you have a tutorial to manually add game art not found on these sources? Thanks!!
yes skraper calls screenscraper for its data
and here is a link to our tutorial on manually adding metadata/images ES-DE: How to edit and manage game metadata
th-cam.com/video/RWA4wK7pEko/w-d-xo.html
Im using Retrobat, Batocera, Recallbox, Retropie, ArkOS, R-Cade, Emuelec....
Theyre all the same, and works fine. Why ES-DE needs to be different?
Feels really bad.
different use cases and different approach - good there are different options at least. thanks for checking it out.
@@ES-DE_Frontend Different approach? Different use cases? Its the same old emulationstation. I cant just copy and paste my library from other emulationstation, so theres no point in use ES-DE over Daijisho, and Daijisho is free. Feels really bad and stupid, because Its the same emulationstation modified to be worse. And on Windows we have Retrobat, witch is great.
sounds great. good to have options. enjoy and thank you again.
@@metaljason77 retrobat is a decent alternative but feels bloated and over enginereed. Aldo terrible documentation. Dajisho is android only, so it's useless.
@@ErnestHemingwayy Nope. As i mentioned, works exactly like all the others(Batocera, Recallbox, Ark OS, Emuelec, etc...). You can even use the same scraped files without the need to change anything. Its a more pure Emulationstation experience, and more compatible than the ES-DE. You install it, and it works, simple as that.
That's cool, is it possible to configure Skraper to recreate the downloaded_media folder and/or create a separate folder on an SD that ES-DE can use rather than the above?
sadly not that i have found - would be a good suggestion for the skraper team though. we're hoping they are interested in helping create a more direct configuration.
@@ES-DE_Frontend It is possible by using specific configuration for each system. Tedious but doable. The fastest way is to edit manually the skraper.config.json file I think. Each overriden system is contained between an {"Overriden" } tag so it relatively easy to do one system then copy/paste it and mass replacing the folder path (just take care of the file extensions tag which diffear from system to system). Not saying that it is painless but it is a one time job so worth it imho. In fact only the "Medias:" and "OutputFile:" tags need to be replaced.
great vid but why use skraper when the build in scraper uses the same database screenscraper
ES-DE's built in scraper is solid (and I like that its native and can be used while using the app). That said we have seen a few use cases where it may make sense to use an external program like Skraper. For example; lets say you want to prepare your media ahead of getting your device. A program like Skraper could allow you to get all your metadata/media prepared ahead of time. Another common one is ES-DE's built-in scraper must stay open while you are scraping; so if you have a large library then Skraper could be a nice alternative to scraping outside of ES-DE so you can play games while Skraper is doing its job =)
@@ES-DE_Frontendah oke
waiting on emudeck to work with android so i can put this on my retroid pocket 4 pro.