ฝัง
- เผยแพร่เมื่อ 8 ส.ค. 2020
- This is the first incarnation of my IRL streaming backpack for biking around. It utilizes a RaspberryPi4 with a usb capture card and a GoPro Hero7 Black, along with a custom FFMpeg command to capture and then relay out to Twitch. The Pi and the capture card are capable of 720p at 30fps, however do to prefering a smooth glitch free stream, I have it set to 480p stretched to a 16:9 resolution at 2000kbit. Obviosuly with a better connection or personal preference these numbers can be tweaked.
Any question comments or suggestions leave them below and I'll do my best to answer. I was inspired to try and build this after watching Terry Barentsen's IRL bike streaming setup.
I am not too worried about the heat generation for the RPi while in the backpack as I had this exact unit running outside in the summer heat for over a month straight.
My Twitch: / drftkng_
Other IRL Bike Streamers:
/ terrybarentsen
/ cat6cycling
/ jamiebodman
/ bikecurious
/ cooperleeray
/ miekii
Command updated to fully correct audio sync issues.
FFMpeg Command: This was a custom compiled version of FFmpeg with the h264_omx encoder
ffmpeg -nostdin -ar 44100 -ac 1 -f alsa -i hw:1,0 -async 1 -vsync cfr -video_size 720x480 -input_format yuyv422 -i /dev/video0 -vf scale=854x480 -b:v 2000k -vcodec h264_omx -pixel_format yuv420p -af "adelay='1000|500'" -f flv (Twitch or Other RTMP Server Address)
Anker PowerCore 26800 Portable Charger, 26800mAh
www.amazon.com/gp/product/B01...
GoPro Hero7 Black
www.amazon.com/dp/B07GDGZCCH/
STUNTMAN Pack Mount
www.amazon.com/gp/product/B01...
GOODAN Audio Video Capture Cards - HDMI to USB 2.0 - High Definition 1080p 30fps
www.amazon.com/gp/product/B08...
GoPro Pro 3.5mm Mic Adapter for (HERO8 Black/HERO7 Black/HERO6 Black/HERO5 Black)
www.amazon.com/dp/B01L2CPPH2
ANLASSER Microphone Mount for GoPro Hero 7, 6, 5
www.amazon.com/dp/B07QW8XXVP
EDUTIGE ETM-001 Microphone - Omnidirectional 3.5mm 3-Pole(TRS) Microphone for GoPro
www.amazon.com//dp/B00IP0ST78
CanaKit Raspberry Pi 4 4GB Starter Kit - 4GB RAM
www.amazon.com//dp/B07V5JTMV9/ - วิทยาศาสตร์และเทคโนโลยี
I'm using this setup but had issues with audio desync. I added two flags and everything works great now. Thanks for sharing this video!
ffmpeg -nostdin -ar 44100 -ac 1 -f alsa -i hw:1,0 -async 1 -vsync cfr -video_size 720x480 -input_format yuyv422 -i /dev/video0 -vf scale=854x480 -b:v 2000k -vcodec h264_omx -pixel_format yuv420p -af "adelay='1000|100'" -f flv rtmp://...
Thank you for the feedback and glad it helped out. Interesting so you added " -async 1 -vsync cfr " in place of " -r 30 " I had been trying to correct the audio delay/desync with the "adelay" which seemed like it fixed it but other times I began to notice it was off. Ill have to give that a shot and update the description.
Hi i have some issue's i connected a usb webcam to the raspberry but i get error like: cannot open audio device. i dont want to send audio from the webcam so wich arg should is remove ?
@@JarwienNL This should have all the audio portions taken out. ffmpeg -nostdin -video_size 720x480 -input_format yuyv422 -i /dev/video0 -vf scale=854x480 -b:v 2000k -vcodec h264_omx -pixel_format yuv420p -f flv The command in the video was written for the specific set of hardware I was using, if you change things up hardware will more than likely be listed and recognized differently by the system.
@drft_kng Thnks for you help 😀 yess it works you got my follow
@@drftkng. Hi there, thank you so much for the video! I am able to stream video with this code, but how can i also get the audio from the webcam or from a seperate mic? is there a way to do it?
Now this is dope! I needed this and didn't even know!
This is thing i was looking for, thank you very much!
Glad it was helpful
Yo man glad I found this great video! Really helps out
Glad it helped out. I need to make a follow up video with my current build, will have to work on that.
Thnkssss mate you are legend👍🏾
I can already hear the old granny from SpongeBob yelling WHAAAAT! WHAT DID HE SAY! I CANT HEAR HE WHAT!
Love the setup. Have you thought of sending your feed to amazon then back down to twitch? And are you using your phones network or do you have a mobile isp box. If these things came together would it increase the possibilities
When I was getting things dialed in and testing I was sending to an AWS server I had set up, it worked great. Very similiar to what most do just running a RTMP server at their house which sends to their local PC running OBS then out to twitch. For connectivity I am just using my single phone plan, which for my area does okay. I would like to add another connection or two but haven't wanted to spend the additional expense, so I kind of have to balance quality and stability.
Fairly tidy and low cost DIY setup. The RPi4 won't have enough juice though, if you'd want to stream at 1080p. GoPro Hero 7 is notorious for audio desync on HDMI. And that cheapo "cantlink" hdmi capture is getting really under pressure when using the YUYV profile to the point of low frame rates, while on the other side, if you used the MJPEG profile, the RPi4 wouldn't have the CPU power to transcode the stream.
What do u install on the pi to make this work ?
Good job, nice vid 👍
Thank you
it's really amazing how much of a stretch it is to use something as a gopro / action camera for streaming with your phone isnt it 😮💨really wish they just made it easier, but i guess this is what we gotta do, we all seem to be ahead of the companies now.
we know what we want and we know how to get it and we know how to build it, remove the middle man 😎
Powerbank to your phone, and stream. Almost the same way.
Hi, Very good video, thanks a lot! I just have a little question. Do you know if there is a way to have the normal overlay I'm using on Twitch (such as, subs, follower, etc ...) for the viewer?
With this configuration you would have to send it to a remote system running OBS, or a cloud OBS service to do the overlays. That would raise the complexity level and expense of the setup.
This is very impressive, can you use this same setup to stream irl on youtube? and whats that device with the blue tapes attached to it.. i really want to get this set up to start streaming on my channel..where can i contact you too?
This setup can be used to stream to any RTMP server not just twitch. I believe you are referring to the RaspberryPI, the tape is just to try and keep the USB and power connections secure while it is inside the backpack. Please see the video description I have all parts linked along with the FFMpeg script used to send the video to the RTMP server.
@@drftkng. thanks for the reply, and yes i did a research on the raspberry pi4 and its a great device, I'm curious how many networks can it Bond at a time and can i stream with my samsung note 8 camera beacuse i dont have a gopro and i learnt you can stream with your phone as well.
@@Citizee If you are just using a Note8 then there are plenty of native phone apps that allow streaming to youtube, none of this additional equipment is needed or necessary. I am only using the pi4 to process the signal coming from the gopro, the pi is connecting to my phones wifi hotspot. So if all you have is the Note8 then that is all you need. I have not used any network bonding services so I can't really comment on that.
@@drftkng. yes i have tried irl streaming on my channel with the note 8 but i noticed at some places the signal is very weak and it makes the streaming lag, i read the pi can connect different modems/wifi together and make it one on this case, when irl streaming and one network is having a bad signal it will switch to the other network for good and quality streaming. Thanks for the reply too.
@@drftkng. between i am thinking of buying the irl purposely for irl streaming only please let me know if it does connect different modems together for strong signal ...
How are u mirror in your stream
Somehow for me the video and audio is pretty laggy. I already tried to change some option. I'm using a simple usb webcam. Does someone have the same Issue?
Been playing with your command but having issues with audio sync. Any reason you are using -af delay? Seems you configure for 1 channel and then give it a 1 second delay. I think that’s my audio issue. Also why use -vf? Does the video auto scale the output to input?
I would have audio sync issues that would come and go sometimes. It seemed to be the least with the current command but I have noted it seems to have the potential to drift over time.
The vf scale was to force widescreen on Twitch. Had issues with the video not properly filling the screen without it.
@@drftkng. thanks so much for the reply! I’m going to run a test stream pretty soon with some adjustments I’ve made to the command. If I have any success I’ll share. Really trying to make this budget build work, but I’ve been beating my head against the wall for several days now lol
What were the commands used for the custom compiling from source of ffmpeg to add the omx encoder?
The main flags on the configure script are --enable-omx --enable-omx-rpi This is the page that I used to compile ffmpeg for my system. Hopefully this will get you going in the right direction. codecalamity.com/raspberry-pi-hardware-accelerated-h264-webcam-security-camera/#compile-ffmpeg-with-hardware-acceleration
hello, awesome projetct!
just one question, why not use the gopro app for streaming via RTMP? Is it worse quality ?
The GoPro app for streaming directly from the camera is indeed much easier. I have found though the bandwidth it requires is incredibly inconsistent and even when selecting 720p the app is trying to use sometime 5000kb of upstream data. Which is great for quality when on wifi, but on cellular it causes lots of drop outs or very choppy streams.
With the Pi setup I can pick the resolution and bitrate I want to use and it will not fluctuate, allowing me to fine tune it for my connection, to provide the smoothest stream my connection can handle. It also has the added benefit of being able to when required, cut the video and audio feed from the camera in situations where it might be needed, but still keeping the stream going. This can be done by just disconnecting the hdmi cable from the GoPro, plugging it back in re-establishes audio and video.
@@drftkng. oooh, i see! thanks so much man, I was trying to find any information about the bandwidth usage of the app and i could not find it.
This is crucial information for me because i live in brasil and we do not have the best 4g over here.
thanks again!
Are you using just one modem? Does this work in your area? Have you thought about using MPTCP or Glorytun?
Currently I am just using the hotspot feature on my iPhone, which is the main reason why I have the bitrate capped at 2000kbits. For my area and my normal cycling routes I have tested so far it has worked very well. I have only had one or two small sections where the stream has kind of done this weird fast forward thing, then it has caught back up. I am not familiar with MPTCP or Glorytun, I will look those up. Right now this is kind of my first iteration of everything, so always looking to improve it or make it better.
drft_kng I sadly got the GoPro 8 without HDMI out and buying the mediamod will set me back another $100. Not sure If I want to go that route or just buy a used Sony Camcorder just like Terry B did. Wireless streaming still only works in fisheye mode and needs the RPI because reconnecting is still not reliable. 😭
@@RolandRides Ah that is a bummer on the GP8. This method is route is definitely more involved than just tethering the GoPro to the Phone. Ive just had really bad luck with that method even doing 480p as it tries to push a very high bitrate and in my opinion looks worse doing so.
drft_kng I tried streaming on 5 GHz WiFi with the GP8 locally at home and it maxed out at 2Mbit/s with a very bad frame rate and artifacts when trying 1080p - I think this may be a hardware limitation. It's really sad as the hypersmooth recording is really good for bike videos.
Pardon my lack of knowledge
, can you explain why the HDMI capture card? It's possible to use the action cam as webcam on raspberry, right? What are the advantages of using the capture card and how to use it on the raspberry?
In this application using Pi I am not sure if the newer USB webcam feature of the GoPro would work. You could get away without using the capture card, by doing something like a local RTMP server that GoPro would connect to and then the ffmpeg script would capture that output and send that to twitch, but that gets a little more tricky since you are then dealing with multiple wifi signals on the Pi. The hdmi capture card is just easy and it works.
The GoPro webcam feature requires their software and only works on Windows or Mac. It also only works with the Hero 8, 9 and 10 and not the Hero 7.
Wow! The only thing missing is the SRT protocol
Thank you for stopping by. This is definitely a bit dated at this point. If you are interested in SRT, please check out the Belabox project by RationalIRL. I have used it and its amazing.
th-cam.com/video/YuH_B48nz1M/w-d-xo.html
I love this idea but you need to have Hotspot on your phone I think. At A sucky part about this I do not have that
Is there a way to do this with 1080p? Also, hows the audio? Is there any delays? I was searching around on YT and google and people said there were 2 second delay with audio using gopro
The Pi4 is not powerful enough to do 1080p, and yes the hero7 would tend to drift after a while. It was a fun, cheap experiment at the time utilizing items I already had, but I wouldn't recommend it today if you were trying to put together something.
@@drftkng. thx for your insight. i have gopro8 and wanted to live stream but i agree other options are a lot better. bless up
get the nanopi r6s & better cap card and you can stream 4k in backpack? 😁
Thanks, I built this with what I had available already at the time of the video. I've since moved on to a Belabox setup ( jetson nano ) with a Camlink4k and it works very well.
Can I do this but instead of a raspberry pi have a laptop in my bag that is running obs so I could add stream elements, chat overlay etc.?
Yes you can, I have currently stepped up to a LattePanda running windows10 in place of the Pi. Giving all the benefits of OBS, of course it is more power hungry. I plan to get a video made of this setup soon.
Is there a way to add power, hr, and cadence overlay to the live video?
There definitely is, but as far as I know it would require a remote/cloud OBS. I have not really ever looked into adding that type of information, however that should be independent of hardware you are using. RPi or windows and such. Check out Pelotom_ or MuxFD on twitch. I know Pelotom_ has those data overlays, and MuxFD has coded a pretty sweet map overlay
www.twitch.tv/pelotom_
www.twitch.tv/muxfd
Any idea how to make works alerts ? (streamlabs or streamelements) Donations,Subs....
With this setup you would need to either a cloud OBS or back to a system at your house running OBS and from there out to twitch. This is a very good video as far as setting up a remote OBS th-cam.com/video/_GTOb8lmOB8/w-d-xo.html I am also working on a new setup ( lattepanda delta ) with OBS running locally in windows. Planning on making a video on that setup soon.
how could we use this with obs as well to run overlays>?
You would need to send the output to an external system running OBS. So in the command instead of routing it out to twitch you would want to point it to whatever system you had running OBS.
doesnt the raspberry pi4 need 5v 3a charge, does the the powerbank you linked provide that?, i looked at the link and it looiks like its 2a, just want to make sure it work before i buy everything, thanks
The powerbank linked is the one I used. I just double checked the powerbank itself and i show this Output: 5V ⎓ 6A (5V ⎓ 3A Max Per Port), which matches the description on amazon.
@@drftkng. ohh my bad, im still a noob when it comes to this stuff, thank you for the detailed instructions!!, will try it out and see how it goes
Very Helpful thanks, But as im Not really a Computer Nerd i dont understand the Part at 5:35. Where do i Need to put the Code from the Description?
you want to create a text file that contains this code, to do so you need do the following from the raspberrypi
once on the raspberry pi type, touch stream.sh ( this will create a file called stream.sh in the current directory you are in, most likely your documents or home directory)
then open that file, nano stream.sh ( this will open a text editor and you can type or paste the command in )
save the file, Ctrl O, Enter, Ctrl X will save the file
make the file executable, chmod +x stream.sh
now you can run the command in the description via the file you create called stream.sh by typing, sh stream.sh
hope that helps
@@drftkng. thank you
@@xfef4441 Glad to help. Ill have a new video up soon that goes over my new setup which is windows based and utilizes OBS
@@drftkng. with the Raspberry too? Really looking Forward to it!
What cords do you need for this setup
You will need a USB power cable for the GoPro, USB Power cable for the Pi, HDMI cable from the capture card to the GoPro, and recommended a usb adapter to allow some flexibility for connecting the capture card to the Pi. You would also want a cable to power your phone/hotspot
can u tell why u delayed the audio ?
i’m trying to get audio and video in sync but it overrides a lot
I had to delay the audio to try and get things in sync. On my setup without the delay audio/video was well out of sync.
drft_kng i’m getting my audio out of sync too, but it is not a consistent delay so i can’t use this filter :(
anyways thx for this video! i learned a lot! i’ll get back here if i came up with a solution
@@raphaelishikawa134 Please see the pinned comment by Nikita, that should take care of the audio sync issues
Thank you, your script is working good!
I just got some errors i'm not able to fix.. maybe you know a solution..:)
In irregular intervals I get the following error: More than 10000 frames duplicated
What does this mean? Is this an error that should be taken seriously or can I ignore it?
I also get ALSA buffer xrun errors from time to time. Again I am not sure what to do.
I also wondered why the output image has a black bar at the top and bottom. Why is it not 100% output?
edit: after about 20 mins the stream crashes and the gopro / pi reboots.. but idk why
My slightly modified script reads: (I use a GoPro Hero 5).
ffmpeg -nostdin -ar 44100 -ac 2 -f alsa -i hw:1,0 -async 1 -vsync cfr -video_size 1280x720 -input_format mjpeg -i /dev/video0 -vf scale=1280x720 -b:v 2000k -vcodec h264_omx -pixel_format mjpeg -f flv rtmp://xxxxx
I have not seen the frames duplicated message, but if it is not affecting the stream i'm guessing it can be ignored. The ALSA buffer xrun seems to be related to the bitrate and video size. If they are just every so often they can be ignored. If they get to where it is happening constantly it will usually kill the stream I have found. Fix is to back down the bitrate or video size. I have used a Hero5 with the code I posted and I had no issues that I saw. As far as the black bars Twitch is a bit weird with resolutions lower than HD, but using 1280x720 should be fine. Could you possibly have the GoPro in a 4:3 picture mode that might be causing the issue.
@@drftkng. Thank you for your reply.
I tried the code again today and the stream crashes immediately.. if not then after about 5 mins.. I'm not streaming directly to twitch. I send the rtmp signal to my root server where an nginx server is running to recieve the rtmp signal, which works pretty well.
The GoPro is in 720p Video Mode..
@@drftkng. îs there any software you've installed to the rpi additionally or did you overclock the rpi ?
@@dajuustn4608 I did something similar when I was originally testing so I didn't have to rely on Twitch or sending out spam going live notices while I was testing things. Could be a hardware connection. I mention it in the video but the USB connection on my capture card was really sensitive, which is why I had to tape it. The slightest adjustment would cause the stream to die.
@@drftkng. but did it cause to let the RPI die, too? Or just the stream? But i dont think its the USB connection. when i mess with the cable during the stream, the stream still stays online.
I get this error when using the command to stream: [alsa @ 0x12523a0] cannot open audio device hw:1,0 (No such file or directory)
hw:1,0: Input/output error
Sounds like your system might have your sound device on a different hardware address. type this command
arecord -l
look for the number associate with the card and the device and modify the script accordingly
Hey im new to this stuff how could I change die Microphone? I want to use AV Jack
On your system run the command aplay -l to see how the AV jack is listed. On my PI it is currently returns this from the command.
card 1: Headphones [bcm2835 Headphones], device 0: bcm2835 Headphones [bcm2835 Headphones]
Change the -f alsa -i hw:1,0 with the appropriate card and device number listed on your PI. Beyond that you would need to experiment, have not tried to hook up an external mic directly to the PI, I would rather have the mic connected directly to the GoPro
@@drftkng. I will try
@@drftkng. I tried to connect my Microphone to the Raspberry and ran the command but under "jack" it says Jack Connection Kit what should I do
Hi this can works with the raspberry 3 b plus?
I have not worked with a RPi3b before, but I'm thinking it might be a bit under powered for this.
@@drftkng. Oh thanks for the answer you are a genius very good idea to go with an economic budget :)
@ Yeah, its fun and useful and utilized parts I had already lying around so very budget friendly. Just have to go into knowing it is under powered and only on a single data connection so the stream quality will reflect that. Hopefuly one day GoPro will let us lock down the data rates in camera.
@@drftkng. If I hope to be able to do the irl setup soon, I'm new to the raspberry platform so that excites me, maybe you remember how long you streamed irl at most and if possible remember how much internet data you spent on your mobile.
Hello! I am attempting this with a gopro hero 4 and I want to use the gopros internal mic, I get a error on my pi that says "cannot open audio device hw:1,0 (no such file or directory ) HW 1,0: Input'output error" how do I edit the code to use the gopros internal mic?
also, after I deleted all audio stuff I get output file #0 does not contain any stream
I do not have a hero4 so I am not sure how its mic is being identified. From the command line of the Pi with everything connected try running this and see what it lists for audio:
arecord -l Replace the hw:1,0 with the output address shown
@@drftkng. it repsonds with
***list of capture hardware devices ***
card 2 : MS2109 [MS2109], device 0:USB Audio [USB Audio]
subdevices: 1/1
subdevice #0: subdevice #0
@@drftkng. does it matter which USB port the capture card is plugged into?
@@Rscapeextreme447 based on that I would try hw:2,0 and no it shouldn't matter what usb port the capture card is connected to.
Sorry, but I can't find the link to the script, how can I do it?
Its in the description, but ill link it here as well
ffmpeg -nostdin -ar 44100 -ac 1 -f alsa -i hw:1,0 -async 1 -vsync cfr -video_size 720x480 -input_format yuyv422 -i /dev/video0 -vf scale=854x480 -b:v 2000k -vcodec h264_omx -pixel_format yuv420p -af "adelay='1000|500'" -f flv (Twitch or Other RTMP Server Address)
@@drftkng. ok, thanks, and for this I just have to install ffmpeg, right?
Any update on this?
I've moved on from the Pi, currently using a Belabox. belabox.net/ Its a really nice setup and very easy to use.
New twitch link ?
yes sorry, forgot I had modified it a while back. updated it in the description www.twitch.tv/drftkng_
How can I use this setup for 1080p streaming
You would modify the -video_size and or the -vf scale, however in my testing 1080 is pushing the Pi4 limits and did not deliver favorable results.
@@drftkng. I think an encoder is better option than the raspberry pi
Are you still running the same script?
For this particular setup yes. I've tried a bunch of different setups since I made this and feel like I finally have my new setup dialed and really understood the benefits and pitfalls of it and the others I have tried. Should have my new backpack this week. So planning to make a new video soon.
@@drftkng. ok that's nice. Looking forward to seeing it! :) all the best
cant you just stream with the gopro directly on twitch ? why do you need Raspberry pi
You can absolutely do that with the GoPro's built in software on the 7 and greater. Using the Raspberry Pi gives me much more control over resolutions and bit rates, allowing me to work within the constraints of my cellular connection. Hopefully one day GoPro will allow users to limit the data rate being streamed, but right now that is not an option.
I can't seem to get it to work for the life of me, im not sure what I'm doing wrong
I think the problem was because my phones hotspot was too slow
just learned that the problem was my phone plan not supporting hotspots lmao