Andreas, 48hrs ago I didn't have a clue about any of this stuff. Words like MQTT and Node-red meant nothing to me. I've had some time off work to learn a new skill. From your image I now have everything working. Well done to you and Peter Scargill for such great work. I really have the bug to learn more. It just goes to show that you are NEVER too old to learn a new skill. Happy New Year !!
Thank you for your feedback and welcome aboard! Actually, also Peter and I are no more considered to be young by age. Only in our heads, we try to stay at least flexible... Happy New Year to you, too
I currently hacking a Atari 2600 to host a PiZero for an RetroPie console. I love the PiZero! My next project will include multiple ESPs for temperature sensores, event counters and number transmissions for displays. So your work saved me from hassle even before it has started. You are THE BEST!
I wish I had this script when I installed all these manually on my Pi3 last year. It was a painful process that took me days to setup and configure. I can now use the script to do a clean install of everything on my Pi2 and Pi3 ( don't have a PiZ). Didn't know about the DietPi. Looks amazing. Thanks Andres
I already have a couple of Pi Zeros (v1.2 & 1.3) so I've been putting off getting a Pi Zero W, since the previous Zeros work OK with a USB hub and USB Wi-Fi dongle. I was hoping that would work for this project. Then I read on Pete Scargill's Tech Blog that he already tried that, and it works great. Thanks again for both the SD card download, and this video.
I had great success with this on both a Pi-Zero with a WiFi dongle, and with a Pi-3. Thanks to both you and Peter for this contribution. But seeing that Peter added comments in the Christmas script in March about successful testing with a NanoPi M1 & M3, coupled with the fact that I've been looking (waiting) for a beefier alternative to a Pi-Zero, I thought I'd look into getting this working on a NanoPi. Well, looking no further than ArmWorks selling a NanoPi2 (only slightly larger than a Pi-ZeroW, but with a 1.4GHz Quad Core Cortex A9 processor) for $15-shipped, I experimented a little. Here are my findings: Well, all did not go too well. The first stickler was that the closest DietPi SD image available to a NanoPi2 was one on the DietPi website for a NanoPi M2. Outwardly, it seemed that the most significant difference was the lacking of an ethernet port on the NanoPi2--shouldn't be too significant, so I installed it. Everything seemed to be okay, except for two things. 1) upon booting and displaying the normal information before allowing user logon on terminal 1, the input was blocked. However, an Alt-F2 switch to terminal 2 got around that. Eh... not perfect, but workable. 2) when installing either LXDE or XFce, neither would work--seemed to be failing during X. But having gotten that far, the Christmas script seemed like halfway-good idea. Well, it did run... but with a generous amount of errors; mostly having to do with file-system access or something missing from the internet. It was minimally successful; Mosquitto broker worked, but the web server did not. So..... no ability to test further. Anyway, would you be willing to take a shot at this? I would gladly provide the NanoP2. Thanks.
Thanks for your long feedback. I am glad that my viewers try things and report it for other viewers! I am not a LINUX guy. This is why I have to stick with the most standard platform, even if better ones are out. Maybe one day I know a little more...
Bravo!!!! Amazing! Looks like you are reading my mind! It's what I was going to make by myself next week as I got my Zero W. I already tested MQTT and Node-red with psf b85 (ESP8285) (Thanks to your mailbox post) but it was on my Laptop. Now I even do not need to install mqtt and nodered as you made an image! And even with sqlite! Thank you thank you thank you! It will save a lot of my time! I'd like to hug you very tight!
well, Peter's script exists from more than an year, what Andreas did was just using that and publishing what that script produced on a specific device... nothing more, nothing less, nothin else...
Big thank you (and to all who made this possible). I did not actually knew the wifi-version of this existed, and this is exactly what i've have wanted. Will buy a Zero W tomorrow :)
Another fantastic video! I just achieved a milestone that I think you'll enjoy… Over the past week I have watched all of your videos from number 1 to this one! The information and knowledge was great! I also made sure to press "Like" on each one ;-) Watching Andreas TV is much better than normal garbage TV we have in USA!!! Many thanks… I will continue to watch and also "Like". One closing note: I was so disappointed when I checked TNN mapper and found only three gateways for LoRa in the entire United States with one of the three due to be decommissioned :-( ... why? Thanks & Keep up the great work !!!
1. Thanks for your support! 2. I count more than 2 (www.thethingsnetwork.org/map). And, of course, you can change that it if you add your own gateway ;-)
Great video. Love the information. I'm setting up my PI as a headless server. I was unfortunately unable to user your image for some reason, but, following your directions, I'm able to get my pi setup. Took a little over three hours. Thanks for the details.
I think you are misunderstanding me Andreas! I mean you make it too easy for us mere mortals if OUR goal is to learn, the whole script + config ready to run! It makes a very convincing argument for a total newbie to "dip a toe in the water" with a Pi Zero W if it is put in front of them in such a complete package! Thanks again. Garry
No, no. Please be aware, that, at the beginning of this year, I did not know anything about MQTT, Linux, LoRa, and Raspberry Pi. So, I also had to learn a lot. But it is always frustrating, if I start something, and get error messages during installation or setup, because then, I have no idea where the problem could be. That is why I love scripts and other helpers. With them, I get at least a chance to succeed.... I can add complications later, when I understand a little more.
@Andreas Spiess: I had a little trouble running your SD card image, more specifically testing the mosquitto broker. I found that the broker would refuse connection without authentication and I had no idea of passwords set. I found I could change the configuration slightly to allow anonymous connection which inside my firewall for test is OK. I navigated to the configuration file and used the nano editor to open the file for edit as below root@DietPi:~# nano /etc/mosquitto/conf.d/websockets.conf I edited the line: allow_anonymous false to read -> allow_anonymous true Then saved the settings with Ctrl and O before I exited the file with Ctrl and X before a reboot to load the new settings. Everything works superbly, thanks again
Great.... just doing some idle Sunday morning cruising the TH-cam channels and when I see one of your videos. I will take some time to view it because your content is great. Now I'm fully down the rabbit hole fully learning about MQTT and NodeRed. Thank you for introducing some "to me" new technology. GeekMustHave
Andreas this was an excellent tutorial. I got it working on a Pi3 but it took quite a bit more than the 30 minutes. Perhaps a few days of tweaking the sql code. I particularly like the date note for node red so it displays the last update. I will use that on everything from now on. thankyou.
Andreas I'm stuck. I've got so far thanks to you and Peter Scargill. 3 weeks ago I didn't know anything about this stuff. I've now got everything working and ready to flash a Sonoff device. I'm going to use Tasmoda. This is probably a really simple question but my inexperience is showing. Tasmoda has many language options and I need to choose English. The Tasmoda config asks this question "Uncomment one of the lines below to build/upload only one environment" I don't know what to do. This isn't an intuitive question for a novice. Sorry for my ignorance. Kind regards Douglas
Big thumbs up ! used your image, ok on pi-zero with usb-wifi and usb-ethernet, same config also worked on rpi3 with onboard networkdevices, only 1 problem in piZero/pi3 : need to restart mosquitto first, nice surprise to find webmin on port 10000. Installed mqtt.fx 1.3.1 on windows 10, good for load testing to send many messages very fast (see script option). Using putty to see htop on rpi + another session to see network load using iftop.
I just finished to install OpenHab on a new PI 3 with OpenHabian script. I think I will add Node Red too, looks nice! Please continue with this kind of videos, they are great!
Great video, as usual... Congrats! You always anticipate the work we must done giving ready-to-use lot of experienced hours in few minutes. I red few comments: in my opinion 10 minutes of video are the best way to stay concentrated and to capture almost all we need. Bye
Hi Andreas, I love your videos and they have been a great source of inspiration for many of my projects!!! Thanks so much for sharing your image file for this. It has come in very handy!!! Keep up the great work!
I personally wouldn't send the 'timeStamp' column in the SQL INSERT. I prefer to config the column as 'CURRENT_TIMESTAMP' in the PhpAdmin, and it will write the timestamp by itself. I prefer doing this because it's easier, and pretty useful for iot applications where using less code can also be trivial. I have to say that I really like your content and this video made me learn more things :). Life's about learning.
Absolut tolle Videos, die mich dazu inspiriert haben, mein Appartement als Probelauf für das künftige Haus zu automatisieren. Danke dafür und bitte genauso weitermachen:)
Das ist ja wunderbar. Dann weisst du auf was du beim Hausbau achten musst. Die meisten älteren Häuser sind ja nicht gut für die automatisierung eingerichtet...
Thanks, Mr. Spiess. You earned another subscriber. (August 2020) I tried your image onmy Raspberry 3 B, but it didn't boot. Tried several SD cards, but no success. Then I went directly to the DietPi download page and tried their images there (both the 32 bit and the experimental 64 one) but those didn't work either. Maybe I'm missing something? Luckily I could run Pete Scargill's script on a Raspbian image.
Nice video I will try DietPi for sure. One note you can enter the wifi password without a monitor. Solder headers to the Pi Zero and connect a FTDI adapter.
Thanks Andreas for bringing Peter's script to my attention. I just wanted to give my feedback on the sd image, I was able to get it up and running and resized successfully but for some reason apache (though it is running) simply serves up a blank webpage. I investigated /var/www/html and found an empty index.html file and a folder for phpliteadmin (going to the IP/phpliteadmin successfully loaded the phpadmin but Peter's launcher page is not there. I'm on the new pi zero W and I'll probably do the whole thing from scratch in a little bit but I wanted to see if anyone else experienced this.
I actually didn't do any of that manually the GUI handled it. After you click move/resize in gparted you can hover over the left and right arrows on either side of the colored bar and you get a 'grab' cursor so I dragged the one on the right all the way to the end on the right and that filled the card for me.
Great video, thanks for providing the image... however running out of storage space... 1.8GB fixed space.... 6.2GB used on my SDCard. Getting out of storage space errors.
I used a small image because I wanted, that people can use their old SD cards. I am not a Linux guy, but maybe you can expand your file system somehow (I did this on the Raspberrry with Raspian)
at time sync 3:41 you show a wifi doggle. I thought Wifi was built in? The reason for the question is I am getting eth0 not found both with the doggle and without. Trying to figure out how to connect the keyboard,mouse and wifi.
Andreas, how do I become a paid subscriber? You have given so much, it is time to support you for your tireless efforts. I really don't know how you achieve so much and deliver it so eloquently and clearly.. Without you, I am lost. Many thanks to you and Peter Scargill, what a wonderful collaboration. 👍😀
There is no need for more support. I get a few dollars from TH-cam and I can buy some stuff for free from Banggood (because of my sponsored link). The rest is hobby. And my time is more than rewarded with the feedback I get from my viewers like you!
I had a couple of thoughts since you're using DietPi (my personal favourite). You can enter a hostname in dietpi-config and then you don't need to worry about the IP address so much. Also, Dietpi supports external USB memory/drives so you can configure a USB drive for all your user data. Its faster and less risky than writing to your SD card :)
I read that Peter wanted to include the hostname feature in his script. Maybe it is already done... I will have a look at it. Concerning SD card: I have an old HD on my main Raspby. But here, I carry the risk of losing everything. I do a backup from time to time.
For those who are interested in using Peter Scargill's script in 2020, please be aware that he no longer supports its use on both the Raspberry Pi Zero AND using DietPi. Checkout his site for more info before descending down that rabbit hole. tech.scargill.net/the-script/
Andreas - thanks for another great video. I watched last night and thought “interesting but what could I possibly need this for?This morning I woke up & realized this is the MISSING LINK to datlogging the esp8266 and esp32 based automotive test equipment I built for my shop. Now my fuel injector tester and my air flow bench will be able to automatically log the test points as mqtt messages!
The node libraries which Peter Scargill installed with his script made me curious, so I run it on a Rpi 1B last night. The script ran insanly slow on that hardware, but surprisingly the Node-RED server is running better than I expected. It takes of course longer than on RPi 3 to initialize the web frontend, but once it is down, the performance is enough to create flows and deploy them. I did not figure out why, but with the testinstallation done via Peter Scargill's script I was unable to add further node libraries. I think something went wrong with the npm setup.
Good to know, thank you. At the moment I'm thinking that the DietPi installer in the current version already brings everything with it what I need for my project. I just installed Peter's script to check it out. If I decide to keep on testing with that RPi 1 image, I will start debugging the npm installation, maybe it's an access rights or version conflict.
Hi Andreas Another great video and also many thanks to Mr. Scargill ! I did everything per instruction but can't install anything as I realized there is no disk space. So I followed the instructions for expanding the SD partition but with no luck. I downloaded the newly instruction from your GDrive but they don't work for me for the following reasons: 1) using the easy instructions, I can't do this as I am unable to add login into any desktop as I can't install anything due to limited disk space 2) using the "hard method", I can't sudo umount as I get an error "target is busy" error any help is greatly appreciated... Many thanks in advance, MG
1. The simple possibility works on a Raspberry 2 or 3, not on the Zero. So, no need to install anything. 2. With both methods, you have to have an SD card reader and put your DietPi/broker SD card there (as a second and unmounted device)
Hello Andreas, Do you have a video that is more current for setting up an MQTT broker? This is all new to me and I really enjoy your videos. I searched but couldn't find anything on your channel. Thank you.
Hi, thank you for this great video. It is still relevant in 2020 ? Can i run it trough putty only ? Don't want to connect to a display. Thank you very much for the answer.
Andreas Spiess i’m following your channel for like 6-7 months but this is the only video about the smart home (mqtt) . I’ve missed something ? Thank you
I use Raspbian Lite in a similar matter and I found out that the HDMI output is switched on, even if there is no screen attached. Switching this off saves power and reduces the CPU temp, I read somewhere that it can reduce 20% power. To switch off the HDMI output type "/usr/bin/tvservice -o" and add this line to "/etc/rc.local" at the end, before "exit 0". I don't now how this is set up in DietPi.
I found out that switching the HDMI port off reduces my CPU temperature (at room temperature) from about 31.5 to 29.5 deg C. I don't know ho to relate this to power use, but it must be a relevant amount.
Thanks Andreas , I think SD card image needs to be updates , dietpi update services says "Your version of DietPi is now obsolete and cannot be updated ".
This is well possible. I cannot maintain all images for all my videos. But with Peter's script, you should be able to create your own image based on the newest dietpi.
Hi Andreas, thanks for sharing your excellent work , I am not able to follow your video for running Peter script after flashing dietpi image into SD card and enabling WiFi Could you please help me to run the Peter script to install all the required installations , thanks in advance for your support
Maybe you go to Peter's blog for help. There you usually get help from the guys who know more than me. But you have to describe exactly what you did and which error you got.
sorry - it did not work by plugging your image into a RasPi3 doesn't it see with ip-scan attached via ethernet :( then I tried to modify config & cmd to access to it with USB/Ethernet. also no success. now I take the time and install it from scratch for the RasPi3
This is not a surprise, because the dietpi does many adjustments during the first install (maybe also to the environment it runs on?). So, the way would be, to install your OS of choice and apply the script. It should run much faster on the -3 than on the zero.
the image Andreas published is meant to be used on RPi0, RPi0W and maybe on RPi1B, nothing else... these boards use armv6 arch, while quite all the others use armv7 and usign Peter's script is best, because there are other optimizations in those cases... and you get php7, too, which is less memory hungry than the 5 which is in this version... running the script is a matter of minutes, than go away, return after about an hour and you're done... we spent very long time optimizing everything on every board... i'm the MrShark you'll find on his blog...
Loaded your image fine. Great work. I am stuck getting into Node Red Control Panel from PETE'S UTILITIES. I have run out of ideas for the Username/Password.
Thanks for your service to the hobbyist community. I have an issue with your image file installation i.e., when I add these lines, editorTheme: { projects: { enabled: true } } in settings.js file I can add Projects option in the Menu of regular Node-red. But it is not working in Node-red of your image file installation. Please advice me, how do I get the "Project option" in Node-red Menu if I use your image file. Thank you again.
Hi Andreas I enjoy your videos. I have tried using your recipe to install 'The Script' on my rPi3. Worked fine with Raspbian. Then I liked to try it on DietPi. In the video at 1:55 you show how to add the user pi. For me it would have been a great help if it was clear which lines belonged together.(blank lines to separate) On the 3. try I managed to do it:) Now I cant figure out what password to use, when I try to login as pi. Please help a newbie. I dont know if you have tried this :) After struggling many hours and finally you have to ask for help, then suddenly you figure it out, sudo passwd pi.
yes. I had issues too. especially a wrong line speration and made an imcomplete user pi and had to remove entire group and the user account. after then Scagil's script did not recognised pi as user. some bugs. then had to modify his script to make it work. took more than 1 hour to get it right. It was a difference between the rasbian and ubuntu. The script did not consider that. and my raspi 3 kept stuck in the loophole. Eventually I separate the scripts into functional chunks and ran all to the end, heavy modification to the original, bur learnt so much about bash script language. It was a steep learning curve but so much rewards now.
Really good Video, liked Diet-Pi as a minimal OS and have used Mosquitto as the broker with an ESP8266. So success. Have run into a problem which others may come across. Have used the Wireless of the Pi Zero and it has a DHCP assigned ip address. Would like to change this to a static ip address to stop the ip address from changing (occasionally via the dhcp). So far have not managed to get the Diet Pi OS to assign a static ip address to the Wlan interface. Starting to think its a bug in the Diet Pi OS.
After some investigation it appears that my problem was being caused by the dietpi-config program. Changing the Network adapter settings for wlan0 from dhcp to static did not save any of the static address details to the /etc/network/interfaces file. Adding them in manually to the file resolved the problem and the wlan0 adapter now has a static address as required. After a reboot of my router and a reboot of the piZero, the piZero now works with the static address. So, it looks like a bug in the dietpi-config program is the fault here.
Great eye-opener Andreas, thank you. To put this into context for myself, what you are saying is that you could set up your IoT home with as many wifi enabled devices as you like, and, as long as they can talk MQTT, for $20 and the price of a wifi adapter you can have this device log every possible event. It is stand-alone. It does not have any effect on how any given device behaves or reacts with its immediate controller, eg smartphone. Have I properly understood the context? is there another benefit? Cheers.
Just wanted to check that I had understood the reason for the setup. Thanks for the reply, keep up the videos, well made, very clear, very easy to understand.
A bit late for the party, but: Thanks for the excellent tutorial. I've got it set up and appears to be working OK, but how do I use it to do something useful eg: I've got a light that I've 'tasmotised' and can control using the Node Red in Home Assistant. How do I (say) turn it on using this set up? I've tried injecting 'on' with the topic of the bulb (Lohas_Bulb2) and subscribed to the same topic, but nothing happens. Maybe it's a lot more involved than this! I'd be grateful for some help, please. Jim
You have to use the right topic as well as the right command. Otherwise you will not see any reaction. I did other videos about Node-Red and similar stuff.
Hi - thank you very much for the image! I cannot seem to get the Zero W to connect to my WiFi though - I edited the dietpi config file after writing and before booting for the first time, but regardless of what I make the static IP, after boot, it always just says the ip is 192.168.0.202 - using AngryIP Scanner I cannot see the zero on my network at all.
Hi Andreas, can you please tell me where I can find the image for this, sorry but I have only statred using node red in the last two days, have already spent many hours on the journey, thanks for your fantastic video classes !
Hello Andreas, Thanks for sharing this very interesting project and providing the pre-installed image. It's really amazing! I tried to upgrade the node red software and also some nodes (e.g. openweathermap) - but struggled. Any chance that you can provide an image of this project with the latest software versions (also dietpi os)?
Great, Great Work! I am a fan of your videos, great source of knowledge and inspiration. Can one find the MQTT Test Flow and MQTT Logger Flow in the SD or do you have to build them? Thank you
Hi Andreas and everybody. First of all thank you very much for this contribution. Has anybody achieved to establish a SSH conection to his Raspberry Pi Zero Wifi, using Andreas' Pi Zero Image File?? My Raspberry isn't even connecting to my Wifi, I changed my Wifi credentials in the dietpi.txt file and I cannot find it using an IP Scanner. Maybe I have to wait more than 5min for the first boot? What do you recomend me to do? Thank you very much Andreas and with best greetings
@@AndreasSpiess no problem, I also switched to RPI OS and have now an image of my RPI zero Wifi with Mosquito Node-Red, Dashboard and Autostart. If you need it, I can share it with you. Mit besten Grüßen :)
Andreas Spiess, very god work!!! I have a question, How can i remove de login when I try to access the Node-Red/Dashboard/ui? I would like to work the /ui without the login and password "user" "user".
Hey man, I had same problem, my solution was to delete the file in /.node_red folder realize the period in /.node_red find file settings.js and type in this command rm settings.js " this deletes the passwords after you reboot the pi" worked for me ok.
I've used etcher program to download the Raspberry pi to a SD card. It takes the zip file and unpacks it without having to use any Linux commands. It seems quicker.
Hi Andreas,i' using your image. Thank you for sharing and saving us all a lot of time.Unfortunatly i have a issue with Mosquitto. I use a Raspberry Pi ZeroW. It works fine with LAN Adapter. When i switch to WLAN it doesnt work anymore. mosquitto -v shows the following1498105665: mosquitto version 1.4.11 (build date Mon, 20 Feb 2017 22:47:27 +0000) starting 1498105665: Using default config. 1498105665: Opening ipv4 listen socket on port 1883. 1498105665: Error: Address already in useEven a reboot brings here no solution.Do you have a idea what is nessessary to bring it running on WLAN?ThanksThomas
Hi Ken, I have the same issue."Address already in use" and no idea about Linus. if you find a fix, please share it . I'll do the same. @Andreas, excellent videos! thanks a lot for them!
I talked to the developer of the script on his page. they recommend a fresh install of dietpi and run the script. Andreas version is not as much up to date as it should be. I'll try it but I stuck on different points because I have no knowledge about Linux. But I'll master it. :)
hi andreas, this looks excellent. im new to linus and the rasp pi. im still waiting for my pi3b to arrive. i was initially planing to use hass.io, but node.red looks a lot easier to use. i want to integrate my home automations with all my xiaomi smart home sensors. what do you think would be the best way to integrate the xiaomi gateway with node red? i could still use home assistant than use mqtt to communicate with node red, but im wondering if there is a better way? ive also got some esp8266 devices coming for some other projects (garage automation and indoor plant watering). please can anyone suggest best way to integrate xiaomi mi home sensors?
I wonder how long can the SD card hold under a 247 operation. They are known to fail thought time. This could be an opportunity to make a tutorial of how to save / extend the lifetime of the SD card, probably getting the ok to boot into read-only mode.
Been through a bunch of videos. This is the one I want to work more than the others... Has what I need. Thank you. This, being my first attempt using Node Red (New User), I feel I've done well just getting to this point... I'm stuck. The dashboard is requiring Authentication. Is there a fix?
Thank you for this nice image file. It seems to work. Yet there are two obstacles which prevent me from experimenting: (1) Node-RED shows "failed to open /home/pi/sqlite/nodered" and indeed I do not find such a folder. (2) I cannot find any link to the „MQTT test flow“ mentioned in the video at 5:25 which I could import into the clipboard nor do I find the „data logger“. Any suggestions?
I do not remember the details but thought, maybe the flows were on my image. But I am not sure. If not, you can build them yourself with a few clicks as most of the info should be provided in the video. Concerning your error message, I cannot help you, because I am no expert in Linux.
Thanks for your quick answer. Node RED works now, the solution was given by the password issue pinned above (I was not aware that my problem relied on that). Yes, now I can build the flows myself. Your image is one year old. There are newer builds of dietpi. But which one is suited for the pi zero w? Does anybody offer a newer image?
Thanks for the advice. I did so, but it was more difficult than expected, with some frustrating experiences, because there are incompatibilities of debian stretch and the mosquitto package on the Pi Zero. The GOOD news: The clever guys of dietpi managed somehow to overcome this and in the newest version 6.2 of dietpi (appeared only 3 days ago) you can install mosquitto, and IT WORKS in node-red in the browser. BUT it is still impossible to install mosquitto-clients in order to subscribe and publish on the command line.
Hi andreas...I'm a big fan of your work....does you SD card image for the raspberry pi zero works for the raspberry pi 1 ( I've read that is basically the same processor but I don't Kwon if the SD card image is compatible)...
Thank you Andreas for this video and your work! Do you or anybody has a good and safe design for node-red connection to SONOFF? I mean cover to every failure if I have a simple switch on the UI? I have an idea, but I can imagine that I am not consider every of the faulty situations (Broker, SONOFF died, initialization issues, other switch/input change the state). I would like to ask you to make a video to cover every of these problems. Thank you in advance!
It is possible to reprogram the firmware on your sonoff in the Arduino IDE do just as you wish; MQTT libraries work very well on the ESP8266 chip. There is a lot of information available on Peter Scargill's blog and Andreas's videos. If you have the way to solder a header and reprogram your Sonoff then you can easily interface using MQTT via Node-RED just as demonstrated here. I am sure I have seen some mention of IFTTT and Sonoff together but have not seen any example. If there was API access to our Sonoff devices while they ran stock firmware and used the Sonoff servers you could do this also with Node-RED I guess. It may happen?
I already know how to reprogram a SONOFF. The question how it can be use a Safety way of design in the NODE-RED side and the SONOFF side if something happens. This is my question basically. The normal flow can be seen many video streams, like Andreas videos as well. I am very grateful these kind of videos. I would like to see the "what if" videos like : MQTT Broker down how to handle this in the SONOFF and the NODE-RED side for example. Thank you as well for your response!
There are many strategies you could try. To start there are QOS levels available when you connect or publish which can ensure that messages queue until they are delivered, this is safe, maybe? The LWT allows a message to auto generate if a device goes off-line without grace (any kind of failure). The will message can flag a hardware issue if this is what you need? If you need to know the status of your connection; up/down while the system is idle, in between infrequent but critical messages you could have a ping/ack run in the background though this will perhaps just flag the death a little earlier than LWT though I haven't tested this. Depending on what nodes you use in Node-RED, some like the "BigTimer" have a function to refresh the current output status to the device every minute in case it has re-connected but again it would not be difficult to poll Node-RED for a status on reconnect? So many ways and powerful, flexible tools to work with... HTH, Garry
Re: Video #126 Years ago I'd dl's and used the sdcard image you'd made from peter scargills christmas script. Thank you. I used the web interface with node-red and mosquitto to monitor and control a basement sump system. Hardware was a pi zero w and an ESP8266 with several sensors. Now, while starting with the same sdcard image for a different but similar project, I find the Diet-Pi version used is too old to upgrade and there were a few nodes I needed that wouldn't install without the upgrades. My Node-Red interface used live gauges, historical graphs, buttons and switches... All viewed on my browser. While looking at the script contents I'm guessing I don't need all of the many included programs. To save space, given the limited info I've provided, can you suggest which packages I will likely need for this project? The project is to monitor and display live and historical data of current flow through individual breakers in my house. My recent electric bills have gotten my attention. This seems to be a good place to start. Thank you for all you do. redisette
What about corruption of SD card because of writes to the database? Would be nice if you could make a video on how to temporarly save values into RAM for a few hours, and then flush them into the database, so it would write only twice or 3 times a day to the sd card.
I too have no idea how to use the Pi's flash memory but it is also relatively easy to mount a storage device to USB and create your database on this storage or to mount a network storage to your Pi. For example; on my existing Pi board which is permanently installed inside my home security alarm system I have gradually come to depend on many Node-RED flows and many MQTT subscriptions to the broker all hosted on this very old Raspberry Pi with the weak link probably being the SD card in this Raspberry Pi. For this reason I have the following in place: 1. I have my 2TB NAS drive mounted on my Pi from reboot (I use cron to run a bash script on boot which will "sudo mount -a" mount all drives listed in the file system table "fstab") 2. I use my NAS drive as storage for any data, logs etc to reduce write cycles to the SD card and provide data contingency/redundancy. 3. I also use "cron" to run an other bash script which creates a compressed backup of my SD image once per week at 2:30am on Tuesdays so I can easily flash a new card if I have a SD failure I am more than happy to document this if Andreas or one of your subscribers would like to create a tutorial, just ask? Garry
msevyt I think that each bit on the SD card has 10,000 writes and I'm pretty sure it balances out the writes to the different bits. But if you wanted to achieve something like this it would definitely take some coding or googling to find the solution.
Just be careful with sqlite. Only one process should be writing to it at a time or you can get corruption. In this situation I doubt it will happen but it's just something to look out for. If you have the option you might switch over to MySQL as it's faster and doesn't have the issue of only being available to one process at a time. Thanks for doing what you do and keep up the great work!
I used mySQL on bigger machines, but thought, this is sufficient because the Zero is really slow... Thanks for the hint about concurrency. I did not know this limitation.
Ill have to get me a Raspberry pi zero as you make it so easy by providing the SD card image. While i wait for the zero to ship ill mess about with with Scargils script on my orange pi.. thanks
Hi, Is anyone else having problems installing new nodes into node-red with either package manager or from the palette? I'm sure this was working on a previous version of the disc image a few weeks ago. Have flashed a newer image that is now hosted on Sensors.iot and I cant add any new nodes???
Having the same issue here - It seems like Node-Red cannot access the internet. I tried to setup a Ping in Note-Red for "registry.npmjs.org" and "google.com" without luck. Then I tried from the Webmin and Putty directly from Dietpi, and still no luck... Somehow the Dietpi seems to be disconnected from the internet which is strange - I'll see if I can work more on it, but would also like to hear if others are having the same issue.
Hello, and sorry if this has been addressed in comments, but I cannot access the node-red dashboard in your sd card image, I've tried all of the 3 sets of credentials given but none allow access... I also can't seem to see where to flush the dashboard settings. This is my very first foray into node red so I am a total beginner.
Hi Andreas, i used your dietpi image.. thanks a lot.. however, i got a small question.. what is the default username/passw for the node-red dashboard? (or probably guide me if there is a link where to get this info?) i figure out already what are the default username/pass for others (dietpi, node-red, sqllite, webmin),, its just the node-red dashboard which i cannot find.. thanks again for a very wonderful video.
Hello Andreas, greetings from the guy with the English accent :-) First may I thanks you for ALL of your videos. I have tried to use your DietPI on my Raspberry Pi zero W. I downloaded your image zip file, extracted it and then wrote it to my 8GB SD card and then entered my WiFi details into the correct txt file. All went well. However when I power the PiZero and it boots to the image the IP address does not change to the fixed IP address I entered and the last line I get on the screen are; -------------------------------------------------------- DietPi I 22:10 I Thu 06/04/17 -------------------------------------------------------- V147 I RPi Zero W (arm61) -------------------------------------------------------- IP Address I 192.168.0.202 -------------------------------------------------------- Default Login: Username: = root Password = dietpi Then just a pulsing - There is no interaction to the key board and I have left it in this state for many hours but still no improvement. Any suggestion as to how to fix this would be gratefully accepted. Best regards Peter
Excellent - glad you got it running - there are some changes coming to the script very soon - keep looking in. It will only get better.
Thanks for your work. Subscribed to your channel.
Nice work.
Can I plug the SD card into a RPI2 B+, instead of RPI Zero? I don't have a Pi Zero but have many Pi2's.
Andreas, 48hrs ago I didn't have a clue about any of this stuff. Words like MQTT and Node-red meant nothing to me. I've had some time off work to learn a new skill. From your image I now have everything working. Well done to you and Peter Scargill for such great work. I really have the bug to learn more. It just goes to show that you are NEVER too old to learn a new skill. Happy New Year !!
Thank you for your feedback and welcome aboard! Actually, also Peter and I are no more considered to be young by age. Only in our heads, we try to stay at least flexible... Happy New Year to you, too
I currently hacking a Atari 2600 to host a PiZero for an RetroPie console. I love the PiZero! My next project will include multiple ESPs for temperature sensores, event counters and number transmissions for displays. So your work saved me from hassle even before it has started. You are THE BEST!
;-)
Amazing! Communities are really pushing the entire IT industry forward with an unprecedented pace! Thanks (both of you) for sharing! Big LIKE
You are welcome!
Amazing Andreas how much value you bring in 10 minutes .. each and every time ...
Thanks! I learned, that you guys (the viewers) only spend 5 minutes in average with my videos. So, why should I make 60 min videos? ;-)
2 years old but still relevant. Thank you Andreas! And Peter Scargil
You are welcome!
Yesterday, I was just thinking about how I could do this. What a delight to find your presentation on this very topic! Thank you very much, Andreas.
You are welcome!
I wish I had this script when I installed all these manually on my Pi3 last year.
It was a painful process that took me days to setup and configure.
I can now use the script to do a clean install of everything on my Pi2 and Pi3 ( don't have a PiZ).
Didn't know about the DietPi. Looks amazing.
Thanks Andres
I am interested about your results if you run this script in an existing (not clean) environment, because I also have one like that...
10-4
Im really happy to see he is still updating his script even today
:-)
Fantastic work. Many thanks to you Mr. Spiess and ofcourse to Mr. Scargill
:-)
Thank you very much for creating the pi zero img file.
+David Manning You are welcome!
I already have a couple of Pi Zeros (v1.2 & 1.3) so I've been putting off getting a Pi Zero W, since the previous Zeros work OK with a USB hub and USB Wi-Fi dongle. I was hoping that would work for this project. Then I read on Pete Scargill's Tech Blog that he already tried that, and it works great. Thanks again for both the SD card download, and this video.
+Art Becker I tried my image also on an old Zero. It worked, too
I had great success with this on both a Pi-Zero with a WiFi dongle, and with a Pi-3. Thanks to both you and Peter for this contribution. But seeing that Peter added comments in the Christmas script in March about successful testing with a NanoPi M1 & M3, coupled with the fact that I've been looking (waiting) for a beefier alternative to a Pi-Zero, I thought I'd look into getting this working on a NanoPi. Well, looking no further than ArmWorks selling a NanoPi2 (only slightly larger than a Pi-ZeroW, but with a 1.4GHz Quad Core Cortex A9 processor) for $15-shipped, I experimented a little. Here are my findings:
Well, all did not go too well. The first stickler was that the closest DietPi SD image available to a NanoPi2 was one on the DietPi website for a NanoPi M2. Outwardly, it seemed that the most significant difference was the lacking of an ethernet port on the NanoPi2--shouldn't be too significant, so I installed it. Everything seemed to be okay, except for two things. 1) upon booting and displaying the normal information before allowing user logon on terminal 1, the input was blocked. However, an Alt-F2 switch to terminal 2 got around that. Eh... not perfect, but workable. 2) when installing either LXDE or XFce, neither would work--seemed to be failing during X.
But having gotten that far, the Christmas script seemed like halfway-good idea. Well, it did run... but with a generous amount of errors; mostly having to do with file-system access or something missing from the internet. It was minimally successful; Mosquitto broker worked, but the web server did not. So..... no ability to test further.
Anyway, would you be willing to take a shot at this? I would gladly provide the NanoP2. Thanks.
Thanks for your long feedback. I am glad that my viewers try things and report it for other viewers!
I am not a LINUX guy. This is why I have to stick with the most standard platform, even if better ones are out. Maybe one day I know a little more...
Bravo!!!! Amazing! Looks like you are reading my mind! It's what I was going to make by myself next week as I got my Zero W. I already tested MQTT and Node-red with psf b85 (ESP8285) (Thanks to your mailbox post) but it was on my Laptop. Now I even do not need to install mqtt and nodered as you made an image! And even with sqlite! Thank you thank you thank you! It will save a lot of my time! I'd like to hug you very tight!
well, Peter's script exists from more than an year, what Andreas did was just using that and publishing what that script produced on a specific device... nothing more, nothing less, nothin else...
You are right. And here, we have the prove, that technology is only effective if it finds its consumers... This was my part today ;-)
Wow! Mr Spiess you're a great teacher👍
Thank you!
Worked a treat, many thanks for the image file.
Big thank you (and to all who made this possible). I did not actually knew the wifi-version of this existed, and this is exactly what i've have wanted. Will buy a Zero W tomorrow :)
Please be aware that the zero is very slow.
@@AndreasSpiess If it is more or less like a raspberry pi 1, then I am fine with it. :)
Another fantastic video!
I just achieved a milestone that I think you'll enjoy… Over the past week I have watched all of your videos from number 1 to this one!
The information and knowledge was great! I also made sure to press "Like" on each one ;-)
Watching Andreas TV is much better than normal garbage TV we have in USA!!!
Many thanks… I will continue to watch and also "Like".
One closing note: I was so disappointed when I checked TNN mapper and found only three gateways for LoRa in the entire United States with one of the three due to be decommissioned :-( ... why?
Thanks & Keep up the great work !!!
1. Thanks for your support!
2. I count more than 2 (www.thethingsnetwork.org/map). And, of course, you can change that it if you add your own gateway ;-)
Awsome as usual Andreas your efforts are priceless!
Thanks!
Great video. Love the information.
I'm setting up my PI as a headless server. I was unfortunately unable to user your image for some reason, but, following your directions, I'm able to get my pi setup. Took a little over three hours.
Thanks for the details.
+Kelly Sumrall You are welcome!
Congratulations Andreas, that is superb. Almost too easy if one's goal is to learn but like a bait for a $10 Pi Zero W fishing hook. Thanks again!
+Garry Keogh I still have a lot to learn. And I prefer to start with something working. Especially as a beginner. ;-)
I think you are misunderstanding me Andreas! I mean you make it too easy for us mere mortals if OUR goal is to learn, the whole script + config ready to run! It makes a very convincing argument for a total newbie to "dip a toe in the water" with a Pi Zero W if it is put in front of them in such a complete package! Thanks again. Garry
No, no. Please be aware, that, at the beginning of this year, I did not know anything about MQTT, Linux, LoRa, and Raspberry Pi. So, I also had to learn a lot. But it is always frustrating, if I start something, and get error messages during installation or setup, because then, I have no idea where the problem could be. That is why I love scripts and other helpers. With them, I get at least a chance to succeed.... I can add complications later, when I understand a little more.
Haha! We have a similar starting point but you clearly have more talent than me!!! :)
@Andreas Spiess: I had a little trouble running your SD card image, more specifically testing the mosquitto broker.
I found that the broker would refuse connection without authentication and I had no idea of passwords set. I found I could change the configuration slightly to allow anonymous connection which inside my firewall for test is OK.
I navigated to the configuration file and used the nano editor to open the file for edit as below
root@DietPi:~# nano /etc/mosquitto/conf.d/websockets.conf
I edited the line:
allow_anonymous false to read -> allow_anonymous true
Then saved the settings with Ctrl and O before I exited the file with Ctrl and X before a reboot to load the new settings.
Everything works superbly, thanks again
Great.... just doing some idle Sunday morning cruising the TH-cam channels and when I see one of your videos. I will take some time to view it because your content is great. Now I'm fully down the rabbit hole fully learning about MQTT and NodeRed. Thank you for introducing some "to me" new technology. GeekMustHave
You are welcome. Enjoy!
Andreas this was an excellent tutorial. I got it working on a Pi3 but it took quite a bit more than the 30 minutes. Perhaps a few days of tweaking the sql code. I particularly like the date note for node red so it displays the last update. I will use that on everything from now on. thankyou.
Maybe you watch also my newest videos on the topic?
Andreas I'm stuck. I've got so far thanks to you and Peter Scargill. 3 weeks ago I didn't know anything about this stuff. I've now got everything working and ready to flash a Sonoff device. I'm going to use Tasmoda. This is probably a really simple question but my inexperience is showing. Tasmoda has many language options and I need to choose English. The Tasmoda config asks this question "Uncomment one of the lines below to build/upload only one environment" I don't know what to do. This isn't an intuitive question for a novice. Sorry for my ignorance. Kind regards Douglas
Uncomment usually means to delete the slashes at the beginning of a line. Two slashes // mean, that the rest is considered comment.
Big thumbs up !
used your image, ok on pi-zero with usb-wifi and usb-ethernet, same config also worked on rpi3 with onboard networkdevices,
only 1 problem in piZero/pi3 : need to restart mosquitto first, nice surprise to find webmin on port 10000.
Installed mqtt.fx 1.3.1 on windows 10, good for load testing to send many messages very fast (see script option).
Using putty to see htop on rpi + another session to see network load using iftop.
Thanks for your tips! Yea, Peter added a lot of stuff...
Very nice LE SUISSE !!! very interesting and sharp in the description, swiss style!!!!
Thank you!
I just finished to install OpenHab on a new PI 3 with OpenHabian script.
I think I will add Node Red too, looks nice!
Please continue with this kind of videos, they are great!
Thanks for your feedback!
The image is really great work and it's an even greater idea to distribute it freely... Thanks!!!
You are welcome!
Really enjoyed this video Andreas. I'm new to this subject and struggling to get my head round the logic. Thanks for an informative video
You are welcome!
Great video, as usual... Congrats! You always anticipate the work we must done giving ready-to-use lot of experienced hours in few minutes. I red few comments: in my opinion 10 minutes of video are the best way to stay concentrated and to capture almost all we need. Bye
Thank you for your nice words! It is, as you say: It costed me quite some time to get there and I thought, I can make it a bit easier for you...
Hi Andreas, I love your videos and they have been a great source of inspiration for many of my projects!!! Thanks so much for sharing your image file for this. It has come in very handy!!! Keep up the great work!
Thank you for your feedback and your nice words!
Great work Andreas, looking forward to see more from you.
Thanks!
I personally wouldn't send the 'timeStamp' column in the SQL INSERT. I prefer to config the column as 'CURRENT_TIMESTAMP' in the PhpAdmin, and it will write the timestamp by itself.
I prefer doing this because it's easier, and pretty useful for iot applications where using less code can also be trivial.
I have to say that I really like your content and this video made me learn more things :). Life's about learning.
Thank you for your tip!
Absolut tolle Videos, die mich dazu inspiriert haben, mein Appartement als Probelauf für das künftige Haus zu automatisieren. Danke dafür und bitte genauso weitermachen:)
Das ist ja wunderbar. Dann weisst du auf was du beim Hausbau achten musst. Die meisten älteren Häuser sind ja nicht gut für die automatisierung eingerichtet...
Thanks, Mr. Spiess. You earned another subscriber.
(August 2020) I tried your image onmy Raspberry 3 B, but it didn't boot. Tried several SD cards, but no success.
Then I went directly to the DietPi download page and tried their images there (both the 32 bit and the experimental 64 one) but those didn't work either. Maybe I'm missing something?
Luckily I could run Pete Scargill's script on a Raspbian image.
Welcome aboard the channel!
This is an old video and I only use Raspbian OS now. You find more up-to-date videos on this channel.
Nice video I will try DietPi for sure. One note you can enter the wifi password without a monitor. Solder headers to the Pi Zero and connect a FTDI adapter.
Thanks for the tip. I did not know that (I am new to Raspberry and Linux)
Very nice Mr Spiess! Looking forward to the next one (as always...)
Thanks for your feedback!
Thank you for the image file. It really saves me a lot of time.
:-)
Thanks Andreas for bringing Peter's script to my attention. I just wanted to give my feedback on the sd image, I was able to get it up and running and resized successfully but for some reason apache (though it is running) simply serves up a blank webpage. I investigated /var/www/html and found an empty index.html file and a folder for phpliteadmin (going to the IP/phpliteadmin successfully loaded the phpadmin but Peter's launcher page is not there. I'm on the new pi zero W and I'll probably do the whole thing from scratch in a little bit but I wanted to see if anyone else experienced this.
run script and check only that part about page+css... this is NOT always valid, some options can't be just "rerun", but this is safe...
How did you res-size your file system? One other viewer had this problem, too
First I tried the normal fdisk method unsuccessfully but gparted works (had to use another system + a card reader)
+Lou Cal It worked now for me, too. Just one question: how did you find the max cylinders,heads,and sectors of the SD card?
I actually didn't do any of that manually the GUI handled it. After you click move/resize in gparted you can hover over the left and right arrows on either side of the colored bar and you get a 'grab' cursor so I dragged the one on the right all the way to the end on the right and that filled the card for me.
Great video, thanks for providing the image... however running out of storage space... 1.8GB fixed space.... 6.2GB used on my SDCard. Getting out of storage space errors.
I used a small image because I wanted, that people can use their old SD cards. I am not a Linux guy, but maybe you can expand your file system somehow (I did this on the Raspberrry with Raspian)
Okay, have to figure out how to do this... no space available so I can not install additional tools. For me not so good choice this Dietpi ;-)
Why?
If you like to expand the partition just follow this guide
geekpeek.net/resize-filesystem-fdisk-resize2fs/
Andreas Spiess because the drive is already 99% is filled... I will try to resize it, so far without success. I will try again with the suggested url.
at time sync 3:41 you show a wifi doggle. I thought Wifi was built in? The reason for the question is I am getting eth0 not found both with the doggle and without. Trying to figure out how to connect the keyboard,mouse and wifi.
I use a Logitech Keyboard mouse set with this unifying dongle. It came with the set.
Andreas, how do I become a paid subscriber?
You have given so much, it is time to support you for your tireless efforts.
I really don't know how you achieve so much and deliver it so eloquently and clearly..
Without you, I am lost.
Many thanks to you and Peter Scargill, what a wonderful collaboration.
👍😀
There is no need for more support. I get a few dollars from TH-cam and I can buy some stuff for free from Banggood (because of my sponsored link). The rest is hobby. And my time is more than rewarded with the feedback I get from my viewers like you!
Bless You
exactly what I needed! already ordered my pi 0 w
+Simon Filiatrault :-)
Great work !!
This is very helpful. I really appreciate your work here !!
Thanks!
I had a couple of thoughts since you're using DietPi (my personal favourite). You can enter a hostname in dietpi-config and then you don't need to worry about the IP address so much. Also, Dietpi supports external USB memory/drives so you can configure a USB drive for all your user data. Its faster and less risky than writing to your SD card :)
I read that Peter wanted to include the hostname feature in his script. Maybe it is already done... I will have a look at it.
Concerning SD card: I have an old HD on my main Raspby. But here, I carry the risk of losing everything. I do a backup from time to time.
For those who are interested in using Peter Scargill's script in 2020, please be aware that he no longer supports its use on both the Raspberry Pi Zero AND using DietPi. Checkout his site for more info before descending down that rabbit hole.
tech.scargill.net/the-script/
Andreas - thanks for another great video. I watched last night and thought “interesting but what could I possibly need this for?This morning I woke up & realized this is the MISSING LINK to datlogging the esp8266 and esp32 based automotive test equipment I built for my shop. Now my fuel injector tester and my air flow bench will be able to automatically log the test points as mqtt messages!
And if you look at the newest script of Peter you see that he included Graphana for Graphic representation
The node libraries which Peter Scargill installed with his script made me curious, so I run it on a Rpi 1B last night. The script ran insanly slow on that hardware, but surprisingly the Node-RED server is running better than I expected. It takes of course longer than on RPi 3 to initialize the web frontend, but once it is down, the performance is enough to create flows and deploy them. I did not figure out why, but with the testinstallation done via Peter Scargill's script I was unable to add further node libraries. I think something went wrong with the npm setup.
Usually, somebody answers your questions if you ask on Peter's blog.
Good to know, thank you. At the moment I'm thinking that the DietPi installer in the current version already brings everything with it what I need for my project. I just installed Peter's script to check it out. If I decide to keep on testing with that RPi 1 image, I will start debugging the npm installation, maybe it's an access rights or version conflict.
Hi Andreas
Another great video and also many thanks to Mr. Scargill !
I did everything per instruction but can't install anything as I realized there is no disk space. So I followed the instructions for expanding the SD partition but with no luck. I downloaded the newly instruction from your GDrive but they don't work for me for the following reasons:
1) using the easy instructions, I can't do this as I am unable to add login into any desktop as I can't install anything due to limited disk space
2) using the "hard method", I can't sudo umount as I get an error "target is busy" error
any help is greatly appreciated...
Many thanks in advance,
MG
1. The simple possibility works on a Raspberry 2 or 3, not on the Zero. So, no need to install anything.
2. With both methods, you have to have an SD card reader and put your DietPi/broker SD card there (as a second and unmounted device)
Great work as always! Thank you so much for sharing it with us.
+Ciprian Bindiu You are welcome!
Andreas, once again fantastic work and thanks for sharing...
You are welcome!
Hello Andreas, Do you have a video that is more current for setting up an MQTT broker? This is all new to me and I really enjoy your videos. I searched but couldn't find anything on your channel. Thank you.
Maybe you google for "IOTstack".
Hi, thank you for this great video. It is still relevant in 2020 ? Can i run it trough putty only ? Don't want to connect to a display.
Thank you very much for the answer.
There are a few newer videos on this channel. Maybe you watch them (Raspberry playlist)
Andreas Spiess i’m following your channel for like 6-7 months but this is the only video about the smart home (mqtt) . I’ve missed something ? Thank you
I had a few videos about Node-red, influxdb, and Grafana (and others like rtl_433 and docker)
I use Raspbian Lite in a similar matter and I found out that the HDMI output is switched on, even if there is no screen attached. Switching this off saves power and reduces the CPU temp, I read somewhere that it can reduce 20% power.
To switch off the HDMI output type "/usr/bin/tvservice -o" and add this line to "/etc/rc.local" at the end, before "exit 0".
I don't now how this is set up in DietPi.
Thanks for the tip!
I found out that switching the HDMI port off reduces my CPU temperature (at room temperature) from about 31.5 to 29.5 deg C. I don't know ho to relate this to power use, but it must be a relevant amount.
Thanks Andreas , I think SD card image needs to be updates , dietpi update services says "Your version of DietPi is now obsolete and cannot be updated ".
This is well possible. I cannot maintain all images for all my videos. But with Peter's script, you should be able to create your own image based on the newest dietpi.
great video and informative for a newbie - but the address of the image file seems to be broken - help!
This is an old video. Maybe you watch my videos about IOTstack?
Hi Andreas, thanks for sharing your excellent work , I am not able to follow your video for running Peter script after flashing dietpi image into SD card and enabling WiFi
Could you please help me to run the Peter script to install all the required installations , thanks in advance for your support
Maybe you go to Peter's blog for help. There you usually get help from the guys who know more than me. But you have to describe exactly what you did and which error you got.
@@AndreasSpiessHi Andreas, thanks for the reply , I will write on the Peter's blog then
Great time saver, thanks Andreas.
Pi Zero on order
+Christopher Taylor :-)
superb timing. And really a good idea. TU
just downloaded ... and I'll try to install it an a RasPi3
thanks again for your great work
+Urs Marti Please report back, how it went.
Urs Marti I'm also very interesting about the raspi 3 Installation! And: How much time does it take to run?
sorry - it did not work by plugging your image into a RasPi3
doesn't it see with ip-scan attached via ethernet :(
then I tried to modify config & cmd to access to it with USB/Ethernet. also no success.
now I take the time and install it from scratch for the RasPi3
This is not a surprise, because the dietpi does many adjustments during the first install (maybe also to the environment it runs on?). So, the way would be, to install your OS of choice and apply the script. It should run much faster on the -3 than on the zero.
the image Andreas published is meant to be used on RPi0, RPi0W and maybe on RPi1B, nothing else...
these boards use armv6 arch, while quite all the others use armv7 and usign Peter's script is best, because there are other optimizations in those cases... and you get php7, too, which is less memory hungry than the 5 which is in this version... running the script is a matter of minutes, than go away, return after about an hour and you're done... we spent very long time optimizing everything on every board... i'm the MrShark you'll find on his blog...
Loaded your image fine. Great work. I am stuck getting into Node Red Control Panel from PETE'S UTILITIES. I have run out of ideas for the Username/Password.
it should be "admin/admin and the dashboard user/user
Thanks
How did I miss that!! Had got past the dashboard.
:-)
Thanks for your service to the hobbyist community. I have an issue with your image file installation i.e., when I add these lines,
editorTheme: {
projects: {
enabled: true
}
}
in settings.js file I can add Projects option in the Menu of regular Node-red.
But it is not working in Node-red of your image file installation. Please advice me, how do I get the "Project option" in Node-red Menu if I use your image file. Thank you again.
I have no idea. So I cannot help :-(
Hi Andreas
I enjoy your videos.
I have tried using your recipe to install 'The Script' on my rPi3.
Worked fine with Raspbian.
Then I liked to try it on DietPi.
In the video at 1:55 you show how to add the user pi.
For me it would have been a great help if it was clear which lines belonged together.(blank lines to separate)
On the 3. try I managed to do it:)
Now I cant figure out what password to use, when I try to login as pi.
Please help a newbie.
I dont know if you have tried this :)
After struggling many hours and finally you have to ask for help,
then suddenly you figure it out,
sudo passwd pi.
yes. I had issues too. especially a wrong line speration and made an imcomplete user pi and had to remove entire group and the user account. after then Scagil's script did not recognised pi as user. some bugs. then had to modify his script to make it work. took more than 1 hour to get it right.
It was a difference between the rasbian and ubuntu. The script did not consider that. and my raspi 3 kept stuck in the loophole. Eventually I separate the scripts into functional chunks and ran all to the end, heavy modification to the original, bur learnt so much about bash script language. It was a steep learning curve but so much rewards now.
Really good Video, liked Diet-Pi as a minimal OS and have used Mosquitto as the broker with an ESP8266. So success. Have run into a problem which others may come across. Have used the Wireless of the Pi Zero and it has a DHCP assigned ip address. Would like to change this to a static ip address to stop the ip address from changing (occasionally via the dhcp). So far have not managed to get the Diet Pi OS to assign a static ip address to the Wlan interface. Starting to think its a bug in the Diet Pi OS.
I usually assign fix addresses by dhcp and the router. So, I do not know
Hi Andreas, my router is a bit on the old side so it does not have a dhcp reservation facility. I may have to think about a router upgrade!
After some investigation it appears that my problem was being caused by the dietpi-config program. Changing the Network adapter settings for wlan0 from dhcp to static did not save any of the static address details to the /etc/network/interfaces file. Adding them in manually to the file resolved the problem and the wlan0 adapter now has a static address as required. After a reboot of my router and a reboot of the piZero, the piZero now works with the static address. So, it looks like a bug in the dietpi-config program is the fault here.
Thanks for your feedback. Maybe it helps somebody else
Great eye-opener Andreas, thank you. To put this into context for myself, what you are saying is that you could set up your IoT home with as many wifi enabled devices as you like, and, as long as they can talk MQTT, for $20 and the price of a wifi adapter you can have this device log every possible event. It is stand-alone. It does not have any effect on how any given device behaves or reacts with its immediate controller, eg smartphone.
Have I properly understood the context? is there another benefit? Cheers.
What more benefits you expect for 20$? ;-)
Just wanted to check that I had understood the reason for the setup. Thanks for the reply, keep up the videos, well made, very clear, very easy to understand.
:-) And sorry, I answered only one part of your question.
Great video thanks a lot, really looking forward for some ESP32 videos
You are welcome. The ESP videos will come...
A bit late for the party, but:
Thanks for the excellent tutorial.
I've got it set up and appears to be working OK, but how do I use it to do something useful eg:
I've got a light that I've 'tasmotised' and can control using the Node Red in Home Assistant. How do I (say) turn it on using this set up? I've tried injecting 'on' with the topic of the bulb (Lohas_Bulb2) and subscribed to the same topic, but nothing happens. Maybe it's a lot more involved than this!
I'd be grateful for some help, please.
Jim
You have to use the right topic as well as the right command. Otherwise you will not see any reaction. I did other videos about Node-Red and similar stuff.
Thanks for providing the package on github. Will try out when I get my Pi Zero.
:-)
Hi Andreas Spiess !
first I thank you for your great job
why you can't make a video about mqtt and lorawan (iot) ?
+MESBAH Youssef I think, I covered the connection to Lorawan in one of my videos (to node-red). It is very easy.
Hi - thank you very much for the image! I cannot seem to get the Zero W to connect to my WiFi though - I edited the dietpi config file after writing and before booting for the first time, but regardless of what I make the static IP, after boot, it always just says the ip is 192.168.0.202 - using AngryIP Scanner I cannot see the zero on my network at all.
This is an old video and I do not use dietPi anymore :-(
Thank you for taking the time to reply. I managed to get it sorted- had to get an otg usb so I could connect a keyboard.
Awesome video! Thanks for sharing
Hi Andreas, can you please tell me where I can find the image for this, sorry but I have only statred using node red in the last two days, have already spent many hours on the journey, thanks for your fantastic video classes !
Maybe you watch the newer videos about the topic. There you should find better images.
@@AndreasSpiess wow I that was a quick reply, I'll see if l can find the videos, thanks
Hello Andreas, Thanks for sharing this very interesting project and providing the pre-installed image. It's really amazing!
I tried to upgrade the node red software and also some nodes (e.g. openweathermap) - but struggled. Any chance that you can provide an image of this project with the latest software versions (also dietpi os)?
I cannot support all my videos. But using Peter Scargill's script you can build your own. It just takes time.
Very nice! I have been logging my solar data to Adafruit.io and now easily I can set up my own broker.
Great, Great Work! I am a fan of your videos, great source of knowledge and inspiration.
Can one find the MQTT Test Flow and MQTT Logger Flow in the SD or do you have to build them?
Thank you
It should be on the SD card. Maybe you have a look at one of my last videos where I have an updated SD card (But not for the zero).
Hi Andreas and everybody. First of all thank you very much for this contribution. Has anybody achieved to establish a SSH conection to his Raspberry Pi Zero Wifi, using Andreas' Pi Zero Image File?? My Raspberry isn't even connecting to my Wifi, I changed my Wifi credentials in the dietpi.txt file and I cannot find it using an IP Scanner. Maybe I have to wait more than 5min for the first boot? What do you recomend me to do?
Thank you very much Andreas and with best greetings
I no more use DietPi, only Raspberry OS :-(
@@AndreasSpiess no problem, I also switched to RPI OS and have now an image of my RPI zero Wifi with Mosquito Node-Red, Dashboard and Autostart. If you need it, I can share it with you. Mit besten Grüßen :)
Andreas Spiess, very god work!!! I have a question, How can i remove de login when I try to access the Node-Red/Dashboard/ui? I would like to work the /ui without the login and password "user" "user".
I do not know. Maybe you have to google...
Hey man, I had same problem, my solution was to delete the file in /.node_red folder realize the period in /.node_red find file settings.js and type in this command rm settings.js " this deletes the passwords after you reboot the pi" worked for me ok.
It would be a good practice to add SHA1SUM of the image (or any other binary files) next to their download link.
I am not too good in these matters...
I've used etcher program to download the Raspberry pi to a SD card. It takes the zip file and unpacks it without having to use any Linux commands. It seems
quicker.
That is the normal way AFAIK.
Hi Andreas,i' using your image. Thank you for sharing and saving us all a lot of time.Unfortunatly i have a issue with Mosquitto. I use a Raspberry Pi ZeroW. It works fine with LAN Adapter. When i switch to WLAN it doesnt work anymore. mosquitto -v shows the following1498105665: mosquitto version 1.4.11 (build date Mon, 20 Feb 2017 22:47:27 +0000) starting
1498105665: Using default config.
1498105665: Opening ipv4 listen socket on port 1883.
1498105665: Error: Address already in useEven a reboot brings here no solution.Do you have a idea what is nessessary to bring it running on WLAN?ThanksThomas
I am not at all a Linux guy. So, I cannot help you.
Hi Ken, I have the same issue."Address already in use" and no idea about Linus. if you find a fix, please share it . I'll do the same.
@Andreas, excellent videos! thanks a lot for them!
I talked to the developer of the script on his page. they recommend a fresh install of dietpi and run the script. Andreas version is not as much up to date as it should be. I'll try it but I stuck on different points because I have no knowledge about Linux. But I'll master it. :)
Thanks for your answer! I will keep looking a fix :)
After a new clean install it works fine. duration approximately 5 hours. I would share my image but it is 16 GB
hi andreas, this looks excellent. im new to linus and the rasp pi. im still waiting for my pi3b to arrive. i was initially planing to use hass.io, but node.red looks a lot easier to use. i want to integrate my home automations with all my xiaomi smart home sensors. what do you think would be the best way to integrate the xiaomi gateway with node red? i could still use home assistant than use mqtt to communicate with node red, but im wondering if there is a better way? ive also got some esp8266 devices coming for some other projects (garage automation and indoor plant watering).
please can anyone suggest best way to integrate xiaomi mi home sensors?
I never worked with Xiaomi sensors (except the MiFlora)
I wonder how long can the SD card hold under a 247 operation. They are known to fail thought time. This could be an opportunity to make a tutorial of how to save / extend the lifetime of the SD card, probably getting the ok to boot into read-only mode.
There were some discussions about that in my video about SD cards
Been through a bunch of videos. This is the one I want to work more than the others... Has what I need.
Thank you. This, being my first attempt using Node Red (New User), I feel I've done well just getting to this point... I'm stuck. The dashboard is requiring Authentication. Is there a fix?
user/user ?
I was close to moving on. Didn't expect an easy answer to this issue. You saved the day.. er week or month. Thank you.
Hi Andreas - the link to your image does not work for me. I would love to try it out as I am just starting to learn MQTT
This is a very old video. So nothing to build today. There are newer videos even on this channel. Search for "IOTstack"
Thank you for this nice image file. It seems to work. Yet there are two obstacles which prevent me from experimenting: (1) Node-RED shows "failed to open /home/pi/sqlite/nodered" and indeed I do not find such a folder. (2) I cannot find any link to the „MQTT test flow“ mentioned in the video at 5:25 which I could import into the clipboard nor do I find the „data logger“. Any suggestions?
I do not remember the details but thought, maybe the flows were on my image. But I am not sure. If not, you can build them yourself with a few clicks as most of the info should be provided in the video.
Concerning your error message, I cannot help you, because I am no expert in Linux.
Thanks for your quick answer. Node RED works now, the solution was given by the password issue pinned above (I was not aware that my problem relied on that). Yes, now I can build the flows myself.
Your image is one year old. There are newer builds of dietpi. But which one is suited for the pi zero w? Does anybody offer a newer image?
Maybe you build your own image using the newest distribution and Peter's script.
Thanks for the advice. I did so, but it was more difficult than expected, with some frustrating experiences, because there are incompatibilities of debian stretch and the mosquitto package on the Pi Zero. The GOOD news: The clever guys of dietpi managed somehow to overcome this and in the newest version 6.2 of dietpi (appeared only 3 days ago) you can install mosquitto, and IT WORKS in node-red in the browser. BUT it is still impossible to install mosquitto-clients in order to subscribe and publish on the command line.
Thanks for the feedback.
Hi andreas...I'm a big fan of your work....does you SD card image for the raspberry pi zero works for the raspberry pi 1 ( I've read that is basically the same processor but I don't Kwon if the SD card image is compatible)...
I do not know. But I think, you cannot destroy a lot if you try...
Just got the info, that they adapted the script that it runs also no RPI1. So, if not the image, at least the script.
Thank you Andreas for this video and your work! Do you or anybody has a good and safe design for node-red connection to SONOFF? I mean cover to every failure if I have a simple switch on the UI? I have an idea, but I can imagine that I am not consider every of the faulty situations (Broker, SONOFF died, initialization issues, other switch/input change the state). I would like to ask you to make a video to cover every of these problems. Thank you in advance!
It is possible to reprogram the firmware on your sonoff in the Arduino IDE do just as you wish; MQTT libraries work very well on the ESP8266 chip. There is a lot of information available on Peter Scargill's blog and Andreas's videos. If you have the way to solder a header and reprogram your Sonoff then you can easily interface using MQTT via Node-RED just as demonstrated here. I am sure I have seen some mention of IFTTT and Sonoff together but have not seen any example. If there was API access to our Sonoff devices while they ran stock firmware and used the Sonoff servers you could do this also with Node-RED I guess. It may happen?
I already know how to reprogram a SONOFF. The question how it can be use a Safety way of design in the NODE-RED side and the SONOFF side if something happens. This is my question basically. The normal flow can be seen many video streams, like Andreas videos as well. I am very grateful these kind of videos. I would like to see the "what if" videos like : MQTT Broker down how to handle this in the SONOFF and the NODE-RED side for example. Thank you as well for your response!
There are many strategies you could try. To start there are QOS levels available when you connect or publish which can ensure that messages queue until they are delivered, this is safe, maybe? The LWT allows a message to auto generate if a device goes off-line without grace (any kind of failure). The will message can flag a hardware issue if this is what you need? If you need to know the status of your connection; up/down while the system is idle, in between infrequent but critical messages you could have a ping/ack run in the background though this will perhaps just flag the death a little earlier than LWT though I haven't tested this.
Depending on what nodes you use in Node-RED, some like the "BigTimer" have a function to refresh the current output status to the device every minute in case it has re-connected but again it would not be difficult to poll Node-RED for a status on reconnect? So many ways and powerful, flexible tools to work with... HTH, Garry
Re: Video #126
Years ago I'd dl's and used the sdcard image you'd made from peter scargills christmas
script. Thank you. I used the web interface with node-red and mosquitto to monitor and
control a basement sump system. Hardware was a pi zero w and an ESP8266 with several
sensors.
Now, while starting with the same sdcard image for a different but similar project, I
find the Diet-Pi version used is too old to upgrade and there were a few nodes I
needed that wouldn't install without the upgrades.
My Node-Red interface used live gauges, historical graphs, buttons and switches... All
viewed on my browser. While looking at the script contents I'm guessing I don't need
all of the many included programs. To save space, given the limited info I've
provided, can you suggest which packages I will likely need for this project?
The project is to monitor and display live and historical data of current flow through
individual breakers in my house. My recent electric bills have gotten my attention.
This seems to be a good place to start. Thank you for all you do.
redisette
Maybe you watch my videos about IOTstack?
What about corruption of SD card because of writes to the database? Would be nice if you could make a video on how to temporarly save values into RAM for a few hours, and then flush them into the database, so it would write only twice or 3 times a day to the sd card.
I am not a Linux specialist. So, I do not know how to do that.
I too have no idea how to use the Pi's flash memory but it is also relatively easy to mount a storage device to USB and create your database on this storage or to mount a network storage to your Pi.
For example; on my existing Pi board which is permanently installed inside my home security alarm system I have gradually come to depend on many Node-RED flows and many MQTT subscriptions to the broker all hosted on this very old Raspberry Pi with the weak link probably being the SD card in this Raspberry Pi. For this reason I have the following in place:
1. I have my 2TB NAS drive mounted on my Pi from reboot
(I use cron to run a bash script on boot which will "sudo mount -a" mount all drives listed in the file system table "fstab")
2. I use my NAS drive as storage for any data, logs etc to reduce write cycles to the SD card and provide data contingency/redundancy.
3. I also use "cron" to run an other bash script which creates a compressed backup of my SD image once per week at 2:30am on Tuesdays so I can easily flash a new card if I have a SD failure
I am more than happy to document this if Andreas or one of your subscribers would like to create a tutorial, just ask?
Garry
msevyt I think that each bit on the SD card has 10,000 writes and I'm pretty sure it balances out the writes to the different bits. But if you wanted to achieve something like this it would definitely take some coding or googling to find the solution.
I am half swiss and I can confirm this man's accent is aggressively Swiss.
:-)
Great video. Do you think this Pi needs a heatsink for this application when it is in a case?
I do not have a heatsink on my Pi zero and it does not get hot
Great help as usual. Except I do not find your GitHub image for the SD card. Do you have a link please.
I had problems to upload it to github. So, I had to change to google drive. It should be there now.
Just be careful with sqlite. Only one process should be writing to it at a time or you can get corruption. In this situation I doubt it will happen but it's just something to look out for. If you have the option you might switch over to MySQL as it's faster and doesn't have the issue of only being available to one process at a time. Thanks for doing what you do and keep up the great work!
I used mySQL on bigger machines, but thought, this is sufficient because the Zero is really slow... Thanks for the hint about concurrency. I did not know this limitation.
Ill have to get me a Raspberry pi zero as you make it so easy by providing the SD card image. While i wait for the zero to ship ill mess about with with Scargils script on my orange pi.. thanks
My Orange zero is also in the mail...
Hi, Is anyone else having problems installing new nodes into node-red with either package manager or from the palette? I'm sure this was working on a previous version of the disc image a few weeks ago. Have flashed a newer image that is now hosted on Sensors.iot and I cant add any new nodes???
Having the same issue here - It seems like Node-Red cannot access the internet.
I tried to setup a Ping in Note-Red for "registry.npmjs.org" and "google.com" without luck.
Then I tried from the Webmin and Putty directly from Dietpi, and still no luck...
Somehow the Dietpi seems to be disconnected from the internet which is strange - I'll see if I can work more on it, but would also like to hear if others are having the same issue.
Hello, and sorry if this has been addressed in comments, but I cannot access the node-red dashboard in your sd card image, I've tried all of the 3 sets of credentials given but none allow access... I also can't seem to see where to flush the dashboard settings. This is my very first foray into node red so I am a total beginner.
usially you can use user/user
Can i use mosquitto other then local networks mean from anywhere i can configure with mosquitto broker...
You have to have a VPN connection to your network
Hi Andreas, i used your dietpi image.. thanks a lot.. however, i got a small question.. what is the default username/passw for the node-red dashboard? (or probably guide me if there is a link where to get this info?) i figure out already what are the default username/pass for others (dietpi, node-red, sqllite, webmin),, its just the node-red dashboard which i cannot find..
thanks again for a very wonderful video.
nvm.. found it.. its user/user
:-)
Hello Andreas, greetings from the guy with the English accent :-)
First may I thanks you for ALL of your videos.
I have tried to use your DietPI on my Raspberry Pi zero W. I downloaded your image zip file, extracted it and then wrote it to my 8GB SD card and then entered my WiFi details into the correct txt file. All went well. However when I power the PiZero and it boots to the image the IP address does not change to the fixed IP address I entered and the last line I get on the screen are;
--------------------------------------------------------
DietPi I 22:10 I Thu 06/04/17
--------------------------------------------------------
V147 I RPi Zero W (arm61)
--------------------------------------------------------
IP Address I 192.168.0.202
--------------------------------------------------------
Default Login:
Username: = root
Password = dietpi
Then just a pulsing -
There is no interaction to the key board and I have left it in this state for many hours but still no improvement.
Any suggestion as to how to fix this would be gratefully accepted.
Best regards
Peter
Unfortunately I cannot do remote debugging. I do not use dietpi anymore, only raspbian because I do not know enough if i run into problems...