This inconsistency and delays you are showing is not a problem of ESP32, it's a problem of Arduino porting for ESP32. Just use ESP-IDF directly and redo the experiments - results will be completely different ;)
How lucky we all are that these super well-produced, interesting and informative videos are available to view at our leisure. What a world we all live in! Thank You Andress!
Truly. I am able to pursue a life passion project through stitching together knowledge from a collection of great youtubers, with Andreas a shining example. You make the world a better place :)
Brilliant video. Exactly what I wanted. And excellent overview for the beginner or even the experienced. I worked on embedded systems 15 years ago - we used microcontrollers, GPS, cellular comms, and used this to create telematics devices installed on John Deere and Liebherr equipment (and others). We read the CAN bus, and used interrupts for things like movement, engines turning on and other interrupts. Since then I've been doing product management, and now I'm getting back into this level of coding... and was depressed that Arduinos don't have good interrupts and sleep. Your video has brought me back up to speed SUPER quickly, helping me restore my memory from tape, and quickly jumpstarting me with a new microcontroller board.
Thanks Andreas, you ever find the way to make it clear and easy to understand. The two channel osciloscope trick is really interesting, but this is part of your very high end workshop...
This is the second video I've watched by Andreas, and I subscribed after watching the first few minutes of this. With so much bad information out there, this channel is a breath of fresh air. So much to unpack in this video. I'll be watching it again and again, thank you Andreas.
Thank you ! Perfect timing ! We were just running into random crashes yesterday with our encoders running off ESP 8266. Cleaning up the interrupt functions based on your advises solved our issue ! For the little story, We are building a 4DOF motion platform using salvaged standing desk electric pistons and ESPs. Such a great content every time ! Thanks again !
As always a pleasure to watch. I like that you are not only focusing on hardware, but also explains how to utilize software to make project simple and easy to make
It would be interesting to see a video on using the ULP core for running code without waking up the ESP32. Would be nice to explore the possibilities and limitations of the ULP core.
Great Topic, The ESP32 has so many new features, performance advantages and value over the Arduino. For the hobbyist, one platform can serve many projects . Your post make the transition worth attempting. Keep them coming!
Mr Spiess, I enjoy your presentations and like this one too. Thank you for all your effort and shared knowledge. There are several reasons why CPU like this one may have long interrupt latency. One of them (and it is a Real Time limitations of large processors like multicore Intel and ARM) is cache coherency. Simple, interrupt code maybe not present in cache and other current content of the cache need to be saved before reloading new one to/from RAM. For vary fast approach, user need to instruct compiler (I dont know how to do it at ESP32 yet) to keep interrupt service routine (if short) permanently in cache. This is typical approach for RT Linux for example.
A great part of the inaccuracy in the interrupt code (at 7:13 in video) is caused by your own loop code: { frequency = count; display(0, "frequency=", frequency); lastEntry=millis(); count=0 } You use count but reset it only after displaying on the pretty slow LCD. That means, all events that occur during the LCD operation are not counted, but lost. Also, if the duration of LCD output varies, it worsens the count precision. You could improve it if you first completed the job of count handling: { frequency = count; count=0; display(0, "frequency=", frequency); lastEntry=millis(); } BTW, your polling loop (at 3:54 in video) would be more elegant if you replaced lastentry= millis(); while (millis() < lastEntry + 1000) {...} with endTime=millis()+1000; while (millis() < endTime) {...} This way the addition would be done only once. However a good compiler might catch this and produce the same binary code.
The compiler will figure out the optimization you mentioned at the end automatically. There will be no difference in performance. However, your hint about doing count=0; just after reading frequency is a valid one. In fact if you have mutexes used, you can wrap read and reset of the count, into critical block and be even safer. There are other approaches (like not resetting count at all, and remembering the last count, and subtracting it from current count to get new frequency (might require a special handling of overflows tho; but it will not need mutexes).
it is perfectly fine how he did it. even if the displaying took multiple seconds it wouldnt change anything since the lastEntry variable is changed just before resetting the counter. so it doesnt matter how many counts there were while communicating with the lcd. correct me if i miss something though
Greetings from Turkey Andreas, I just wanted to thank you for all the great videos you have put out here on the channel. I can't imagine what I would do without you. Loved the cat btw :)
Thank you for another interesting and instructive video Andreas. >edit: went through the comments and found this was already reported, sorry I just wanted to add that RTOS seems indeed to be a culprit for the interrupt response latency and jitter. I think that attachInterrupt actually hooks up not to the interrupt controller but to an RTOS callback function. This function is entered the queue of RTOS tasks, and get executed after the completion of all the previous tasks only. Apparently it is possible to get a fast interrupt response when programming using noOS SDK from Espressif but I did not try this yet.
@@Quemedices684 ESP32 Arduino calls various functions that are built around Espresif's SDK that in turn uses RTOS for WiFi operations. If one does not need WiFi or software timers then no RTOS is involved indeed.
Great job of using the KISS principle, Keep It Simple S.... Silly. This is the most straight for explanation of ISRs, aka, AST as we know them on our beloved VAX-32s. Thanks for showing us all your amazing "scope" work! I'm REALLY enjoying your 2020 video's along with all the others, VERY HELPFUL!!!
Glad you like my stuff! I only sold VAX computers, I never programmed them :-( At least the biggest I sold was a VAX9000 for 10 million Swiss Francs. At that time maybe 25 million dollars...
Andreas, perhaps a followup comparing the interrupt coding and latency on other 'Arduinos' like STM32, SAMD21, ATMega, ATTiny, ESP8266, MK20DX (Teensy), SiFive E31 (HiFive1), etc.
@@ripper121 Ah yes, datasheets to find out about interrupts and how they affect everything... let me just quickly read for dozens of hours to compare a few µC... Just seeing that a ESP32 is pretty much useless if you go into deep sleep is enough information.
@@leocurious9919 Really, that's a very specialized problem and different for each individual case, as Andreas said. Think about changing just one clock cycle in your application code changing the complete timing that is at issue here. It is best to simulate this for each individual case, better to test it as an experimental setup. If something is important for a preliminary decision, it is the limiting/rating values and the clock behavior that can be found in the data sheet. So @Ripper121's remark is far more helpful than displaying one's own laziness. Stay healthy:)
Your videos are always excellent. By the way, If you want a low latency ISR on the ESP32, consider placing it in IRAM. (There is a flag you can put on the ISR definition to do this).
He already did that. I think the issue with ISR is due to arduino code, not ESP32. Also I don't think you really need the mutexes in ISR unless you manipulate more complex data structures from ISR. doing read-modify-write (like count++) from ISR, while rest of the code only do reads (so you might need to have two variables to track how much count you already processed, not reset it back to zero), is safe and doesn't require a mutex.
I agree with your idea of being the RTOS influencing the interrupt latency. The RTOS itself (which seems to mee FreeRTOS reading the definitions you wrote to allow ISRs to be safely called) has surely some routines to schedule our loop() function with its own tasks, which can be in turn the communications module handlers (Wifi and/or Bluetooth). Even though you disable them, they could be still working for some reason. In addition the scheduler itself can use an interrupt to switch internal tasks, and this can be another jitter cause.
Thanks a lot for your effort, your experiments, the video and the explanations. And we are now back to the same question we discussed when the ESP32 became availabe: How to use the different cores for different tasks in Arduino IDE , e.g. to decouple WiFi. Up to now I did not find a solution. This is why my counter at the water meter still uses 2 pcs ESP8266. One just for counting and tranferring data via HW-serial without any WiFi output and the second for analyzing the data and communication with my home automation system. Not very elegant, but runs very stable, uptime 657 days since the last blackout caused by road construction works.
Thank you for pointing me towards the Otii. Now have one and it is becoming an essential piece of kit. Especially now I’m investigating why my new custom board is using 1mA more than it should be
This video helped a lot! I wanted to monitor my PV panel energy harvesting using an ESP8266 and an arduino DUE (i know, not ebergy efficient but thats what I had lying around). Before th is video they were consuming 210mA and up to 250mA when publishing the measurements. Now i modified the sketch so that the DUE is always asleep (by pull down resistor on reset) and only wakes up for 3 sec (by the ESP) to measure and transmit the data to the ESP then go to sleep again. The ESP then (after connecting) publishes the data and goes to sleep for 20 sec or so. The result is that during sleep they both consume on 38mA and only 100mA when the ESP is awake. Only 3 seconds of 200mA now which easily runs this 24/7 on a single 18650 cell and for several days! Thanks for the insight!
@Andreas, I detach the interrupt at the beginning of the ISR on my Dimmer control, it's only 60Hz and an ESP8266 (today) but it did resolve the flickering I was facing at the edges turning on the off the light completely (and smoothly). Wifi has to be on and there is intense MQTT to keep dashboard as real time as possible, so if I miss a trigger at the edges I just complete the cycle one way or another. With this I could literally get the entire 1% to 99% (in a logarithm scale for real light scale) without bugs. Another great video from you. Cheers.
@@AndreasSpiess In god old NEBRASKA, we had a minimal closedown and even the mall open last Friday! I hope governments get smart and reopen everything ASAP! People will not go, if they are in the risk group, like me and my wife, since we don't want to get sick! People are much smarter than government thinks! I think we OVERDID this, but now is time to reopen everything and let business control everything they know how! I hope your finger gets well soon and you are also being able to do whatever you did before this crappy virus! Good luck and stay safe!
Andreas, nice video! Regarding start-up time: the ESP32 supports deep sleep wake stubs that are executed before any normal initialization. It can send the ESP back to sleep if for example the voltage of a connected battery is too low. I use this feature for undervoltage detection of a connected lipo battery (saving on an additional hardware component). Best
@@AndreasSpiess Sorry, missed that part! It is easy to implement in Arduino, as the default wake up stub function is weakly coupled and can be overwritten directly: RTC_DATA_ATTR int bootCount = 0; void RTC_IRAM_ATTR esp_wake_deep_sleep(void) { esp_default_wake_deep_sleep(); bootCount++; } This increments the counter before the bootloader starts. Greetings from Germany
Thank you Mr. Spiess for the interesting video. Having started programming Microcontrollers with Arduinos and ESPs, and now programming Controllers on a professional level, the DIY embedded system community is filled with lack of skills: poor code because no real programming knowledge, lack of understanding of what is actually going on under the hood, ... . For example, one thing i noticed in professionally, is that i had to always master the controllers' documentations, i had to work on. This lead to the fact that most issues that you mentioned in the video simply can't happen (like polling the digitalread and delaying). I therefore really appreciate deep videos like yours, that aren't simply about repeating examples found online, but analyse and go behind the curtains.
Always a pleasure to watch your videos. Thanks for this on. I ran into some trubble appling the irq approach to a 100Hz signal with not as perfect steep flanks as in your given example. The isr gets triggered multiple times during rising and falling flanks. The RISING statemend seems to have no effect in the allocation of the irq. The esp32 seems to have problems with shallow flanked and slow signals. In such cases additional HW and Code is needed...
It is always good to have a Schmitt trigger in front of the interrupt input. Maybe you can disable the interrupt for a few ms in the ISR as a work around.
I'm currently using the ESP32 for a fft application on net voltage and load current signals (2 analogue channels, 50Hz), where I trigger a timer interrupt up to 1024 times per period, so ~ 100k samples/s on RTOS using both cores. In my case I'm working with hardware interrupt each ~20ms which calculates a timer value for the real period time divided by 1024. This timer or counter calls another ISR every ~ 20µs. In my opinion the ESP32 is fast enough for similar applications. But I'm totally agree with your point of the delay of hardware interrupts. Thanks for your research!
This is why I still rely on 8 bit / 16 bit PIC MCUs, they do a very good job at handling interrupts and have a simple way to hook a internal timer to an input pin so you can count very fast signals. It makes easier to implement control loops like PIDs. Only if I need a web server or something to do with WiFi I go for the ESP32. The ESP32 is not a Jack of all Trades.
I think that right now the ESP32 is the most complete microcontroller when it comes to stay connected and also have massive processing power. But if you don't need connectivity there are better options out there than the ESP32. In the end we choose what we feel comfortable using...
@@AndreasSpiess yes i have read. Normaly if you learn interrupt programming, the first command in the ISR is that you mask the interrupts, that no other can block you. Only die NMI is allowed
GREAT VIDEO!!!! Yes, it´s a penny that ESP32 is not good for Real Time applications. I´ve noticed the high Jitter on interrupts (Varying from 2 to 45us). It would be good if someone finds how to program the interrupt with *high Priority* even on assembler.
@@AndreasSpiess The main core is running many background tasks, I believe the second core is completely idle, If RTOS is handling the interrupts (which it shouldn't) that's another story
@@AndreasSpiess I think the delay is due to other FreeRTOS tasks taking over. Running it on another code could help. You need to create a very high priority task on that core and disable the watchdog timer.
Ali Devrim OGUZ FreeRTOS seems to have a make menuconfig option to lock it to only the first core? would this assist after your interrupt suggestion? also interested in other versions. wroom, wrover, (solo can’t be real-time), S2. Would love to have time to test them. Probably goes for all of us. Also need to invest in oscilloscope / dsi.
@@jrgalyen yeah that'll probably work too, however it may not let you run your program on the other core. I haven't tried that. I only saw the menu option to "not run the freertos on a single core"
If your running an RTOS then there will always be issues with when you get to see the interrupt. so i can see why the latency is changing, it depends where you interrupt arrives in the the background processes. Not sure if the ESP32 RTOS has variable time slots or fixed time slots so there could be issues there. In the embedded world there is a lot of effort to get an RTOS working correctly. Spent many a happy week on embedded RTOS courses, just to decide that if you don't need all that an RTOS offers then it best not to use one. Also interrupts are a pain for proving the code is safe, as how do you check all the possible places in your main code where it can get interrupted, don't get issues when interrupted at the point. Nice thought provoking video as usual, thanks
You can process interrupts at higher priority (i.e. level 5, just before NMI level). By default ISR will be lowest priority (level 1), so it will be preempted and/or delayed by other routines like a task scheduler. It is possible to have stable latency and minimal jitter using FreeRTOS.
Nice. To be fair, the ESP32 is running a very high level OS, FreeRTOS with changes. It doesn't have to run FreeRTOS, but you'll experience a great deal of trouble using Arduino or PlatformIO if you eliminate the OS. (You'd have to write a new core library) Something that might make a difference is to set the affinity of the ISR to the second core, which is unused by any code unless you explicitly force tasks over to it. I've never tried it, but it should be produce measurable improvement.
You are right. I usually just take what I have and check it out. I would probably use a different processor for real-time applications before I would start to mess around with the underlying infrastructure ;-)
@@AndreasSpiess I believe you'll have much better results w/ interrupt driven ESP32 tasks, working from Espressif's development environment. And you might have some limited success just forcing your loop function onto the unused core via xTaskCreatePinnedToCore(myLoop, ...). There's no reason why an ESP32's Xtensa cores can't handle what you were trying to do in this example, but the Arduino program model could be a limiting factor. I know...target audience. You're right, but the ESP32 is an AMAZING development board. I don't use it much, but only because I never need that much processing power. :o)
Hello, your videos help me a lot, as I´m working with ESP32 for my Bachelor's thesis and there is not a lot of documentation out there. So thank you. :)
I think that Timer0 is used by the underlaying FreeRtos as internal Tick source (behind the Arduino Sketch). Due to this, you are getting an "oversized" ISR and a long response time. You might try with timer 1 and check again the response time? ISR TIMER0( .... SystemTick (with context switch) .... your ISR routine( with its context saving) .... (context restore) ) ISR TIMER1( .... context saving ....your ISR routine .... context restore ) greetings from Argentina!
Maybe somebody has it already mentioned. You can shorten the interrupt reaction time by using high level interrupts. But you must implement it in assembly. LX instruction set is a little bit tricky and commonly not the right approach for people living in the Arduino world. But in generall it is pollible to improve the performance with this way.
You have a huge latency because your inrerrupt routine is actually a callback function. The real interrupt routine is hidden behind the assignInterrupt() finctionality. So there is a long execution chain: interrupt - lookup of assigned callback - callback execution
Hi. What a great video. I think you may have just solved my esp32 interrupt crashing issues. I will test your code tomorrow. FYI I'll be using it for a speedometer.
Update: the Frequency_Counter_with_Interrupt.ino seems to run fine. A little inaccurate at really low rpm (60rpm for example) but good at high rpm. Maybe some smoothing required. Now trying to use time between pulses so work out rpm. Not going to plan yet ;)
Verv interesting Video. The main difference i normally do on similar Programs i don't reset the counter Variable, but use the difference to the Value of this Variable from the last read. This only works when the difference is smaller then half of the maximum value possible with this variable ( 2^31 with 32 Bit Systems ), so wraparounds are always result in differences in this Range. Resetting the Variable is only safely possible when the changing of the Count-Variable can not be interrupted ( this is true when changing this Value is a single command on the Processor, The Processor has some means of binding more commands together in an non-Interruptible way - even across multiple Processors, or you can use for example critical sections ) Otherwise the ISR might be interrupted in between reading the Variable and writing it back after changing it - so the reset Variable will be overwritten.
Very interesting and informative video as always. I don't know how to disable interrupts in arduino mode, but in bare-bone C/C++ or w/o rtos it is possible. I think that it would be quite interesting to compare the behavior / timing in bare-bone / arduino program.
Andreas, I think your interrupt latency problem is caused by using the straightjacket and rubber room of the Arduino attachInterrupt() instead of using the ESP IDF's esp_intr_alloc(). Finding the definition of the attachInterrupt was a real pain-- google failed, but I finally found github.com/espressif/arduino-esp32/blob/master/cores/esp32/esp32-hal-gpio.c . I think by default, you are getting a level 1 (lowest) interrupt, so other interrupts will interfere. You can get level 3 with some flags in the esp_intr_alloc(), but to reduce latency you'd need to use level 5 (Timer.2 uses level 5) and this level requires an assembly ISR (not C callable). If you only modify the counter in the ISR and it is word-aligned, then you shouldn't need to worry about portEnter (but you can use esp_intr_disable()), and you can run the ISR in the other CPU. In assembly, your ISR only needs to increment the counter and return from interrupt. Perhaps having a low-level interrupt wouldn't matter running on the second core. It would be interesting to see your latency on the scope running on the second CPU. I assume it's not used by the RTOS except maybe timers? It would be interesting for you to make a followup video demonstrating how to use a high priority (level 5) interrupt with a short assembly handler running in the second CPU, and see how high of a frequency you can get. Also, I came across this: github.com/MacLeod-D/ESp32-Fast-external-IRQs where he uses dedicated polling on core 1 and claims >3MHz counting.
Howdy Andreas, Thanks for your videos. I needed better than 200khz latency so I used HLI's and that got me better than 2MHZ latency. So the ESP32 can do better than 200khz. I've tried to provide a link to source code and write up on my Medium page but seems youtube deletes it. Thanks for all your great content.
Good to know. But probably not for everybody (I think I saw your issues on the Expressif page ;-) Links, unfortunately, are removed by TH-cam. They changed their policy :-(
Having two identical CPU cores onboard (the "sleep time" processor is irrelevant for this discussion, since it is not symmetrical to the two main CPU cores) does not make the ESP-32 a "true" SMP computer chip (like AMD/Intel, higher-end ARM, etc.). A "true" SMP machine provides built-in arbitration for interrupts, that allows any of the CPU cores, sharing the common SMP system bus, to respond to any interrupt source with impunity. On the x86 family of processors for example, this arbitration achieved by special hardware, known as APIC (Advanced Processing Interrupt Controller). In addition, "cache snooping", memory locks, and many other mechanisms are provided in SMP architectures to guarantee "atomic memory access" and cache coherency that are all necessary for "Transparent Multi-Processing" capabilities, Such capabilities free the programmer from having to deal with many of the fine details of parallel hardware multi-processing. The ESP32 (as well as many of the ARM-based multi-core chips reduce chip complexity by relegating the responsibility for memory coherency and shared interrupts processing to software. The result is a compromise between ease of programming and chip cost (which is proportional to the die area of the chip). Simpler chips cost less and may also consume less energy during most operations; however, parallel operations also require very careful programming and understanding of the hardware limitations in a pseudo-SMP mode of operation. The need to synchronize the CPUs via software, results in overhead that eventually, adds latency to the system behavior. This is what distinguishes SMP (Symmetrical Multi-Processing) class of processors from the simpler "Multi-Core" class of processors. Concurrent execution on a single CPU core is a lot more complicated when more CPU cores are added.
Although I did not verify this, I suspect that multi-CPU synchronization on the ESP-32 is utilizing the "Peterson Lock" (see: en.wikipedia.org/wiki/Peterson%27s_algorithm) for memory access arbitration. This is very common among implementations of "pseudo SMP" programming models. To quote the programmer's manual for the ESP-32: Vanilla FreeRTOS implements critical sections in vTaskEnterCritical which disables the scheduler and calls portDISABLE_INTERRUPTS. This prevents context switches and servicing of ISRs during a critical section. Therefore, critical sections are used as a valid protection method against simultaneous access in vanilla FreeRTOS. On the other hand, the ESP32 has no hardware method for cores to disable each other’s interrupts. Calling portDISABLE_INTERRUPTS() will have no effect on the interrupts of the other core. Therefore, disabling interrupts is NOT a valid protection method against simultaneous access to shared data as it leaves the other core free to access the data even if the current core has disabled its own interrupt.
Andreas, please understand that the software framework (actually FreeRTOS) underneath the Arduino application code is always at work, regardless of you assigning code (task) to either one of the CPU cores, or not. CPU-0 runs many of the wireless code functions; however, CPU-1 is also running code that may be invisible to you (possibly, garbage collection for the memory allocator). In any case, CPU-1 is likely NOT in HALT state even if you did not assign any code to it. Since all the CPUs share the same memory (and I/O) buses and the internal instruction and data caches are limited in size, shared memory accesses must be arbitrated. Due to absence of atomic RMW (read/modify/write) memory access support across the memory bus, all MP synchronization must be managed through software (via RTOS kernel functions). Because such functions require cache flushes to guarantee MP serialized access to memory, the synchronization is slower than usual. True SMP processor incurs some overhead each time that (atomic) RMW operation is executed; however, extensive hardware support (native MP bus protocol, MP memory locks, cache snooping, sophisticated interrupt dispatcher, etc.) allows this type of operations to be orders of magnitude faster.
I would add one word of warning: When using interrupts to detect the activation of a pushbutton, this will lead most likely to unwanted effects, specifically to multiple invocation of the ISR for a single press. The reason is the bouncing of the mechanical contact. Therefore special debouncing routines are necessary. I'm sure I don't state anything new for you, however, I would have added 1-2 sentences to the video directly after the recommendation to use interrupts to detect such things. :-)
your conclusion would have saved me a bunch of money 6 months ago. I purchased a bunch of esp32's for DIY motion sensors. but when the ESP32 wakes up from input, it basically reboots. so instead of motion -> turn on light you get motion -> reboot esp32 -> stand in the dark while the esp32 boots up - > move around again to get motion and then the light turns on. so yeah can't use them for that
Yes, the display() routine is slow. That is why the last two lines have to be together. You also ca n put it in front of this routine. It will give the same result.
@@AndreasSpiess Maybe I’m not understanding the code correctly. Please correct me if I’m wrong, but if an event happens during the display() routine, the counter would be incremented, and then later the counter would be reset, so those events would be lost?
@@AndreasSpiess Ok, I think I get it now. Some events might be “lost” but because the lastEntry is also reset at the same time, those lost events wouldn’t change the frequency measurement, it would just be a “gap”.
Doesn't page 38 section 2.3.3 of The ESP32 Technical Reference Manual document how to use the Interrupt Matrix Controller to disable CPU interrupts? Another interesting video, by the way.
@@AndreasSpiess Ah, ok, I use Platform IO. I'll try and have a look using it in Arduino IDE and see if I can find Ivans blog. Haven't found Ivans blog but have a look at "Assembly via Arduino (parts 1 and 2) - Introduction" you tube videos.
It might work better if you put a 800ms sleep inside the if in the main and a 1ms sleep in the main loop. This will not affect your accuracy much; but, it will make sure the isr has plenty of time to run. This is one case where sleeps are good in a realtime system. It is a balance. Whether this works or not depends on how the ESP32 OS/Driver is done; but, since I believe it uses FreeRTOS then it probably will be better.
Great stuff Andreas, I thought I was competent with ESP interrupts, you showed me 2 new things! I am interested, is it not possible to use the ULP processor to collect small amounts of data then only wake up and upload to the main processor one every 10 readings or so? I am imagining some kind of slow process like a weather station application.
Andreas, have you ever looked at the Parallax (Prop) P1 CPU? 80 Mhz, with 8 parallel cores. Very low power consumption via code clock resetting. Is ideal for real time application use. No need for interrupts. The soon to be released soon P2 CPU will be 10X faster and much more capable. The P1 has been around for over 10 years with many objects available in their object exchange. It is my RT goto processor.
I have an issue with ESP8266 in my weather and fertilization station where ESP8266 must exchange data with ATMEGA328 via I2C. What I found very strange is that ATMEGA328 can receive data from ESP8266 without any loss but ESP cannot receive any data from ATMEGA328 even if it runs at 80MHz which is 5 times faster than ATMEGA328. Is ESP8266 Interrup latency much slower than ATMEGA328's or is it due to Wifi and multitasking in ESP8266?. I tried sending data using Wire.write(), ATMEGA Master ESP Slave, and also tried I2C request mode where ESP is Master and ATMEGA is Slave. I also tried to reduce I2C frequency to the minimum (like 30 Khz) but nothing worked. Is "WIFI OFF" function available also in ESP8266? Can it solve the problem? Here a link to my web interface to my weather station: www.abrobotics.be/siliconceptsarl/METEO/meteoframe.php
I cannot do remote debugging. But you can switch Wi-Fi off on the ESP8266. Maybe you use a logic analyzer for debugging? I once made a video about that.
@@AndreasSpiess Thanks Andreas for your reply. I tried switching off Wifi using WIFI_OFF at the beginning of ISR then WIFI_RESUME at the end of ISR but also it doesn't work. I will try to send from ATMEGA328 to ESP8266 using hardware Serial and Software Serial. As you suggested I will debug I2C using logic analogic. Unfortunatly I have it in my lab and I am now stuck in another city due to Corona virus.
der esp32 arbeitet mit einem seriellen flashrom, das intern gebuffert ist. der Zugriff auf den Programmspeicher beim ausführen von code passiert also nicht synchron, sondern in bloecken. Daher fluktuiert das timing beim auslösen des ISRs
very well explained! who is responsible for the english subtitels? (want to know why some english-words are translated in other words - e.g. _heap_ -> _cluster_ )
Nice video you have! I have a question for you if you can to help me. Can I make a wake up event with a touch sensor and in the same time I have timer wake up? I want to use this method to send the data through Wi-Fi(at every one hour) and touch sensor to wake up to see the values via Bluetooth? Or it's too much?
Hi , love your videos so much. By the way, do you know the boards from Kevin Darrah ´trigbaords’ they consume almost nothing and they are based on ESP32. I’d love to have a review from you, be safe.
hello good video thank you very much it helped me a lot but I have a question I have a set of multiple gpio as an interrupt pointing to the same ISR function, the question is how can I know which GPIO was activated by interrupt? Or are there special methods to do this type of query?
I would add different ISRs for each interrupt and call a common function inside each one. Maybe there is also a register to find out which interrupt was triggered. But I do not know it.
Very interesting! I've been trying to combine wake up timer and wake up interrupt on my current project but have run into a bug with the ESP32 that is problematic for multiple wake up methods. Have you ever tried both a timer and interrupt for deep sleep? For example, counter on interrupt and then sending the count total every 5min?
@@AndreasSpiess I mean waking up on an interrupt pin (esp_sleep_enable_ext0_wakeup(GPIO_NUM_33,1)) I've found that when including ext0 and timer wakeup that there one of the two sometimes doesn't work
Great video! Question 🙋♂️ could you count frequency with an internal hardware counter? Are they cascadable so that you could at least use them for HF? Thanks 😊 73…
You are right. You can use the internal counters either to count or to divide the frequency of the input signal. Here I did not want to build a fast counter, I only used it as a simple to understand example for interrupts.
Nice video! I have just one question: What is the divice called that you used to measure the power consumption of the esp32? (I once saw it at the eevblog mailbag, but it seems that I can't find itanymore.) Thank you very much in advance for your answer!
Hi Andreas. Please show example of a USB interrupt routine. The Arduino command "serialEvent()" dosent work with the ESP32? Im using windows and the Arduino software.
I believe the esp32 runs freertos in order to manage the wifi stack. Your code is only one thread between others. So it’s possible that another one is delaying your interrupts.
Great video once again Andreas, very educating! ; just a comment pcnt (optimized assembly code on esp32 for pulse counting) can do better than standard isr when it comes to frequency counting?
Mr Andreas, thanks for the video. I have a project that extensively uses interrupts. It uses 8 water flow meters to measure water consumption. I have always used portMUX_TYPE mux = portMUX_INITIALIZER_UNLOCKED; in my code without actually understanding its function. I saw you are using portMUX_TYPE sync = portMUX_INITIALIZER_UNLOCKED; Tried to search for the differences but failed to find relevant explanations. Why MUX or SYNC and when to use one or the other? Thanks in advance.
That is just a variable name, you could use portMUX_TYPE potato = portMUX_INITIALIZER_UNLOCKED; just refer to the same variable name in your ISR's portENTER_CRITICAL(&potato) and portEXIT_CRITICAL(&potato) calls.
Beware that the interrupt latency is large enough, that if you're running the Arduino interrupt driven 'hardware serial' routine, with the default buffer size, at high data rates (115200 or more), you can and will over run the buffer. The easy fix is to increase the size of the buffer. The buffer defaults to a small value to work with the Arduino Uno, that has limited RAM memory.
If you're looking for quickie content I'd love to see a low power battery operated wifi mqtt switch for use with homeassist etc. In my case I would fit them behind standard light switches and double sided tape them where convenient. ZigBee switches are not very common and and I haven't found a nice way to control my sonoffs outside homeassist.
@@AndreasSpiess I agree. I use a simple zigbee2mqtt dongle to integrate them and the Xiaomi/IKEA switches are very neat... I just don't know what to do with my ESP devices now :-).
At 15:20 I mixed micro with milliseconds. As you can see on the oscilloscope it is milliseconds
No big deal. It takes me an even longer time to wake up : )
Can you do a video on CAN bus? Also check out my channel if you want to see me build a two-legged walking robot. Enjoy
This inconsistency and delays you are showing is not a problem of ESP32, it's a problem of Arduino porting for ESP32. Just use ESP-IDF directly and redo the experiments - results will be completely different ;)
@@techfuture9846 The 150ms of delay after wakeup to actual code running is probably issue with bootloader.
@@movax20h, I'm talking about the pure interrupt response time, jitter, etc. The wakeup time is different beer.
How lucky we all are that these super well-produced, interesting and informative videos are available to view at our leisure. What a world we all live in! Thank You Andress!
Thank you for your nice words!
Truly. I am able to pursue a life passion project through stitching together knowledge from a collection of great youtubers, with Andreas a shining example. You make the world a better place :)
Agreed, great video!
Brilliant video. Exactly what I wanted.
And excellent overview for the beginner or even the experienced.
I worked on embedded systems 15 years ago - we used microcontrollers, GPS, cellular comms, and used this to create telematics devices installed on John Deere and Liebherr equipment (and others). We read the CAN bus, and used interrupts for things like movement, engines turning on and other interrupts. Since then I've been doing product management, and now I'm getting back into this level of coding... and was depressed that Arduinos don't have good interrupts and sleep.
Your video has brought me back up to speed SUPER quickly, helping me restore my memory from tape, and quickly jumpstarting me with a new microcontroller board.
So have fun with your future projects!
Thanks Andreas, you ever find the way to make it clear and easy to understand. The two channel osciloscope trick is really interesting, but this is part of your very high end workshop...
You could use a logic analyser, you can pick them up for cheap these days 👍
And 2 channel oscilloscopes are also quite cheap these days. No need for the one I have...
This is the second video I've watched by Andreas, and I subscribed after watching the first few minutes of this. With so much bad information out there, this channel is a breath of fresh air. So much to unpack in this video. I'll be watching it again and again, thank you Andreas.
Welcome aboard the channel!
@@AndreasSpiess thanks Andreas, I have my seat in the front row
Thank you ! Perfect timing ! We were just running into random crashes yesterday with our encoders running off ESP 8266. Cleaning up the interrupt functions based on your advises solved our issue ! For the little story, We are building a 4DOF motion platform using salvaged standing desk electric pistons and ESPs. Such a great content every time ! Thanks again !
Glad the video helped! Enjoy your project!
As always a pleasure to watch. I like that you are not only focusing on hardware, but also explains how to utilize software to make project simple and easy to make
My pleasure!
It would be interesting to see a video on using the ULP core for running code without waking up the ESP32. Would be nice to explore the possibilities and limitations of the ULP core.
Silly me, of course you have already made such a video! th-cam.com/video/-QIcUTBB7Ww/w-d-xo.html
Great Topic, The ESP32 has so many new features, performance advantages and value over the Arduino. For the hobbyist, one platform can serve many projects . Your post make the transition worth attempting. Keep them coming!
And it has Wi-Fi, which the most important difference for me.
Mr Spiess, I enjoy your presentations and like this one too. Thank you for all your effort and shared knowledge. There are several reasons why CPU like this one may have long interrupt latency. One of them (and it is a Real Time limitations of large processors like multicore Intel and ARM) is cache coherency. Simple, interrupt code maybe not present in cache and other current content of the cache need to be saved before reloading new one to/from RAM. For vary fast approach, user need to instruct compiler (I dont know how to do it at ESP32 yet) to keep interrupt service routine (if short) permanently in cache. This is typical approach for RT Linux for example.
You are right. There are a few other comments pointing in your direction,. too
A great part of the inaccuracy in the interrupt code (at 7:13 in video) is caused by your own loop code:
{ frequency = count; display(0, "frequency=", frequency); lastEntry=millis(); count=0 }
You use count but reset it only after displaying on the pretty slow LCD. That means, all events that occur during the LCD operation are not counted, but lost. Also, if the duration of LCD output varies, it worsens the count precision. You could improve it if you first completed the job of count handling:
{ frequency = count; count=0; display(0, "frequency=", frequency); lastEntry=millis(); }
BTW, your polling loop (at 3:54 in video) would be more elegant if you replaced
lastentry= millis(); while (millis() < lastEntry + 1000) {...}
with
endTime=millis()+1000; while (millis() < endTime) {...}
This way the addition would be done only once. However a good compiler might catch this and produce the same binary code.
The compiler will figure out the optimization you mentioned at the end automatically. There will be no difference in performance. However, your hint about doing count=0; just after reading frequency is a valid one. In fact if you have mutexes used, you can wrap read and reset of the count, into critical block and be even safer. There are other approaches (like not resetting count at all, and remembering the last count, and subtracting it from current count to get new frequency (might require a special handling of overflows tho; but it will not need mutexes).
it is perfectly fine how he did it. even if the displaying took multiple seconds it wouldnt change anything since the lastEntry variable is changed just before resetting the counter. so it doesnt matter how many counts there were while communicating with the lcd.
correct me if i miss something though
Greetings from Turkey Andreas, I just wanted to thank you for all the great videos you have put out here on the channel. I can't imagine what I would do without you. Loved the cat btw :)
Thank you for your kind words!
Thank you for another interesting and instructive video Andreas.
>edit: went through the comments and found this was already reported, sorry
I just wanted to add that RTOS seems indeed to be a culprit for the interrupt response latency and jitter. I think that attachInterrupt actually hooks up not to the interrupt controller but to an RTOS callback function. This function is entered the queue of RTOS tasks, and get executed after the completion of all the previous tasks only. Apparently it is possible to get a fast interrupt response when programming using noOS SDK from Espressif but I did not try this yet.
That's a mistake then. It's an interrupt and should have a higher priority than a normal task.
@Alexander: Maybe I will have once a closer look into RTOS...
I don’t get it… Arduino is by no means RTOS, and it has no callbacks or other real time capabilities
@@Quemedices684 ESP32 Arduino calls various functions that are built around Espresif's SDK that in turn uses RTOS for WiFi operations. If one does not need WiFi or software timers then no RTOS is involved indeed.
Great job of using the KISS principle, Keep It Simple S.... Silly. This is the most straight for explanation of ISRs, aka, AST as we know them on our beloved VAX-32s. Thanks for showing us all your amazing "scope" work! I'm REALLY enjoying your 2020 video's along with all the others, VERY HELPFUL!!!
Glad you like my stuff! I only sold VAX computers, I never programmed them :-(
At least the biggest I sold was a VAX9000 for 10 million Swiss Francs. At that time maybe 25 million dollars...
Andreas, perhaps a followup comparing the interrupt coding and latency on other 'Arduinos' like STM32, SAMD21, ATMega, ATTiny, ESP8266, MK20DX (Teensy), SiFive E31 (HiFive1), etc.
This is a very special topic. So blogs are probably a better place for such comparisons.
Take a look into there datasheet and you can compare by your own.
@@ripper121 Ah yes, datasheets to find out about interrupts and how they affect everything... let me just quickly read for dozens of hours to compare a few µC...
Just seeing that a ESP32 is pretty much useless if you go into deep sleep is enough information.
@@leocurious9919 Really, that's a very specialized problem and different for each individual case, as Andreas said. Think about changing just one clock cycle in your application code changing the complete timing that is at issue here. It is best to simulate this for each individual case, better to test it as an experimental setup. If something is important for a preliminary decision, it is the limiting/rating values and the clock behavior that can be found in the data sheet.
So @Ripper121's remark is far more helpful than displaying one's own laziness.
Stay healthy:)
@@dieSpinnt It would be a perfect followup to this video. And for which videos does this not apply?
"displaying one's own laziness"
Your videos are always excellent. By the way, If you want a low latency ISR on the ESP32, consider placing it in IRAM. (There is a flag you can put on the ISR definition to do this).
He already did that. I think the issue with ISR is due to arduino code, not ESP32. Also I don't think you really need the mutexes in ISR unless you manipulate more complex data structures from ISR. doing read-modify-write (like count++) from ISR, while rest of the code only do reads (so you might need to have two variables to track how much count you already processed, not reset it back to zero), is safe and doesn't require a mutex.
Well done ! Indeed interesting, again I've learned something new.
That is my hope for every video. I also learned something unexpected about the ESP32
Thank you for the explanation... You are really making a valuable content. I'm already sitting in the first row waiting a next video.
Than) you!
I agree with your idea of being the RTOS influencing the interrupt latency. The RTOS itself (which seems to mee FreeRTOS reading the definitions you wrote to allow ISRs to be safely called) has surely some routines to schedule our loop() function with its own tasks, which can be in turn the communications module handlers (Wifi and/or Bluetooth). Even though you disable them, they could be still working for some reason. In addition the scheduler itself can use an interrupt to switch internal tasks, and this can be another jitter cause.
Many other commenters support this theory.
Thanks a lot for your effort, your experiments, the video and the explanations. And we are now back to the same question we discussed when the ESP32 became availabe: How to use the different cores for different tasks in Arduino IDE , e.g. to decouple WiFi. Up to now I did not find a solution. This is why my counter at the water meter still uses 2 pcs ESP8266. One just for counting and tranferring data via HW-serial without any WiFi output and the second for analyzing the data and communication with my home automation system. Not very elegant, but runs very stable, uptime 657 days since the last blackout caused by road construction works.
I think this is a good concept. Or use a little HW for time critical tasks.
Thank you for pointing me towards the Otii. Now have one and it is becoming an essential piece of kit. Especially now I’m investigating why my new custom board is using 1mA more than it should be
Glad I was helpful!
This video helped a lot! I wanted to monitor my PV panel energy harvesting using an ESP8266 and an arduino DUE (i know, not ebergy efficient but thats what I had lying around). Before th is video they were consuming 210mA and up to 250mA when publishing the measurements. Now i modified the sketch so that the DUE is always asleep (by pull down resistor on reset) and only wakes up for 3 sec (by the ESP) to measure and transmit the data to the ESP then go to sleep again. The ESP then (after connecting) publishes the data and goes to sleep for 20 sec or so. The result is that during sleep they both consume on 38mA and only 100mA when the ESP is awake. Only 3 seconds of 200mA now which easily runs this 24/7 on a single 18650 cell and for several days! Thanks for the insight!
Nice project!
@Andreas, I detach the interrupt at the beginning of the ISR on my Dimmer control, it's only 60Hz and an ESP8266 (today) but it did resolve the flickering I was facing at the edges turning on the off the light completely (and smoothly). Wifi has to be on and there is intense MQTT to keep dashboard as real time as possible, so if I miss a trigger at the edges I just complete the cycle one way or another. With this I could literally get the entire 1% to 99% (in a logarithm scale for real light scale) without bugs. Another great video from you. Cheers.
Interesting. I thought 60 Hz would be possible, especially on the non-Wi-Fi core.
Advanced topic explained with just enough info for practical use. Great job Andreas!
Thank you!, Hari.
To experiment with measuring a higher frequency a (simple) hardware frequency divider could be added.
The frequency counter was just my example to demonstrate the two interrupts in one example.It was not meant to be useful...
You are right again! But the main think is that the rest is perfect! My friend Hari is gonna love this - I love this sample also! Thank you Andreas!
You are welcome! I hope your lockdown also will end soon...
@@AndreasSpiess In god old NEBRASKA, we had a minimal closedown and even the mall open last Friday! I hope governments get smart and reopen everything ASAP! People will not go, if they are in the risk group, like me and my wife, since we don't want to get sick! People are much smarter than government thinks! I think we OVERDID this, but now is time to reopen everything and let business control everything they know how! I hope your finger gets well soon and you are also being able to do whatever you did before this crappy virus! Good luck and stay safe!
I did a great discovery when I found your channel with such professional analysis!
Welcome aboard the channel!
Andreas, nice video! Regarding start-up time: the ESP32 supports deep sleep wake stubs that are executed before any normal initialization. It can send the ESP back to sleep if for example the voltage of a connected battery is too low. I use this feature for undervoltage detection of a connected lipo battery (saving on an additional hardware component). Best
I mention that in the summary. Do you have an example for the Arduino IDE?
@@AndreasSpiess Sorry, missed that part! It is easy to implement in Arduino, as the default wake up stub function is weakly coupled and can be overwritten directly:
RTC_DATA_ATTR int bootCount = 0;
void RTC_IRAM_ATTR esp_wake_deep_sleep(void) {
esp_default_wake_deep_sleep();
bootCount++;
}
This increments the counter before the bootloader starts.
Greetings from Germany
Thank you Mr. Spiess for the interesting video.
Having started programming Microcontrollers with Arduinos and ESPs, and now programming Controllers on a professional level, the DIY embedded system community is filled with lack of skills: poor code because no real programming knowledge, lack of understanding of what is actually going on under the hood, ... . For example, one thing i noticed in professionally, is that i had to always master the controllers' documentations, i had to work on. This lead to the fact that most issues that you mentioned in the video simply can't happen (like polling the digitalread and delaying). I therefore really appreciate deep videos like yours, that aren't simply about repeating examples found online, but analyse and go behind the curtains.
He didn't delay, he used millis(). Take another look.
@Jules: Glad you like them.
Always a pleasure to watch your videos. Thanks for this on. I ran into some trubble appling the irq approach to a 100Hz signal with not as perfect steep flanks as in your given example. The isr gets triggered multiple times during rising and falling flanks. The RISING statemend seems to have no effect in the allocation of the irq. The esp32 seems to have problems with shallow flanked and slow signals. In such cases additional HW and Code is needed...
It is always good to have a Schmitt trigger in front of the interrupt input. Maybe you can disable the interrupt for a few ms in the ISR as a work around.
Love how you used Tishka in the video to illustrate the deep sleep example.
It was not hard to convince her to help in this project ;-)
Geat work Andeas, just purchased my first esp32 and I have a lot of catching up to do : )
Indeed. Enjoy!
Just got my adafruit esp32 feather in the mail today first video I find is this and what a great video!
Enjoy your journey. You find a lot of ESP32 videos on this channel...
Ok, one thing: thank you for identing your code in a proper way!
I use ctrl-T ;-)
I'm currently using the ESP32 for a fft application on net voltage and load current signals (2 analogue channels, 50Hz), where I trigger a timer interrupt up to 1024 times per period, so ~ 100k samples/s on RTOS using both cores.
In my case I'm working with hardware interrupt each ~20ms which calculates a timer value for the real period time divided by 1024. This timer or counter calls another ISR every ~ 20µs.
In my opinion the ESP32 is fast enough for similar applications. But I'm totally agree with your point of the delay of hardware interrupts. Thanks for your research!
Quite a sophisticated application ;-) I use now a second RTOS task with a delay for my morsetrainer. Works fine (ms)
Very informative, thanks!! I will need this in near future, so it is just on time :)
Glad it was helpful!
Amazing, Herr Spiess! We can not thank you enough!
Glad you like it!
Informative videos AND kitties!? What a combo!
Thank you! 😊
This is why I still rely on 8 bit / 16 bit PIC MCUs, they do a very good job at handling interrupts and have a simple way to hook a internal timer to an input pin so you can count very fast signals. It makes easier to implement control loops like PIDs. Only if I need a web server or something to do with WiFi I go for the ESP32. The ESP32 is not a Jack of all Trades.
The more I learn about the ESP32 the more I want to just stay away.
Most of my projects are connected these days. This is why I like the ESP32. But sometimes I also use an Arduino...
I think that right now the ESP32 is the most complete microcontroller when it comes to stay connected and also have massive processing power. But if you don't need connectivity there are better options out there than the ESP32. In the end we choose what we feel comfortable using...
Great video! Most of the programmers don't know that they should use more interrupts! It seems that you can't block the interrupts inside the isr.
There are some discussions going in other comments around "disable interrrupt" ;-)
@@AndreasSpiess yes i have read. Normaly if you learn interrupt programming, the first command in the ISR is that you mask the interrupts, that no other can block you. Only die NMI is allowed
GREAT VIDEO!!!! Yes, it´s a penny that ESP32 is not good for Real Time applications. I´ve noticed the high Jitter on interrupts (Varying from 2 to 45us). It would be good if someone finds how to program the interrupt with *high Priority* even on assembler.
So far I do not know of such a project :-(
Is it possible to handle the interrupts with the second core?
maybe this fixes the high jitter on EXTI
It is possible, but I do not know why it would change. Maybe somebody tries?
@@AndreasSpiess The main core is running many background tasks, I believe the second core is completely idle, If RTOS is handling the interrupts (which it shouldn't) that's another story
@@AndreasSpiess I think the delay is due to other FreeRTOS tasks taking over. Running it on another code could help. You need to create a very high priority task on that core and disable the watchdog timer.
Ali Devrim OGUZ FreeRTOS seems to have a make menuconfig option to lock it to only the first core? would this assist after your interrupt suggestion?
also interested in other versions. wroom, wrover, (solo can’t be real-time), S2. Would love to have time to test them. Probably goes for all of us. Also need to invest in oscilloscope / dsi.
@@jrgalyen yeah that'll probably work too, however it may not let you run your program on the other core. I haven't tried that. I only saw the menu option to "not run the freertos on a single core"
Very nice work! You should be quarantined more often.
Not a lot of change here. I am anyway living in my lab ;-)
Great video, very informative. Thank you for all the work you put in to producing this.
My pleasure! Glad you liked it.
Very good summary Andreas, thanks.
Glad you liked it!
If your running an RTOS then there will always be issues with when you get to see the interrupt. so i can see why the latency is changing, it depends where you interrupt arrives in the the background processes. Not sure if the ESP32 RTOS has variable time slots or fixed time slots so there could be issues there. In the embedded world there is a lot of effort to get an RTOS working correctly. Spent many a happy week on embedded RTOS courses, just to decide that if you don't need all that an RTOS offers then it best not to use one. Also interrupts are a pain for proving the code is safe, as how do you check all the possible places in your main code where it can get interrupted, don't get issues when interrupted at the point.
Nice thought provoking video as usual, thanks
You can process interrupts at higher priority (i.e. level 5, just before NMI level). By default ISR will be lowest priority (level 1), so it will be preempted and/or delayed by other routines like a task scheduler. It is possible to have stable latency and minimal jitter using FreeRTOS.
Nice. To be fair, the ESP32 is running a very high level OS, FreeRTOS with changes. It doesn't have to run FreeRTOS, but you'll experience a great deal of trouble using Arduino or PlatformIO if you eliminate the OS. (You'd have to write a new core library) Something that might make a difference is to set the affinity of the ISR to the second core, which is unused by any code unless you explicitly force tasks over to it. I've never tried it, but it should be produce measurable improvement.
See esp32.com/viewtopic.php?f=2&t=10006
You are right. I usually just take what I have and check it out. I would probably use a different processor for real-time applications before I would start to mess around with the underlying infrastructure ;-)
@@AndreasSpiess I believe you'll have much better results w/ interrupt driven ESP32 tasks, working from Espressif's development environment. And you might have some limited success just forcing your loop function onto the unused core via xTaskCreatePinnedToCore(myLoop, ...). There's no reason why an ESP32's Xtensa cores can't handle what you were trying to do in this example, but the Arduino program model could be a limiting factor. I know...target audience. You're right, but the ESP32 is an AMAZING development board. I don't use it much, but only because I never need that much processing power. :o)
Hello, your videos help me a lot, as I´m working with ESP32 for my Bachelor's thesis and there is not a lot of documentation out there. So thank you. :)
Are you using IDF or Arduino for developement ?
You are welcome!
super nice Andreas, as usual: idea stolen for my next project: rpm of my noctua fan counted using your example ;-)
Sounds great!
Andreas you are a treasure bro, thanks a lot
Thank you!
Thank you for sharing your knowledge with community!
My pleasure!
It’s worth mentioning that the Wifi runs only on one core. If you run your app on the other core, it will not be affected
Interesting to know how you allocate cores to processes John. Will try and look that up.
@@MiniLuv-1984 Andreas had mentioned it in his esp32 dual core video
I think that Timer0 is used by the underlaying FreeRtos as internal Tick source (behind the Arduino Sketch). Due to this, you are getting an "oversized" ISR and a long response time. You might try with timer 1 and check again the response time?
ISR TIMER0(
.... SystemTick (with context switch)
.... your ISR routine( with its context saving)
.... (context restore)
)
ISR TIMER1(
.... context saving
....your ISR routine
.... context restore
)
greetings from Argentina!
Thanks for the tip. For the moment I have no fast application. Maybe somebody else tries it?
Maybe somebody has it already mentioned. You can shorten the interrupt reaction time by using high level interrupts. But you must implement it in assembly. LX instruction set is a little bit tricky and commonly not the right approach for people living in the Arduino world. But in generall it is pollible to improve the performance with this way.
Thank you for the additional info. You are the first mentioning it.
You have a huge latency because your inrerrupt routine is actually a callback function. The real interrupt routine is hidden behind the assignInterrupt() finctionality. So there is a long execution chain: interrupt - lookup of assigned callback - callback execution
Is it possible to avoid this latency by using the ESP-IDF maybe?
Thanks for clarification!
Hi. What a great video. I think you may have just solved my esp32 interrupt crashing issues. I will test your code tomorrow. FYI I'll be using it for a speedometer.
Update: the Frequency_Counter_with_Interrupt.ino seems to run fine. A little inaccurate at really low rpm (60rpm for example) but good at high rpm. Maybe some smoothing required. Now trying to use time between pulses so work out rpm. Not going to plan yet ;)
Verv interesting Video.
The main difference i normally do on similar Programs i don't reset the counter Variable, but use the difference to the Value of this Variable from the last read. This only works when the difference is smaller then half of the maximum value possible with this variable ( 2^31 with 32 Bit Systems ), so wraparounds are always result in differences in this Range.
Resetting the Variable is only safely possible when the changing of the Count-Variable can not be interrupted ( this is true when changing this Value is a single command on the Processor, The Processor has some means of binding more commands together in an non-Interruptible way - even across multiple Processors, or you can use for example critical sections ) Otherwise the ISR might be interrupted in between reading the Variable and writing it back after changing it - so the reset Variable will be overwritten.
Thank you for the tip!
Amazingly presented, Just as I received my first ESP32 in the mail!
Enjoy!
Very interesting and informative video as always. I don't know how to disable interrupts in arduino mode, but in bare-bone C/C++ or w/o rtos it is possible. I think that it would be quite interesting to compare the behavior / timing in bare-bone / arduino program.
For the moment I have no project with the need of those fast interrupts. So I will not follow up.
Great overview of IRQ usage on esp32, thank you!
You are welcome!
Andreas, I think your interrupt latency problem is caused by using the straightjacket and rubber room of the Arduino attachInterrupt() instead of using the ESP IDF's esp_intr_alloc(). Finding the definition of the attachInterrupt was a real pain-- google failed, but I finally found github.com/espressif/arduino-esp32/blob/master/cores/esp32/esp32-hal-gpio.c .
I think by default, you are getting a level 1 (lowest) interrupt, so other interrupts will interfere. You can get level 3 with some flags in the esp_intr_alloc(), but to reduce latency you'd need to use level 5 (Timer.2 uses level 5) and this level requires an assembly ISR (not C callable). If you only modify the counter in the ISR and it is word-aligned, then you shouldn't need to worry about portEnter (but you can use esp_intr_disable()), and you can run the ISR in the other CPU. In assembly, your ISR only needs to increment the counter and return from interrupt.
Perhaps having a low-level interrupt wouldn't matter running on the second core. It would be interesting to see your latency on the scope running on the second CPU. I assume it's not used by the RTOS except maybe timers?
It would be interesting for you to make a followup video demonstrating how to use a high priority (level 5) interrupt with a short assembly handler running in the second CPU, and see how high of a frequency you can get.
Also, I came across this: github.com/MacLeod-D/ESp32-Fast-external-IRQs where he uses dedicated polling on core 1 and claims >3MHz counting.
Thank you for the links. I just was surprised, I have no particular project for eh moment...
Your video is both useful and interesting. Great job!
Glad you think so!
Much appreciated by this guy with the Afrikaans accent!
You are welcome!
Very helpful video. I liked it
Glad to hear that
Howdy Andreas, Thanks for your videos. I needed better than 200khz latency so I used HLI's and that got me better than 2MHZ latency. So the ESP32 can do better than 200khz. I've tried to provide a link to source code and write up on my Medium page but seems youtube deletes it. Thanks for all your great content.
Good to know. But probably not for everybody (I think I saw your issues on the Expressif page ;-)
Links, unfortunately, are removed by TH-cam. They changed their policy :-(
Great video. One question: Do you have a schematic of how you hooked up the input signal and LCD display to the ESP32 as demonstrated in your video?
I do no more remember. But I am sure Google knows...
Having two identical CPU cores onboard (the "sleep time" processor is irrelevant for this discussion, since it is not symmetrical to the two main CPU cores) does not make the ESP-32 a "true" SMP computer chip (like AMD/Intel, higher-end ARM, etc.). A "true" SMP machine provides built-in arbitration for interrupts, that allows any of the CPU cores, sharing the common SMP system bus, to respond to any interrupt source with impunity. On the x86 family of processors for example, this arbitration achieved by special hardware, known as APIC (Advanced Processing Interrupt Controller). In addition, "cache snooping", memory locks, and many other mechanisms are provided in SMP architectures to guarantee "atomic memory access" and cache coherency that are all necessary for "Transparent Multi-Processing" capabilities, Such capabilities free the programmer from having to deal with many of the fine details of parallel hardware multi-processing. The ESP32 (as well as many of the ARM-based multi-core chips reduce chip complexity by relegating the responsibility for memory coherency and shared interrupts processing to software. The result is a compromise between ease of programming and chip cost (which is proportional to the die area of the chip). Simpler chips cost less and may also consume less energy during most operations; however, parallel operations also require very careful programming and understanding of the hardware limitations in a pseudo-SMP mode of operation. The need to synchronize the CPUs via software, results in overhead that eventually, adds latency to the system behavior. This is what distinguishes SMP (Symmetrical Multi-Processing) class of processors from the simpler "Multi-Core" class of processors. Concurrent execution on a single CPU core is a lot more complicated when more CPU cores are added.
Although I did not verify this, I suspect that multi-CPU synchronization on the ESP-32 is utilizing the "Peterson Lock" (see: en.wikipedia.org/wiki/Peterson%27s_algorithm) for memory access arbitration. This is very common among implementations of "pseudo SMP" programming models.
To quote the programmer's manual for the ESP-32:
Vanilla FreeRTOS implements critical sections in vTaskEnterCritical which disables the scheduler and calls portDISABLE_INTERRUPTS. This prevents context switches and servicing of ISRs during a critical section. Therefore, critical sections are used as a valid protection method against simultaneous access in vanilla FreeRTOS.
On the other hand, the ESP32 has no hardware method for cores to disable each other’s interrupts. Calling portDISABLE_INTERRUPTS() will have no effect on the interrupts of the other core. Therefore, disabling interrupts is NOT a valid protection method against simultaneous access to shared data as it leaves the other core free to access the data even if the current core has disabled its own interrupt.
I did not use more than one core for my video.
Andreas, please understand that the software framework (actually FreeRTOS) underneath the Arduino application code is always at work, regardless of you assigning code (task) to either one of the CPU cores, or not.
CPU-0 runs many of the wireless code functions; however, CPU-1 is also running code that may be invisible to you (possibly, garbage collection for the memory allocator). In any case, CPU-1 is likely NOT in HALT state even if you did not assign any code to it.
Since all the CPUs share the same memory (and I/O) buses and the internal instruction and data caches are limited in size, shared memory accesses must be arbitrated. Due to absence of atomic RMW (read/modify/write) memory access support across the memory bus, all MP synchronization must be managed through software (via RTOS kernel functions). Because such functions require cache flushes to guarantee MP serialized access to memory, the synchronization is slower than usual. True SMP processor incurs some overhead each time that (atomic) RMW operation is executed; however, extensive hardware support (native MP bus protocol, MP memory locks, cache snooping, sophisticated interrupt dispatcher, etc.) allows this type of operations to be orders of magnitude faster.
Another outstanding video, many thanks for your efforts
My pleasure!
I would add one word of warning: When using interrupts to detect the activation of a pushbutton, this will lead most likely to unwanted effects, specifically to multiple invocation of the ISR for a single press. The reason is the bouncing of the mechanical contact. Therefore special debouncing routines are necessary.
I'm sure I don't state anything new for you, however, I would have added 1-2 sentences to the video directly after the recommendation to use interrupts to detect such things. :-)
Switch denouncing is not specific to interrupts. It always have to be done.
your conclusion would have saved me a bunch of money 6 months ago. I purchased a bunch of esp32's for DIY motion sensors. but when the ESP32 wakes up from input, it basically reboots. so instead of motion -> turn on light you get motion -> reboot esp32 -> stand in the dark while the esp32 boots up - > move around again to get motion and then the light turns on. so yeah can't use them for that
Sorry I was too late :-(
@@AndreasSpiess I'm sure i'll find a use for them eventually :)
At 7:08, I would recommend resetting count=0 right away, to improve accuracy.
The display() routine is time consuming, so events could be lost.
Yes, the display() routine is slow. That is why the last two lines have to be together. You also ca n put it in front of this routine. It will give the same result.
@@AndreasSpiess
Maybe I’m not understanding the code correctly. Please correct me if I’m wrong, but if an event happens during the display() routine, the counter would be incremented, and then later the counter would be reset, so those events would be lost?
@@AndreasSpiess
Ok, I think I get it now. Some events might be “lost” but because the lastEntry is also reset at the same time, those lost events wouldn’t change the frequency measurement, it would just be a “gap”.
Doesn't page 38 section 2.3.3 of The ESP32 Technical Reference Manual document how to use the Interrupt Matrix Controller to disable CPU interrupts? Another interesting video, by the way.
You are right. But I do not know how to do it in Arduino and also not the consequences (as Ivan points out in his blog entry)
@@AndreasSpiess Ah, ok, I use Platform IO. I'll try and have a look using it in Arduino IDE and see if I can find Ivans blog. Haven't found Ivans blog but have a look at "Assembly via Arduino (parts 1 and 2) - Introduction" you tube videos.
Superb video with tons of help! Ty!
What microcontroller do u recommend for RT systems with wifi inside? Do u meet such?
If you need fast responses, you probably are better with separating Wi-Fi from the MCU (using a ESP-01 for example)
It might work better if you put a 800ms sleep inside the if in the main and a 1ms sleep in the main loop. This will not affect your accuracy much; but, it will make sure the isr has plenty of time to run. This is one case where sleeps are good in a realtime system. It is a balance. Whether this works or not depends on how the ESP32 OS/Driver is done; but, since I believe it uses FreeRTOS then it probably will be better.
The ESP always boots after sleep. Other than the Arduinos. So no sleep inside a loop :-(
@@AndreasSpiess By "sleep" I meant delay (you are sleeping the thread). Sorry, old terminology habit.
It would be lovely to have chapters in your videos!
They are probably too short and are made to be watched till the end (except mailbags which have chapters)
@@AndreasSpiess Andreas, for me your videos turn very quickly into references, and the chapters are excelent to go and check something again
Great stuff Andreas, I thought I was competent with ESP interrupts, you showed me 2 new things!
I am interested, is it not possible to use the ULP processor to collect small amounts of data then only wake up and upload to the main processor one every 10 readings or so? I am imagining some kind of slow process like a weather station application.
I think I mentioned this fact in thee video.
Nice idea with the output pin debugging.
Thanks!
Andreas, have you ever looked at the Parallax (Prop) P1 CPU? 80 Mhz, with 8 parallel cores. Very low power consumption via code clock resetting. Is ideal for real time application use. No need for interrupts.
The soon to be released soon P2 CPU will be 10X faster and much more capable. The P1 has been around for over 10 years with many objects available in their object exchange. It is my RT goto processor.
I decided to go with the Arduino IDE for this channel because it is widely used and has lots of libraries and community support.
I have an issue with ESP8266 in my weather and fertilization station where ESP8266 must exchange data with ATMEGA328 via I2C. What I found very strange is that ATMEGA328 can receive data from ESP8266 without any loss but ESP cannot receive any data from ATMEGA328 even if it runs at 80MHz which is 5 times faster than ATMEGA328. Is ESP8266 Interrup latency much slower than ATMEGA328's or is it due to Wifi and multitasking in ESP8266?. I tried sending data using Wire.write(), ATMEGA Master ESP Slave, and also tried I2C request mode where ESP is Master and ATMEGA is Slave. I also tried to reduce I2C frequency to the minimum (like 30 Khz) but nothing worked. Is "WIFI OFF" function available also in ESP8266? Can it solve the problem? Here a link to my web interface to my weather station:
www.abrobotics.be/siliconceptsarl/METEO/meteoframe.php
I cannot do remote debugging. But you can switch Wi-Fi off on the ESP8266. Maybe you use a logic analyzer for debugging? I once made a video about that.
@@AndreasSpiess Thanks Andreas for your reply. I tried switching off Wifi using WIFI_OFF at the beginning of ISR then WIFI_RESUME at the end of ISR but also it doesn't work. I will try to send from ATMEGA328 to ESP8266 using hardware Serial and Software Serial. As you suggested I will debug I2C using logic analogic. Unfortunatly I have it in my lab and I am now stuck in another city due to Corona virus.
der esp32 arbeitet mit einem seriellen flashrom, das intern gebuffert ist. der Zugriff auf den Programmspeicher beim ausführen von code passiert also nicht synchron, sondern in bloecken. Daher fluktuiert das timing beim auslösen des ISRs
Es gibt noch andere Erklährungen in den Kommentaren. Ich weiss nicht was der Grund ist.
very well explained!
who is responsible for the english subtitels? (want to know why some english-words are translated in other words - e.g. _heap_ -> _cluster_ )
Google does add an auto-translation.
@@AndreasSpiess astonishing ^v^
Nice video you have!
I have a question for you if you can to help me. Can I make a wake up event with a touch sensor and in the same time I have timer wake up? I want to use this method to send the data through Wi-Fi(at every one hour) and touch sensor to wake up to see the values via Bluetooth? Or it's too much?
Here you find some info: randomnerdtutorials.com/esp32-touch-wake-up-deep-sleep/randomnerdtutorials.com/esp32-touch-wake-up-deep-sleep/
Hi , love your videos so much. By the way, do you know the boards from Kevin Darrah ´trigbaords’ they consume almost nothing and they are based on ESP32. I’d love to have a review from you, be safe.
I had one of them in one of my past mailbags.
@@AndreasSpiess Hi, it is very unlikely as they just got announced a few weeks ago but I'll check, maybe you are referring to the 8266 model.
at smt32 controllers existing interrupt priorities(interrupt in interrupts), maybe that helps with counting edges, when the EXTI is the most highest.
That is what most other CPUs have.
You could use one of its secret peripheral, i.e., pulse counter (PCNT) to do real time counting up to 40MHz.
Thank you for the info!
I didnt know they had external interrupts. Good video
Thank you!
This has to be the most expensive video yet.
:-))
I don't get it?
@@RakshithPrakash I think because and is a really expensive word 😉
hello good video thank you very much it helped me a lot
but I have a question
I have a set of multiple gpio as an interrupt pointing to the same ISR function, the question is how can I know which GPIO was activated by interrupt?
Or are there special methods to do this type of query?
I would add different ISRs for each interrupt and call a common function inside each one. Maybe there is also a register to find out which interrupt was triggered. But I do not know it.
Very interesting! I've been trying to combine wake up timer and wake up interrupt on my current project but have run into a bug with the ESP32 that is problematic for multiple wake up methods. Have you ever tried both a timer and interrupt for deep sleep? For example, counter on interrupt and then sending the count total every 5min?
I wold not mix deep sleep and interrupts. As shown, in one case the CPU sleeps and in the other it runs
@@AndreasSpiess I mean waking up on an interrupt pin (esp_sleep_enable_ext0_wakeup(GPIO_NUM_33,1)) I've found that when including ext0 and timer wakeup that there one of the two sometimes doesn't work
Very well explained in detail
Glad it was helpful!
Great video!
Question 🙋♂️ could you count frequency with an internal hardware counter? Are they cascadable so that you could at least use them for HF?
Thanks 😊 73…
You are right. You can use the internal counters either to count or to divide the frequency of the input signal. Here I did not want to build a fast counter, I only used it as a simple to understand example for interrupts.
@@AndreasSpiess Thanks for your replies; much appreciated 😃
Nice video!
I have just one question: What is the divice called that you used to measure the power consumption of the esp32? (I once saw it at the eevblog mailbag, but it seems that I can't find itanymore.) Thank you very much in advance for your answer!
I use several devices: The ucurrent gold, the current ranger (both shown in one of my videos), the Joulescope, and the OTII
Hi Andreas. Please show example of a USB interrupt routine. The Arduino command "serialEvent()" dosent work with the ESP32? Im using windows and the Arduino software.
The standard ESP32 does not support USB. And serialEvent() has nothing to do with USB. So I do not understand your comment :-(
@8:00 In regards to a real time MCU, have you looked at the Ti CC3220/MSP430 and Ti RTOS?
No. I stick with my few MCUs because it is a lot of effort to add another one.
I believe the esp32 runs freertos in order to manage the wifi stack. Your code is only one thread between others. So it’s possible that another one is delaying your interrupts.
You are right.
Interrupts are higher priority than ANY thread. The lowest priority interrupt always interrupts the highest priority thread!
Unless they get disabled by a critical section, or if higher priority interrupts need to be serviced.
Great video once again Andreas, very educating! ; just a comment pcnt (optimized assembly code on esp32 for pulse counting) can do better than standard isr when it comes to frequency counting?
Assembly usually is faster. But nearly nobody can use it.
Can you do a video comparing interrupts, timers and tasks? how to use them, in which situation and speed limitation?
I do not know. I am not into video.
Andreas Spiess hehehe sorry I meant an episode ;)
Mr Andreas, thanks for the video.
I have a project that extensively uses interrupts. It uses 8 water flow meters to measure water consumption. I have always used portMUX_TYPE mux = portMUX_INITIALIZER_UNLOCKED; in my code without actually understanding its function.
I saw you are using portMUX_TYPE sync = portMUX_INITIALIZER_UNLOCKED; Tried to search for the differences but failed to find relevant explanations. Why MUX or SYNC and when to use one or the other? Thanks in advance.
That is just a variable name, you could use portMUX_TYPE potato = portMUX_INITIALIZER_UNLOCKED; just refer to the same variable name in your ISR's portENTER_CRITICAL(&potato) and portEXIT_CRITICAL(&potato) calls.
Beware that the interrupt latency is large enough, that if you're running the Arduino interrupt driven 'hardware serial' routine, with the default buffer size, at high data rates (115200 or more), you can and will over run the buffer. The easy fix is to increase the size of the buffer. The buffer defaults to a small value to work with the Arduino Uno, that has limited RAM memory.
Thanks for the input! You are right.
If you're looking for quickie content I'd love to see a low power battery operated wifi mqtt switch for use with homeassist etc. In my case I would fit them behind standard light switches and double sided tape them where convenient.
ZigBee switches are not very common and and I haven't found a nice way to control my sonoffs outside homeassist.
I like teh Zigbee switches and Zigbee recently became much more important as a Home automation standard, I think.
@@AndreasSpiess I agree. I use a simple zigbee2mqtt dongle to integrate them and the Xiaomi/IKEA switches are very neat... I just don't know what to do with my ESP devices now :-).