I am glad I found your video, cause now I understood a bit more about the influxdb queries, however I think there is still a lot of hesitation/mistakes that are slightly degradating the comprehension of the video, that's a point for improvement. Thanks a lot for your time and explanations! 👍
Great intro video! I have been doing a deep dive into influx DB 2.x, telegraf, grafana etc and it took me a while to get my bearings coming from just a SQL background. One note about the video, the image of you narrating obscures the bottom right corner of the panel which is important to see :)
Great video! thank you for the insightful knowledge into how the query builder generates code for you if you are not sure how to write the flux equivalent.
Another great vid - I am building up a new NUC to hold mainly node-red, influx and grafana. I have an older v1.x influx with several years worth of data that I may try and transfer. So good timing on your part :)
Thanks for a great tutorial Csongor Varga,! Is your bucket mydb available anywhere? Thought it would help a lot if I can have the same data setup locally when I wath the different chapters in the video
Dear Varga. How can we create measurement in influxdb 2.1 OSS for my Bucket? Because your video state that already created measurement like sensor mydb bucket.
@@csongorvarga Thanks Varga. Still I am not sure about data creation. Where can I create data like field, tag, measurement in influxdb 2.1 UI for my bucket? As of now I can create bucket only. After create bucket what to do?
@@gopalr5894 Influx is a structure less database. You load the data and the measurements, tag and fields will get created. There is an import feature in the UI to load data in CSV or line protocol format, otherwise you just push data form an external application like Node-Red.
@@csongorvarga Thanks for your Clarification. I want to push the data from Node-Red to Influxdb using Docker Images. But it won't work at all. Could you tell me using docker (Node-Red to Influxdb 2.1 OSS) to push the data.
This was really useful, especially the bit about deleting Influx data. I'm using Node-RED to send data from multiple current clamp sensors (Emporia, data collected in HA). I have a function node that just takes the MQTT topic and converts it into an object key, with the number as the value. However for some reason, one of the sensors gives an error: failure writing points to database: partial write: field type conflict: input field "empty_10_1min" on measurement "emporia_power" is type float, already exists as type string dropped=1". So obviously some time in the past it has written a string, and so that measurement type is a string. I thought I could just delete all the data in that field by running the delete command, but that doesn't seem to work. Is there a way to fully delete a field itself (not just the data within the field)?
Yes, I had similar issue in the past, and I had to delete data as well. You can delete data for an entire measurement or entire field. So it really depends how to save the data.
@@csongorvarga Any idea what the command to do that might be? I have tried this: "sudo influx delete --bucket nodered --start 2013-03-01T00:00:00Z --stop 2023-08-24T00:00:00Z --predicate '_measurement="emporia_power" AND _field="empty_10_1min"' --org CHR". The command doesn't produce an error. But when I go into Influx data explorer (web interface) and refresh the page, then click into the measurement, (also need to change aggregate function to "last" and set visualisation type to "table") that field still exists with loads of data. All the data values are "unknown" but there are a lot of them...
@@MatSmithLondon I am going through my notes and I have this as an example: influx delete --bucket aggregates --start 2005-03-01T00:00:00Z --stop 2022-03-01T00:00:00Z --predicate '_measurement="example-measurement" AND exampleTag="exampleTagValue"' . And based on this, I used an example this: influx delete --bucket nodered --start 2005-03-01T00:00:00Z --stop 2023-03-01T00:00:00Z --predicate '_measurement="sensors" AND device="house"' . You need to put the filters after predicate into single quotes. If I can in your example your predicate ends with single quote+double quote, but I think it should be double quote+single quote to correctly close the parameter after predicate. But this has worked for me. And I would remove any aggregate function from the query so see each record in the database.
Hello, I have a query: If the values in left most column "table MEAN" represent mean of the window, how can mean be 0 (15:08 timestamp in video). Also, if I don't have any aggregate function in place, the column becomes "table _RESULT" and has int values (0, 3) [my local db]. What do they represent?
Hello Csongor! Nice video as always from you! In one of your earlier video I saw you installed esphome without home assistant on one of your iot device. My question is whether you could send datas from esphome to influxdb. I am not sure, but as far as I know influxdb plugin for esphome is not existent. You can disable the standard api of esphome and change to mqtt and then you can use a mqtt->influxdb connector to send data from esphome to influxdb. However, I think it is not am elegant way. Do you have any experience about that. Thanks for your answer.
If I remember correctly, I tried looking into it. To be honest since I have Node-Red I do everything via Node-Red. But it is possible to set up Telegraf to subscribe to MQTT topics and push the data to influx. Maybe this post can help: github.com/influxdata/telegraf/blob/master/plugins/inputs/mqtt_consumer/README.md
In influxdb is it possible to find which exact query,index,measurement using high memory or cpu in percentage wise. Is there any document along with commands/syntax for checking these. can you help on this
Just use the range function and you can just specify the start and end date directly. For example: |> range(start: 2018-05-22T23:30:00Z, stop: 2018-05-23T00:00:00Z)
I am glad I found your video, cause now I understood a bit more about the influxdb queries, however I think there is still a lot of hesitation/mistakes that are slightly degradating the comprehension of the video, that's a point for improvement. Thanks a lot for your time and explanations! 👍
Thanks! the SQL comparisons are especially helpful.
Great intro video! I have been doing a deep dive into influx DB 2.x, telegraf, grafana etc and it took me a while to get my bearings coming from just a SQL background. One note about the video, the image of you narrating obscures the bottom right corner of the panel which is important to see :)
Great video! thank you for the insightful knowledge into how the query builder generates code for you if you are not sure how to write the flux equivalent.
Great content. I'm going to switch from 1.x to 2.x and this is very useful for me. Keep going :)
Finally, some good content for novice users. Garbage training materials from influxdb, very frustrating start... Thank you kindly, Sir.
Another great vid - I am building up a new NUC to hold mainly node-red, influx and grafana. I have an older v1.x influx with several years worth of data that I may try and transfer. So good timing on your part :)
Nicely explained, great video 👍
Very nice video. Keep it up!!
Good Job! please continue and do something with influx 1.x also.
Sorry, it takes a lot of time to get my head around 2.x, I have no intention to go back to a version which is not supported any more.
I was looking forward to this video but the background music is too loud and annoying, had to stop two minutes in.
Thanks for a great tutorial Csongor Varga,! Is your bucket mydb available anywhere? Thought it would help a lot if I can have the same data setup locally when I wath the different chapters in the video
Not, but I am not sure how I could export it... never done that before
Dear Varga. How can we create measurement in influxdb 2.1 OSS for my Bucket? Because your video state that already created measurement like sensor mydb bucket.
You just start creating new data and the measurement gets created automatically. It is not like a table that you need to define manually.
@@csongorvarga Thanks Varga. Still I am not sure about data creation. Where can I create data like field, tag, measurement in influxdb 2.1 UI for my bucket? As of now I can create bucket only. After create bucket what to do?
@@gopalr5894 Influx is a structure less database. You load the data and the measurements, tag and fields will get created. There is an import feature in the UI to load data in CSV or line protocol format, otherwise you just push data form an external application like Node-Red.
@@csongorvarga Thanks for your Clarification. I want to push the data from Node-Red to Influxdb using Docker Images. But it won't work at all. Could you tell me using docker (Node-Red to Influxdb 2.1 OSS) to push the data.
@@gopalr5894 I don't know. I never worked with docker. If Node-Red and Influx are in different dockers it may not work.
This was really useful, especially the bit about deleting Influx data. I'm using Node-RED to send data from multiple current clamp sensors (Emporia, data collected in HA). I have a function node that just takes the MQTT topic and converts it into an object key, with the number as the value. However for some reason, one of the sensors gives an error: failure writing points to database: partial write: field type conflict: input field "empty_10_1min" on measurement "emporia_power" is type float, already exists as type string dropped=1". So obviously some time in the past it has written a string, and so that measurement type is a string. I thought I could just delete all the data in that field by running the delete command, but that doesn't seem to work. Is there a way to fully delete a field itself (not just the data within the field)?
Yes, I had similar issue in the past, and I had to delete data as well. You can delete data for an entire measurement or entire field. So it really depends how to save the data.
@@csongorvarga Any idea what the command to do that might be? I have tried this: "sudo influx delete --bucket nodered --start 2013-03-01T00:00:00Z --stop 2023-08-24T00:00:00Z --predicate '_measurement="emporia_power" AND _field="empty_10_1min"' --org CHR". The command doesn't produce an error. But when I go into Influx data explorer (web interface) and refresh the page, then click into the measurement, (also need to change aggregate function to "last" and set visualisation type to "table") that field still exists with loads of data. All the data values are "unknown" but there are a lot of them...
@@MatSmithLondon I am going through my notes and I have this as an example: influx delete --bucket aggregates --start 2005-03-01T00:00:00Z --stop 2022-03-01T00:00:00Z --predicate '_measurement="example-measurement" AND exampleTag="exampleTagValue"' . And based on this, I used an example this: influx delete --bucket nodered --start 2005-03-01T00:00:00Z --stop 2023-03-01T00:00:00Z --predicate '_measurement="sensors" AND device="house"' . You need to put the filters after predicate into single quotes. If I can in your example your predicate ends with single quote+double quote, but I think it should be double quote+single quote to correctly close the parameter after predicate. But this has worked for me. And I would remove any aggregate function from the query so see each record in the database.
Hello, I have a query:
If the values in left most column "table MEAN" represent mean of the window, how can mean be 0 (15:08 timestamp in video). Also, if I don't have any aggregate function in place, the column becomes "table _RESULT" and has int values (0, 3) [my local db]. What do they represent?
Hello Csongor! Nice video as always from you! In one of your earlier video I saw you installed esphome without home assistant on one of your iot device. My question is whether you could send datas from esphome to influxdb. I am not sure, but as far as I know influxdb plugin for esphome is not existent. You can disable the standard api of esphome and change to mqtt and then you can use a mqtt->influxdb connector to send data from esphome to influxdb. However, I think it is not am elegant way. Do you have any experience about that. Thanks for your answer.
If I remember correctly, I tried looking into it. To be honest since I have Node-Red I do everything via Node-Red. But it is possible to set up Telegraf to subscribe to MQTT topics and push the data to influx. Maybe this post can help: github.com/influxdata/telegraf/blob/master/plugins/inputs/mqtt_consumer/README.md
hi men good video, an question is there a way to get the number of rows returned by a query?
Sure, you can use the count() function.
Hi, I just want to know how you are writing the data into the influxdb. If you can share the that file, it will be very helpful
I post data from Node-Red, and I use the line protocol to inject the data. I am showing this is all my other videos.
In influxdb is it possible to find which exact query,index,measurement using high memory or cpu in percentage wise. Is there any document along with commands/syntax for checking these. can you help on this
That is a good question. Sorry I have no idea, I probably have to research this.
hi .. may i know how to do query database for influx for speceifi date and time . let say query from 1jan2022 8am to 2jan2022 8am
Just use the range function and you can just specify the start and end date directly. For example: |> range(start: 2018-05-22T23:30:00Z, stop: 2018-05-23T00:00:00Z)
So you did not show how to create a measurement!
You don't have to create it. Once you start injecting data, it will get generated. And if you misspell it, that would be a new measurement.
@@csongorvarga sorry but it took sometime for me to understand how influxdb really works.
69th like :D
Thanks for the info!
Informative but the background music needs to go!
No more background music. You will not hear on my new videos.
after year is useless, this explorer is totally different