Hi Stefen , thank you so much for this video.. all the information shared is just great. If you could find some time to upload more videos on NIFI it will be really great !!
Excellent video, thanks! A question: max value property lets us get new records, but what if we wanted to get updated records as well? Say we have a 'last updated' column with a timestamp to facilitate this. Should we then build another pipeline for updates?
Nice.. I want to connect to postgresql db which is secured by ssl. Since there is no property on DBCPConnection Pool controller to provide ssl deatils, how we are able to connect to db ? Can we pass sslcert and sslmode in query param of database url property ?
In the answer of the following thread is a link that should help you on this issue. Let me know how it goes. community.cloudera.com/t5/Support-Questions/QueryDatabaseTable-giving-error-while-pulling-data-from/td-p/220949
@@condla Thanks for info. i tried by passing ssl details in query params for 'database connection url' property (jdbc:postgresql://host:port/databaseName?ssl=true&sslrootcert=C:\Certificate\DEV.cert&sslmode=verify-full ). But getting following exception .. 1. Caused by: org.postgresql.util.PSQLException: SSL error: Received fatal alert: handshake_failure .
Stefan, I am trying to connect to Cassanda with help of Query Cassandra processor, is there any way we can fetch records using conditions in query , data can be passed from outside..
Hi sir can we put the resultant data into another database! for example can I put that data into some other sql database table ? basically my requirement is to make replica of database.
Sure, drag another processor into the board that has a name like "Put....." e.g. PutSQL to write it to a system that talks SQL. You need to add the jdbc driver just like you add it when you query it. There's plenty of other Put processors that use the Write APIs of many other databases.
How can i fix this error Cannot create JDBC driver of class 'com.mysql.jdbc.Driver' for connect URL 'jdbc:mysql//mysql-rfam-public.ebi.ac.uk:4497/Rfam':
Hi Hamid, I know what you mean. However, I guess you can get as confused with code as with graphical user interfaces if you're not following clean code practices. If you want to get into ways on how to "write" clean NiFi flows, you can watch this video: th-cam.com/video/v1CoQk730qs/w-d-xo.html&ab_channel=NiFiNotes
Hi Stefen , thank you so much for this video.. all the information shared is just great. If you could find some time to upload more videos on NIFI it will be really great !!
Thanks so much for the feedback. Highly appreciate it. What would you be interested in specifically?
@@condla If you could share us some knowledge on building our own customised processors , It will be wonderful
Wonderful video Stefen. This one made my day. Thanks for sharing your knowledge 👍😊
Thanks, I wish I had more time to create more videos
Thanks for sharing the knowledge... its really good
Excellent video, thanks! A question: max value property lets us get new records, but what if we wanted to get updated records as well? Say we have a 'last updated' column with a timestamp to facilitate this. Should we then build another pipeline for updates?
You can add multiple columns to check for both new and updated records based on the timestamp in those columns.
@@condla Can you please show how and which version of driver should be installed?
Excellent explanation
Thank you
Stark.. Danke sehr. Nifi hat sich bisl geändert aber mit deiner Anleitung war auch das kein Problem. Ohne die...phuu
Gerne und freut mich. Ist schon etwas älter das Video 😊
Gracias Stefan!!!!
😀
Thanks for the feedback
@Stefan Dunkler: Can you please show how and which version of driver should be installed?
Thanks so much!!! The best video.
You're welcome
Hi Stefan and thx for video. How can I know if data was inserted or deleted? Because in both cases I get just object of data
Nice..
I want to connect to postgresql db which is secured by ssl. Since there is no property on DBCPConnection Pool controller to provide ssl deatils, how we are able to connect to db ? Can we pass sslcert and sslmode in query param of database url property ?
In the answer of the following thread is a link that should help you on this issue. Let me know how it goes.
community.cloudera.com/t5/Support-Questions/QueryDatabaseTable-giving-error-while-pulling-data-from/td-p/220949
@@condla Thanks for info.
i tried by passing ssl details in query params for 'database connection url' property (jdbc:postgresql://host:port/databaseName?ssl=true&sslrootcert=C:\Certificate\DEV.cert&sslmode=verify-full ).
But getting following exception ..
1. Caused by: org.postgresql.util.PSQLException: SSL error: Received fatal alert: handshake_failure .
Stefan, I am trying to connect to Cassanda with help of Query Cassandra processor, is there any way we can fetch records using conditions in query , data can be passed from outside..
Hi sir can we put the resultant data into another database! for example can I put that data into some other sql database table ? basically my requirement is to make replica of database.
Sure, drag another processor into the board that has a name like "Put....." e.g. PutSQL to write it to a system that talks SQL. You need to add the jdbc driver just like you add it when you query it. There's plenty of other Put processors that use the Write APIs of many other databases.
@@condla thanks a lot ♥️
Excellent!
Hi Stefan, I am new in Apache NIFI, I am trying to fetch data from sqlite and want to store in csv file, please share tutorial for it?
Thanks!
How can i fix this error Cannot create JDBC driver of class 'com.mysql.jdbc.Driver' for connect URL 'jdbc:mysql//mysql-rfam-public.ebi.ac.uk:4497/Rfam':
stefan i am unable to connect
I find graphical programming more difficult than text based programming. In the former, I often get confused using the user interface.
Hi Hamid, I know what you mean. However, I guess you can get as confused with code as with graphical user interfaces if you're not following clean code practices. If you want to get into ways on how to "write" clean NiFi flows, you can watch this video: th-cam.com/video/v1CoQk730qs/w-d-xo.html&ab_channel=NiFiNotes
nice,
thanks
Excellent!