Hi, thanks so much for your videos. I learned so much from you. However in a real life project the lookup table had a milion and half records and the number of records that need to be be updated is less than 100. So trying to join a table with less than 100 recs with a table with 1.5 milion records is very, very slow and then in bombed out with an java.lang.outOfMemoryError: java heapspace. In sql server joining such tables takes a millisecond or something... How can I fix this in Talend? Thanks.
Thank you for the very helpful video. But I have a problem using tBigQuery. It has no action to update data. There are only 3 options: truncate, Append and empty. I want to update to tBigQuery, how do I do that?
Hello Sir, I'm Chetan Actually i have a dbt while I created my Db connection and retrieved when dragging it in the work space I can't see the options like Oracleinput, oracle output. (Components) I can see very less components at that time. But while i search with typing the letters I can find it. So, what's the issue ? Can uh plz let me know that.
Hi Brother, first of all, thanks a ton for all your hard work and effort. what next? Are you going to cover any other topic? Please let me know if possible to make a video on a real project ( complex scenario ) so it will be helpful Thanks! Please share your linkedin profile if possible.
I am getting this error Exception in thread "main" java.lang.NoSuchMethodError: org.apache.commons.lang3.reflect.TypeUtils.toLongString(Ljava/lang/reflect/TypeVariable;)Ljava/lang/String; when I am using tdboutput for snowflake
hi brother, I have a simple MS SQL database that i want to take MY SQL offline. i have 12 data in MS SQL database and in talend database configuration I configure action on table: Create table, action on data: insert. Then i insert 5 more data to MS SQL and changed talend database configuration action on table: default, action on data: insert and update. I want to take that 5 newly changed or inserted data from MS SQL to MY SQL. not the whole lot. I assign primary key. I cannot or not want to use tMAP as i have one table from mssql to mysql. your advise or help is appreciable
u can use insert or update but u need to make sure the update keys and updatable/insertable columns in field_options present in advanced settings tab in database component.
@@cognitivehub2223 yes brother by following your this video I changed and configure that from advance settings tab but haven't any luck. is this possible for you to anydesk to my machine and have a look into the issue to solve please?
you can append it to the target table if you have similar columns in the target table. This doesn't require a primary key to insert. We generally use primary keys in order to avoid redundant data.
@@cognitivehub2223 I have 100 tables with different schema and I wanted to load to different database tables. The one thing I can use dynamic schema as I have different schema for each table. But is there any other way to solve this. Could you please create video for this job design. It will be helpful.
@@vru5696 For schema identification you can use dynamic schema but in order to identify all 100 table, u atleast need one key to identify table and corresponding target table. then based on that key u can able to insert into corresponding table. Thanks for Sharing.
@@javvadipravallika7686 Are you using any java components in the code.If not,please share the screen shot of the error component and error messgae.So that I can have a better idea.because normally we wont use set keywords in the above mentioned components.but let me know in which component you got the issue.Thanks
Thank you so much
clear explanation
Really helpful thank u so much
Hi, thanks so much for your videos. I learned so much from you. However in a real life project the lookup table had a milion and half records and the number of records that need to be be updated is less than 100. So trying to join a table with less than 100 recs with a table with 1.5 milion records is very, very slow and then in bombed out with an java.lang.outOfMemoryError: java heapspace. In sql server joining such tables takes a millisecond or something... How can I fix this in Talend? Thanks.
Thank you so much bro, it's really helpful
Glad it helped
Thank you for the very helpful video. But I have a problem using tBigQuery. It has no action to update data. There are only 3 options: truncate, Append and empty. I want to update to tBigQuery, how do I do that?
Hello Sir, I'm Chetan Actually i have a dbt while I created my Db connection and retrieved when dragging it in the work space I can't see the options like Oracleinput, oracle output. (Components) I can see very less components at that time. But while i search with typing the letters I can find it. So, what's the issue ? Can uh plz let me know that.
Hi Brother, first of all, thanks a ton for all your hard work and effort. what next? Are you going to cover any other topic? Please let me know if possible to make a video on a real project ( complex scenario ) so it will be helpful Thanks!
Please share your linkedin profile if possible.
my linkedin profile is "Inti Venkata Subba Rao".
Not able to paste the link here.
Sure will definitely do some projects if there is something interesting
@@cognitivehub2223 Thanks . sent you request.
Share u r number bro
@@suryareddy737 ping me on my linkedin profile or mail to ivsr517@gmail.com,there i will share my contact number.Thanks
Key cannot be a dynamic column correct? Also then you would need the exact name for the column that matches the dbname.
Your Explanation is great! Can we undo the updates through Talend in the database table?
Thank You. I don't think we have that option but I am not 100% sure. I will confirm, if I got any evidence
@@cognitivehub2223 ohk. Thank you for the reply.
I am getting this error
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.commons.lang3.reflect.TypeUtils.toLongString(Ljava/lang/reflect/TypeVariable;)Ljava/lang/String;
when I am using tdboutput for snowflake
hi brother,
I have a simple MS SQL database that i want to take MY SQL offline. i have 12 data in MS SQL database and in talend database configuration I configure action on table: Create table, action on data: insert. Then i insert 5 more data to MS SQL and changed talend database configuration action on table: default, action on data: insert and update. I want to take that 5 newly changed or inserted data from MS SQL to MY SQL. not the whole lot. I assign primary key. I cannot or not want to use tMAP as i have one table from mssql to mysql. your advise or help is appreciable
u can use insert or update but u need to make sure the update keys and updatable/insertable columns in field_options present in advanced settings tab in database component.
@@cognitivehub2223 yes brother by following your this video I changed and configure that from advance settings tab but haven't any luck. is this possible for you to anydesk to my machine and have a look into the issue to solve please?
@@cognitivehub2223 hello brother really need to solve this issue. so i am waiting for your reply. thanks
@@omardaraz1027 I can but currently I was little busy with my work. If you want u can share screenshot then i will update
@@cognitivehub2223 you have email or some other way that i can share screen shot?
sir how to insert table into destination table if we don't have any column that can be primary key in out table please help
you can append it to the target table if you have similar columns in the target table. This doesn't require a primary key to insert. We generally use primary keys in order to avoid redundant data.
I need your help in one scenario. Could you please help me?
Sure definitely. Please feel free to ask
@@cognitivehub2223 I have 100 tables with different schema and I wanted to load to different database tables. The one thing I can use dynamic schema as I have different schema for each table. But is there any other way to solve this. Could you please create video for this job design. It will be helpful.
@@vru5696 For schema identification you can use dynamic schema but in order to identify all 100 table, u atleast need one key to identify table and corresponding target table. then based on that key u can able to insert into corresponding table. Thanks for Sharing.
@@cognitivehub2223 could you please help me with job design.. its better if you can create a video on the same.
@@cognitivehub2223 I got this question in an interview and this should be done without dynamic schama.
There is an error like missing set keyword.what should i do?
May I know what you are trying to use?
Iam trying to update the values of a table where it updates the date , iam getting ora-00971 missing set keyword error which iam not able to resolve.
Iam using the tdboutput,tmap and a tfixed flow input components
@@javvadipravallika7686 Are you using any java components in the code.If not,please share the screen shot of the error component and error messgae.So that I can have a better idea.because normally we wont use set keywords in the above mentioned components.but let me know in which component you got the issue.Thanks