How to Validate Millions of Record in ETL testing?

แชร์
ฝัง
  • เผยแพร่เมื่อ 1 ม.ค. 2025

ความคิดเห็น • 134

  • @dastageerpinjar5065
    @dastageerpinjar5065 ปีที่แล้ว +4

    Only thing i want to tell u ..i will wait for your videos.....and its worth of my time....thanks a lot for ur big help....
    These are very imp questions....
    Please dont stop.....people like me have life in this....

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว +2

      thank u so much for ur motivational words... it really help me to make new vdo... 🙏🙏😇

    • @Mehala_Vision
      @Mehala_Vision ปีที่แล้ว

      ​@@testerhoon28 mam please may I add subtitles in English

  • @chethanmotebennur7538
    @chethanmotebennur7538 2 ปีที่แล้ว +2

    How to Validate Millions of Record in ETL testing
    this is the only vido over YT which contains relevant explanation with respect to caption.

  • @palashmuley5755
    @palashmuley5755 2 หลายเดือนก่อน +1

    I must say ur videos are so help full . U are doing amazing work. soon it will top one channel for etl . keep it up . I have 4 yr of exp but still i learn from u .❤

    • @testerhoon28
      @testerhoon28  2 หลายเดือนก่อน

      Thankyou 😇

  • @Falcon-dt6li
    @Falcon-dt6li ปีที่แล้ว +1

    Best video for etl testing in TH-cam

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว

      thank you so much 🙂🙏

    • @Falcon-dt6li
      @Falcon-dt6li ปีที่แล้ว

      @@testerhoon28 not able to open your web page

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว

      @@Falcon-dt6li try once - www.testerhoon.com

  • @pushkardafre319
    @pushkardafre319 2 ปีที่แล้ว +4

    Same question asked in my recent interview but can't ,so can you elaborate 2 nd scenario in more detail with python

  • @ramaantony3849
    @ramaantony3849 ปีที่แล้ว +1

    Hi Sissy.. Thank you very much.. For this video..As a new joiner for ETL testing.. Very useful for me...

  • @mytoprecipes6759
    @mytoprecipes6759 ปีที่แล้ว +1

    Super mam.. I am wrkng as a qa engineer.. Its really helpful for me.. Plz do more videos..

  • @shraddhadhakad1154
    @shraddhadhakad1154 ปีที่แล้ว +1

    Hi, Can you tell me how to perform ETL testing on unstructured & semi-structured data

  • @chinmayamahapatra-l1h
    @chinmayamahapatra-l1h ปีที่แล้ว +1

    Grate one you are explained amazing

  • @chethanmotebennur7538
    @chethanmotebennur7538 2 ปีที่แล้ว +2

    lot of helpful video
    request to pls ans for following
    Request to Please provide answer for below scenarios frequently getting these queries @interview
    *) how to validate flat file in landing area.
    1.How to validate data and quality between landing and stage area
    if source is flat file and stag is db with out converting flat file to any other format.
    2.If json file has millions of record and this is source file
    and target is oracle table then what is your approach to validate and how to validate

    3.If oracle database is source and Teradata is Target and millions of record
    then how to compare without using any automation tool and not with sample data, need to validate full load data

    • @testerhoon28
      @testerhoon28  2 ปีที่แล้ว

      Yes, in this vdo i have explained that to validate the cross db data we have to use automation... bcoz it wont be possible to run sql query to validate 2 different server data..

  • @deveshpadgelwar8895
    @deveshpadgelwar8895 ปีที่แล้ว +1

    Thank you Mam... Really appreciate your efforts to share some real time scenario

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว

      okay 🙏

    • @deveshpadgelwar8895
      @deveshpadgelwar8895 ปีที่แล้ว

      How to coordinate with dev Team in case there is not mapping document ?

  • @kanchankumar-pt2lp
    @kanchankumar-pt2lp 9 หลายเดือนก่อน +1

    can you pls help how can we compare production data with test data,if not using any automated tool

  • @BillionDollerDream
    @BillionDollerDream 2 ปีที่แล้ว +1

    Wow... Was waiting for this

  • @gds3535
    @gds3535 ปีที่แล้ว +1

    Can automation possible between Oracle and big data?

  • @shekharpawar2536
    @shekharpawar2536 2 ปีที่แล้ว +1

    I’m getting frustrated learning SQL. Can you tell me how to master SQL and which topics of SQL needed for a etl tester.

    • @testerhoon28
      @testerhoon28  2 ปีที่แล้ว

      No need to get frustrated .. just focus on joins first, later learn subquery and some date, sub str functions... plssee my sql interview vdo and learn only those topics.. 👍

  • @azharmirza2013
    @azharmirza2013 ปีที่แล้ว +1

    mam can you please take practicle example of cross DB valiadtion

  • @chethanmotebennur7538
    @chethanmotebennur7538 2 ปีที่แล้ว +1

    and which is the commonly used automation tool for etl

    • @testerhoon28
      @testerhoon28  2 ปีที่แล้ว

      You could use any automation tool, in my organization we have build c# script and python script to validate the data..

  • @gds3535
    @gds3535 ปีที่แล้ว +1

    Does except query is possible between SQL server and bigdata?

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว +1

      no

    • @gds3535
      @gds3535 ปีที่แล้ว

      Can only count, duplicate and null validation done between SQL server and bigdata Hive?

  • @gds3535
    @gds3535 ปีที่แล้ว +1

    After getting defect we follow following procedure:
    1.check is reproducible
    2.email to developer
    3.then respond defect resolution type
    4.then we raise defect into hpal
    Is this right process ?

  • @uttambongarde6558
    @uttambongarde6558 9 หลายเดือนก่อน +1

    Suppose if you have 20GB text file data for the validation. How you are validated this data without using automation tool.

    • @testerhoon28
      @testerhoon28  9 หลายเดือนก่อน +1

      To test we have to do the sampling of data and test it

    • @uttambongarde6558
      @uttambongarde6558 9 หลายเดือนก่อน

      Thank you @@testerhoon28

  • @gds3535
    @gds3535 ปีที่แล้ว +1

    Can we handle million of record if database is same ?
    Sql server to sql server
    Using SQL server

  • @irfanmulla3801
    @irfanmulla3801 ปีที่แล้ว +1

    how to check this in mongo db

  • @rohitchavan3246
    @rohitchavan3246 ปีที่แล้ว +1

    Can you explain about flat file to database .

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว

      I already cover that in my below vdo link -
      th-cam.com/video/Khds_7JJWZM/w-d-xo.html

  • @rameshairaddi1647
    @rameshairaddi1647 2 ปีที่แล้ว +1

    please make brief video on different db validation

    • @testerhoon28
      @testerhoon28  2 ปีที่แล้ว

      pls check out all my vdos.. 🙏

  • @Kumar-w5q3v
    @Kumar-w5q3v ปีที่แล้ว +1

    Thanks a lot mam, can you please end to end automation video?

  • @a1geet
    @a1geet ปีที่แล้ว +1

    Thank you! Please share the sheet link python/c# sample code for cross db validation

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว

      okay will soon post the selenium code that used to validate the report... 🙏

  • @My-Research
    @My-Research 2 ปีที่แล้ว +1

    Nice video thanks sis....
    how to explain to interviewer this -- what is your testing approach if source have 1000 recods and out of this 900 loaded ??

    • @testerhoon28
      @testerhoon28  2 ปีที่แล้ว

      Approach -
      First validate all the 900 records are same in source or target.
      Second, find the missing records and reason for not loaded in target...

  • @gds3535
    @gds3535 ปีที่แล้ว

    How to get srs document or build from server?

  • @shreesha1111
    @shreesha1111 ปีที่แล้ว +1

    Thank you so much for vdo
    Please make complete sql from beginning to advance level course

  • @himanshumaggu6562
    @himanshumaggu6562 ปีที่แล้ว +1

    Can you make video on E2E flat file to database validation.Ifs very helpful for us.

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว

      i already made that vdo... pls chk my old vdos 🙏

  • @rohith3294
    @rohith3294 ปีที่แล้ว

    In the second scenario can we use Informatica tool and validate the data?

  • @harshitagrwal9975
    @harshitagrwal9975 ปีที่แล้ว +1

    can u provide the script mam?? please

  • @Kushi-v
    @Kushi-v ปีที่แล้ว +1

    Thank u so much for good explanation

  • @ISOOFMULLA-p5d
    @ISOOFMULLA-p5d 10 หลายเดือนก่อน +1

    Hi Mam, it was really helpful, can you please make a video on ETL Testing using Automation using python or Java.

  • @SANJAYYADAV-hm2bs
    @SANJAYYADAV-hm2bs 10 หลายเดือนก่อน +1

    Ma'am please make videos on ETL testing using cloud - Azure, AWS, GCP.

    • @testerhoon28
      @testerhoon28  10 หลายเดือนก่อน

      Sure will make 👍

  • @aniketkadam4167
    @aniketkadam4167 ปีที่แล้ว +1

    Hi mam,tableau tool pe ek vedio banado.

  • @tusharsonwane8468
    @tusharsonwane8468 ปีที่แล้ว +1

    Thank you so much... explain very nicely thank you mam

  • @akshayghadge299
    @akshayghadge299 2 ปีที่แล้ว

    for millions of records for cross db in excel what query we have to write for source and target ...it will take except ?

    • @testerhoon28
      @testerhoon28  2 ปีที่แล้ว

      No, we could not use sql query in cross db... to overcome this issue, we have to use automation

    • @akshayghadge299
      @akshayghadge299 2 ปีที่แล้ว +1

      @@testerhoon28 I am requesting you please make video on automation with end to end etl testing it will really help

  • @vinaykale5053
    @vinaykale5053 ปีที่แล้ว

    How we can validate data from different Databases manually? (without python)

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว

      Manually we have to do the sampling of data and validate.... it wont be possible to test millions of data manually... 🙏

  • @umakasibatla6389
    @umakasibatla6389 ปีที่แล้ว +1

    Thanks a lot excellent explanation can you go over python basic for testers.

  • @ud4747
    @ud4747 2 ปีที่แล้ว +1

    Mam please make video on end to end project on real time project

    • @testerhoon28
      @testerhoon28  2 ปีที่แล้ว

      pls check out all my vdos.. 🙏

  • @prajakta887
    @prajakta887 ปีที่แล้ว +1

    please mam .. make video on how to do automation using python script like how to check null, count .it will be helpfull for us

  • @pravinkashid3647
    @pravinkashid3647 ปีที่แล้ว +1

    Mam pls csharp ka code explain karo na hoga to..

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว

      wo code nahi show kar sakti 😰

    • @pravinkashid3647
      @pravinkashid3647 ปีที่แล้ว

      I have written code for automating count ,null,duplicate validation in python using pandas ...but the difference is that both the table present in same DB..

  • @Dope007
    @Dope007 ปีที่แล้ว

    mam how to do Source target mapping in excel, can u help?

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว

      pls see me data validation vdo... their i have explained it... 🙏🙏

  • @sJ-cl8sy
    @sJ-cl8sy หลายเดือนก่อน +1

    got it mam..
    ty

  • @sakshinaik05
    @sakshinaik05 ปีที่แล้ว

    Plz explain 1 end to end project on etl testing

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว

      I had already explained pls go thru my end to end vdo... 🙏

  • @SivaKumar-vm6iq
    @SivaKumar-vm6iq 2 ปีที่แล้ว +2

    Thank you for your effort. Can you please explain in English or you can add captions under the videos.

  • @Freakouts_and_found_Insane
    @Freakouts_and_found_Insane ปีที่แล้ว +1

    Can you please share your code How that works. That really helpful please madam share how that code is prepared

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว

      i have already shown that in my 2nd recent vdo.. pls chkout 🙏

  • @prabhatgupta6415
    @prabhatgupta6415 ปีที่แล้ว +1

    Mam we really need if u can provide us the script

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว

      even if I provide you the script... you would not be able to execute... it needs some environment to run 🙏

    • @prabhatgupta6415
      @prabhatgupta6415 ปีที่แล้ว

      Mam i dont waant to run ur script. I want to know the logic , will create my script.
      I know we need environment to run all this.
      @@testerhoon28

  • @lokeshankamreddi1626
    @lokeshankamreddi1626 2 ปีที่แล้ว +1

    Thank you sister 🙏

  • @thelayer5211
    @thelayer5211 2 ปีที่แล้ว +2

    This is not enough for us we need more details video on cross db testing as well as we need test closure report

  • @kirankalliguddi3617
    @kirankalliguddi3617 2 ปีที่แล้ว +1

    Thanks a lot for KT!!

  • @KiranTrends
    @KiranTrends ปีที่แล้ว +1

    Kaha hai Automation madam..

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว

      wo is vdo me nahi hai... that vdo is yet to make.. 🙏

    • @prabhatgupta6415
      @prabhatgupta6415 ปีที่แล้ว

      Mam can u give us to script which u prepared to validate the data..
      so that we can replicate the thinngs@@testerhoon28

  • @motherschannelforvbac5673
    @motherschannelforvbac5673 ปีที่แล้ว +1

    Asked for me same question

  • @dpinched
    @dpinched ปีที่แล้ว

    English or not English? I can't decide😮

  • @manasenamanakarthavyam4150
    @manasenamanakarthavyam4150 2 ปีที่แล้ว

    Hi..thanks for sharing practical things like this can you share one more video to count check and minus check Null checks
    If any error record comes then how to debug..

    • @testerhoon28
      @testerhoon28  2 ปีที่แล้ว +1

      thank u for liking my content... i already made a vdo on that... pls chk my all end to end vdos..,🙏

    • @manasenamanakarthavyam4150
      @manasenamanakarthavyam4150 ปีที่แล้ว

      @@testerhoon28
      Can you please explain one or 2 business logics like direct mapping and derived mapping logic ../
      How firm a script by those logic
      Show practically plz....

  • @pravinkashid3647
    @pravinkashid3647 ปีที่แล้ว

    Mam pls automation code show karo na

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว

      code mai show ni kar sakti... 🤐

  • @durbandiary508
    @durbandiary508 ปีที่แล้ว +1

    can you please explain in english ? that will be really helpful please

  • @Dope007
    @Dope007 ปีที่แล้ว +1

    mam, can u connect and help me if u have time i can pay u 😇. whenever u r free...its just excel sheet data source target mapping I,
    pls give an indian time if u r free

    • @Dope007
      @Dope007 ปีที่แล้ว

      it will not take more than an hour i guess pls

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว

      Hello, i have already made vdo on source to target data validation in excel... pls see that vdo.. 🙏

    • @Dope007
      @Dope007 ปีที่แล้ว

      @@testerhoon28 mam ,
      Mere palle nahi pad raha ... 😅
      Pls

    • @Dope007
      @Dope007 ปีที่แล้ว

      @@testerhoon28 plzzzzzzzzzzzzzzzzzzzzzzz

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว

      @@Dope007 sorry am not providing 1-1 support..

  • @riyavenkat2637
    @riyavenkat2637 8 หลายเดือนก่อน +1

    Pls mak it in English r else try to give English caption

  • @NagalakshmiAmudala
    @NagalakshmiAmudala ปีที่แล้ว +1

    Hi Mam, Please explain in English that would be great help😊

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว

      yes i have started making vdos in english only... thatwas an old vdo 🙂

  • @thirumaleshkumarreddykalak7188
    @thirumaleshkumarreddykalak7188 ปีที่แล้ว +1

    Please do videos only in English

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว

      okay.. will try to add subtitle..

    • @thirumaleshkumarreddykalak7188
      @thirumaleshkumarreddykalak7188 ปีที่แล้ว

      @@testerhoon28 no subtitles, please do videos in English only so that people can understand easily and improve their communication as well

  • @vishalkoundal5008
    @vishalkoundal5008 ปีที่แล้ว +1

    Hello mam I mail you few things to understand but didnt get any reply could you please let me know how can I contact you?

    • @testerhoon28
      @testerhoon28  ปีที่แล้ว

      pls email me... iwill respond ..

    • @vishalkoundal5008
      @vishalkoundal5008 ปีที่แล้ว +1

      ​@@testerhoon28.. Hi I mail kindly reply Ns thxs for the response

    • @vishalkoundal5008
      @vishalkoundal5008 ปีที่แล้ว

      Hello I have few question related to etl I mailed you plz reply on that