Tutorial 6- Pyspark With Python-Introduction To Pyspark Mlib

แชร์
ฝัง
  • เผยแพร่เมื่อ 5 ม.ค. 2025

ความคิดเห็น • 27

  • @garvitmehta2593
    @garvitmehta2593 3 ปีที่แล้ว +6

    Hey Krish.... superb series that you are doing, I am trying to learn as much I can from your videos. Please do continue this good work. 👍

  • @usaikiran96
    @usaikiran96 2 ปีที่แล้ว +1

    Hi Krish. Kudos to all your efforts for this good work. Kindly make a video on how to perform clustering, apply clustering algorithms, do topic modelling, apply NLP using PySpark. Really need it. Thank you

  • @alihaiderabdi9939
    @alihaiderabdi9939 3 ปีที่แล้ว

    superb sir, we are waiting for end-to-end development and deployment using pyspark. Keep going!!!! Thanks a lot sir!!!

  • @abhayjain5775
    @abhayjain5775 3 ปีที่แล้ว

    You are doing great work. So easy to understand yout tutorials.

  • @ashishbhatnagar9590
    @ashishbhatnagar9590 3 ปีที่แล้ว

    awesome simply awesome. Thanks a lot for sharing

  • @samimtu8994
    @samimtu8994 3 ปีที่แล้ว

    big fun bro. it is all clear when you speak, please prepare a
    video on multimodal meme detection

  • @balochcode
    @balochcode 2 หลายเดือนก่อน

    Hi Kirsh, I dont know how to fix this issue in my jupyter lab: when I do : from pyspark.ml.feature import VectorAssembler I get: ModuleNotFoundError Traceback (most recent call last)
    Cell In[5], line 1

  • @ajaysaikiranpenumareddy9809
    @ajaysaikiranpenumareddy9809 3 ปีที่แล้ว +1

    God Bless U sir

  • @thourayasboui376
    @thourayasboui376 2 ปีที่แล้ว

    Hi ! I got this error when executing "output=featureAssembler.transform(training)" age does not exist, available: name, age..., any help ??

  • @SANDYS-w1i
    @SANDYS-w1i ปีที่แล้ว

    randomsplit is not working,showin NoneType' object has no attribute 'randomSplit'

  • @abhijeetjain2098
    @abhijeetjain2098 3 ปีที่แล้ว

    Thank you sir 👍

  • @meenakshipandey1253
    @meenakshipandey1253 3 ปีที่แล้ว

    Hi Krish. How can I populate table in RDS from glue pyspark job..I have one table in RDS MySQL Arora db
    Now I want to insert some record in that table but using glue spark job

  • @ajaysaikiranpenumareddy9809
    @ajaysaikiranpenumareddy9809 3 ปีที่แล้ว

    'function' object has no attribute 'read' this is error i am getting when trying to read data set

  • @darshanayenkar
    @darshanayenkar 2 ปีที่แล้ว

    error: [WinError 10061] No connection could be made because the target machine actively refused it

  • @vipulbharadwaj618
    @vipulbharadwaj618 3 ปีที่แล้ว +1

    Hi Krish, great video, just wanted to ask why can't we use sklearn ML algorithm with pyspark dataframe?... that way we can use spark data handling capabilities along with highly optimized sklearn ML algorithms

    • @jimbocho660
      @jimbocho660 3 ปีที่แล้ว +1

      Pyspark's data handling capabilities come from the fact that it has been designed to work on parallel clusters. Sklearn, on the other hand, only works on single machines. The machine learning algorithms implemented in MLlib had to be parallelized to take advantage of parallel architectures. Sklearn's machine learning algorithms have not been parallelized.

  • @shaik906
    @shaik906 3 ปีที่แล้ว +1

    I wan talk to you how will i approach to you please reply

  • @shaik906
    @shaik906 3 ปีที่แล้ว +1

    I wan talk to you how will i approach to me please reply

  • @vashistnarayansingh5995
    @vashistnarayansingh5995 3 ปีที่แล้ว

    Can anyone tell me why there is 2 coeficent as y = mx+c has only one coeficent M and one intercept C?

    • @gauravtripathi562
      @gauravtripathi562 ปีที่แล้ว

      c is also a kind of coefficient only......in maths people call it as intercept....

  • @fairuzshadmanishishir8171
    @fairuzshadmanishishir8171 3 ปีที่แล้ว

    please make videos on distributed training

  • @hardikvegad3508
    @hardikvegad3508 3 ปีที่แล้ว +1

    Krish can you show us...HOW WE CAN USE PYSPARK IN A DISTRIBUTED NETWORK?....Thank you.

    • @krishnaik06
      @krishnaik06  3 ปีที่แล้ว +1

      Yes upcoming videos

  • @kush88soni
    @kush88soni 2 ปีที่แล้ว

    What is Intercept?

  • @SanjayaKumarSahoo-gm5fu
    @SanjayaKumarSahoo-gm5fu ปีที่แล้ว

    Bro so much probably 😅😅