[100% Interview Question] Cache and Persist in Spark

Enroll to the Oracle DBA real time interview Question
====================================================
learnomate.org/courses/oracle...
WhatsApp me for Training - wa.link/gi7fv2
Starting new Oracle DBA batch in next week.
Please connect with me if you are interested.
Batch will start from next week
Time - 9am ist (11:30 PM EST)
Duration - 45 days
Daily one hour
Contact - [phone]
Email - [e-mail]
Fees - 15k (300$)
Two installments can be available
Syllabus -
www.learnomate.org/syllabus
Review -
www.learnomate.org/reviews
TH-cam Channel
• Starting NEW REAL TIME...
Registration
https:www.learnomate.org/register
WhatsApp me
wa.link/usfz52
Facebook Page
/ learnomate
LinkedIn
/ ankushthavali Contact forrm for Real time database training
================================
forms.gle/pTwgeWPLW3cjr7hr5
REal time Oracle DBA Training Syllabus
=======================
www.blognow.in/oracle-dba-bes...
My channel is mainly helpful for those who are looking to start their career in Oracle DBA | Oracle databases administration technology.
Channel will provide you in depth understanding for all oracle database concept.You will find the TH-cam channel helpful for cracking oracle database administration interview. The explanation is clear and practically represented.
Please fill the google form to get Job alerts, important documents, Sample Resume
forms.gle/JEfZLofDM4y5wuMa7
FOLLOW ME
============
LinkedIn : / ankushthavali
Instagram: / ankushthavali
Facebook : / blognow.in
Subscribe: / engineerankush
Training : blognow.in/oracle-dba-trainin...
Training Review: blognow.in/student-review/
Contact:
Email: [e-mail]
Mob No: [phone]
Please donate on below link if you think I am helping you with your career.
PayPal: www.paypal.me/ankushthavali
GooglePay : 9960262955
Account No : 31347845762 IFSC: SBIN0012311
If you are planning to buy laptop for oracle dba practice then you can refer the below laptop configuration.
Following are the best laptop for oracle dba practice
amzn.to/2LldXaI
amzn.to/30FdDIn
amzn.to/2Qm0Vyh
amzn.to/352eZQQ
amzn.to/32RYbda
How I record Video | Click on link if you wish to buy
==========================================
Mic
amzn.to/2Yh5Lw1
My DSLR Camera - Canon 200d Mark ||
=================================
amzn.to/34qV7FD
Tripod
======
amzn.to/2xh97Dw
Please use the following link to get unlimited videos.
============================================
www.skillshare.com/r/profile/...
Below is the coupon code for my skillshare video.
=========================================
www.udemy.com/draft/1412310/?...
Connect SqlDeveloper with Oracle 18C
================================
• Connect SqlDeveloper w...
Import XSLX/CSV File To PostgreSQL database
======================================
• Import XSLX/CSV File T...
Basic Unix Commmand for Oracle DBA
================================
• Basic Unix Commmand fo...
Calling Sqlplus using shell script and saving the sqlplus output in Logfile
===========================================================
• Calling Sqlplus using ...

[@balajichandramohan9707]

Hi sir, this is topic related to Oracle.

[@mani.kandan4020]

Nice video bro ....... I'm from tamil nadu

[@DS-bo5wu]

Hi Ankush, Thanks for the video, I have one query. suppose if I am using Persist(StorageLevel.DISK_ONLY), then how will it improve Spark application performance because if this application will need this data again then it will have to read from DISK only, so there will be more I/O operations with the disks and as we all know spark doesn't do unnecessary I/O operations with the disks and it is the main reason why Spark is better than MapReduce.

[@learnomate]

Simple example - you may have one relatively great RDD rdd1 and one smalled RDD rdd2. You want to store both of them.
If you apply persist MEMORY_AND_DISK on both, then both of them will be spilled to disk resulting in slower reaed.
But you may take a different approach - you may store rdd1 with DISK_ONLY. It may just so happen that thanks to this move you can store rdd2 right in the memory with cache() option and you will be able to read it faster.

[@DS-bo5wu]

@@learnomate Thanks for the clarification

[@pardeep657]

Hi Ankush, how long the cached data will survive in memory, does it automatically gets removed when the session ends?

[@ADY_SR]

yes it does if you dont un cache it manually

[@mani.kandan4020]

Make hbase video bro

[@rohinidhorje8269]

Aws step function