Easy Hive Installation Guidelines: Step-by-Step Tutorial for Hadoop on Windows 10/11 | Kundan Kumar|
ฝัง
- เผยแพร่เมื่อ 20 ส.ค. 2024
- In this video, I will guide on installing Apache Hive for Hadoop 3.2.4! and we'll walk you through each step to set up Hive, including prerequisites, configuring Apache Derby, setting environmental variables, and more.
Download Essential Files:
1) Apache hive installation Guidelines on windows: drive.google.c...
2) To download derby : db.apache.org/...
3) To download HIVE : archive.apache...
4) 2) To download hive-site.xml files: drive.google.c...
5) To download wget : eternallybored...
6) To Download Windows Version of Hive Bin folder command: wget -r -np -nH --cut-dirs=3 -R index.html svn.apache.org...
Please you do subscribe my channel.
Thank you for watching this video.
![เบิ้ล ปทุมราช - สาวสอง ( มีมี่ของอ้าย ) ft. ตาต้า,ต้องเต [OFFICIAL MV]](http://i.ytimg.com/vi/mqlMjnP08XI/mqdefault.jpg)
Top-notch tutorial.I was able to successfully install HIVE👌Looking forward to other helpful tutorials, Thanks
Happy to know that this tutorial helped you to install and configure HIVE successfully. Enjoy your learning. Yes soon I will publish a new video on bigdtaa tools 🔥
This video tutorial is very easy to understand and all steps are well demonstrated. It is very helpful ❤
I am glad to know that this video is very easy to understand and it was helpful to you ❤️
Sir, with your help I am done with these steps. Could you please share steps to connect the hive table with the Tableau tool for data visualization
Hello dear Adyaa. Glad to know that you are done with these hive steps and thank you so much for watching this video ❤️. Let me work on the video to connect the Hive to the Tableau tool. Please do subscribe to the channel if you have not yet so that you don't miss notification of the upcoming video.
Thank you for the detailed and helpful video on installing HIVE, Sir! It was incredibly useful and made the installation process much clearer.
However, I encountered an issue where some Hadoop processes run successfully (like NodeManager and DataNode), but others do not (like NameNode and ResourceManager). Could this discrepancy be causing issues with creating databases in Hive? If so, what steps would you recommend to ensure all necessary Hadoop processes are running smoothly?
I am glad to know that this video tutorial is very helpful. Please provide me a few details before I guide you to fix.
1) check Hadoop demons by using jps command then check still namenode and resource manager running? I think it runs once then closes automatically??
@@kundankumar011 datanode is not running but everything else is running as well as hive!
The logs indicate an incompatible cluster ID error!
@@uweragisele1489 try to create ba database on hive. Use hive command "create database Gisele" Then use command "show databses;" just to confirm all is working. Because I am suspecting dear. Datanode is the storage of the hive databases and table based on hive configuration. Let me know after performing the above commands.
@@kundankumar011 All is working, Sir! show databases; create database; use database; create table; show tables; .... all these commands are working
@@uweragisele1489 cool. Then enjoy. Rest we will see later on
Hello sir , when try to run StartNetworkServer -h 0.0.0.0 it displays an error message the command is not recognised as an internal or external command or operable program
Hi dear.
1) Ensure Apache Derby is installed on your system. If it is not installed, in this video it shown how to download and configure
2) Add Environmental variable DERBY_HOME : C:\derby (This based on my computer and shown in video)
3) Add C:\derby\bin to the Path of Environmnetal variable. This is because the StartNetworkServer script is typically located in the bin directory of the Derby installation.
N.B: It's always good practice to re-start all service. After making the change, don't forget to reopen Command prompt as Administrator
Hope this will help you.
This worked for me Thanks.
@@onem3929 Glad to know it worked for you as well ❤️
Thank you for the good tutorial. I am facing this error "Missing hadoop installation: C:\hadoop-3.3.6\hadoop-3.3.6\bin must be set" after running this hive --service schematool --dbType derby -initSchema
I am glad to know that this tutorial is good❤️. As per error shared. I can see your Hadoop version is 3.3.6. I believe your Hadoop is working fine. But Hive is making an issue. Hive Version we are using is Hive 3.1.2 which is not compatible with the Hadoop 3.3.6 version it seems. For me I have used Hadoop 3.2.4 version which is compatible with Hive3.1.2 . This below link may help you to download Hadoop 3.2.4. otherwise you need to research Compatible Hive version of Hadoop 3.3.6. hope you got me well dear. archive.apache.org/dist/hadoop/common/
Addition to this, you can find on my channel video Easy Hadoop Installation on windows 10/11 (in this video, I am installing Hadoop 3.2.4 .
@@kundankumar011 I used Hive 4.0.0 which is compatible with hadoop 3.3.6 but still I am facing the same problem
@@ishimwejoshua2766 dear Joshua. If it's really compatible and Hadoop is well configured the same error should not be promoted. I really wonder.
Hello Sir, i was trying to run this command "hive --service schematool -dbType derby -initSchema" i am encountering this error: SLF4J: Class path contains multiple SLF4J bindings and Exception in thread "main" java.lang.UnsupportedOperationException: 'posix:permissions' not supported as initial attribute
Hello dear. this is warning it seems, not an error. if you want to fix this warning you need to navigate to C:\hadoop\share\hadoop\common\lib and remane slf4j-reload4j-1.7.35.jar as slf4j-reload4j-1.7.35.jar.bak (In short we are keeping as a backup)
@@kundankumar011 Thank you:)
@@PhilemonIransubije Welcome❤
@@kundankumar011 , Dear Sir , the file seem not to be editable since they are in use. any other procedures ?
@@EmmaBemmly Just shutdown/close all the services then open the file to edit thereafter restart the all the required services dear❤️
Sir, plz upload Hbase installation and table creation
Yes, dear. I will try to find the time to work on your requested topic: HBase installation and table creation. Thank you so much for the suggestion. ❤ If I’m not mistaken, have you subscribed to my channel? So that you cannot miss the new upload notifications.
when I entered jps I am missing the datanode, can you give any suggestion to rectify the problem
@@srijacheruku9903 thank you so much for watching this video but this raised here is related to Hadoop Not Hive. But still ok to answer here. Please Ensure that the DataNode is properly configured in the hdfs-site.xml and core-site.xml files. Please cross check. In addition to this, sometimes due to insufficient space datanode are not created. Please cross check the above mentioned file and all is ok. You can even restart the computer then check.
@@srijacheruku9903 hello dear. Hope you managed to fix the issues? Please do subscribe to my channel and encourage me l
while running this command i am getting error:
C:\hive\bin>hive --service schematool -dbType derby -initSchema
"Missing hadoop installation: C:\hadoop\bin must be set"
How can we resolve this error
Thank you so much for watching this video dear. But Sorry that you are facing issues . As per your error shared. It shows that your Hadoop installation/configuration is not done. Ensure that you have installed/configured the Hadoop on your machine. You can find the Hadoop installation video on my channel dear. Please do you subscribe to my channel and encourage me dear.
Datanode and Namenode start nhi ho raha hai. Cmd me error show krr raha hai. Please solution btaye.
Hello Ankit. Thank you so much for watching this video. App error ko comment copy paste kar do. Tab app ko help karta Hoon.
Hi @kundankumar011 , I am facing this error and I installed everything as you said but I'm facing this error , could you please explain this a bit and I have been trying this from yesterday , C:\hive\bin>hive --service schematool -dbType derby -initSchema
"Missing hadoop installation: C:\hadoop\bin must be set"
Dear Sai Nirmal. Sorry to know that you are facing error. The error "Missing hadoop installation: C:\hadoop\bin must be set" indicates that Hive is unable to locate the Hadoop installation. This usually happens because the Hadoop environment variables are not correctly set up, or Hadoop is not installed in the expected location. But i believe your Hadoop Deamons are running if its running then based on my experience it could be Hive Version Compatibility issues with Hadoop you have installed on your machine. I have used Hadoop 3.2.4 Version on my machine. Hope you get me well dear.
@@kundankumar011 Thank you for your response , I have done everything as in the video kumar but I cannot fix this and I checked other comment and "I change .jar to .bak file" , Now I am unable to run commands in HDFS, could you please tell me how to change the ".bak file to .jar file" again, and I used the same version from the Google Drive's which you used, please help , I am trying this from long time ..
@@SaiNirmalReddyGavini-k2oI am very sorry to know still you are experiencing issues. Just try to remove .bak extension and maintain .jar file. For example: Navigate to the directory where the .jar.bak file is located.
Right-click on the file and select Rename.
Remove the .bak extension and press Enter. Hope this simple way can help you if it is not working then you can go to zip file hadoop extract somewhere else and just copy the jar file you renamed and paste it here. Let me know which version of Hadoop you are using dear?
@@kundankumar011 Thankyou kumar, I resolved the jar error and I am using the same Hadoop 3.2.4 version which you shown in the video ,but I can't understand why I am unable to set the error of hive - C:\hive\bin>hive --service schematool -dbType derby -initSchema
"Missing hadoop installation: C:\hadoop\bin must be set"
do we have any other way , please tell me I will work on it until I get this , thankyou..
@@SaiNirmalReddyGavini-k2o Good to know that you managed to recover your jar file. To fix raised issue can you try this and see if it helps to you.
Set Variables Temporarily for the Session: Try setting the environment variables temporarily for the current command prompt session and then run the Hive schema tool command again. Run below commands:
set HADOOP_HOME=C:\hadoop
set PATH=%PATH%;%HADOOP_HOME%\bin
hive --service schematool -dbType derby -initSchema
if this also doesn't help you. Please share with me content of "hive-site.xml" file. Just copy paste the content of hive-site.xml file in comment box
Nice job on a video pls with error getting this
ERROR StatusLogger No log4j2 configuration file found. Using default configuration: logging only errors to the console.
Exception in thread "main" java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
Thnak you for saying the vide os is Nice. But sorry to know that you are facing the issues: Let me share the steps that may help to fix this issues. The error you are encountering during the installation and configuration of Apache Hive, specifically ERROR StatusLogger No log4j2 configuration file found. Using default configuration: logging only errors to the console. Exception in thread "main" java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)v, suggests that there are issues related to logging configuration and class compatibility.
Here are the steps to resolve this:
1. Fix the Log4j2 Configuration Issue
Create a Log4j2 Configuration File
Create a log4j2.properties file in the Hive configuration directory (e.g., HIVE_HOME/conf) with the following content:
status = error
name = PropertiesConfig
filters = threshold
filter.threshold.type = ThresholdFilter
filter.threshold.level = debug
appenders = console
appender.console.type = Console
appender.console.name = STDOUT
appender.console.layout.type = PatternLayout
appender.console.layout.pattern = %d{HH:mm:ss.SSS} [%t] %-5level %logger{36} - %msg%n
loggers = console
logger.console.name = org.apache.hive
logger.console.level = debug
logger.console.additivity = false
logger.console.appenderRef.stdout.ref = STDOUT
rootLogger.level = info
rootLogger.appenderRefs = stdout
rootLogger.appenderRef.stdout.ref = STDOUT
Then, set the HIVE_LOG4J2_CONF environment variable to point to this file:
HIVE_LOG4J2_CONF=$HIVE_HOME/conf/log4j2.properties
2. Resolve NoSuchMethodError Related to Guava Library
The NoSuchMethodError typically indicates a version mismatch between the Guava library used by Hive and another version of Guava that is being loaded by your application. To resolve this:
Check for Multiple Guava JARs
Ensure there are no multiple versions of Guava JARs in your classpath. You can check this in the hive/lib directory.
Use a Compatible Guava Version
If there are multiple versions, remove the conflicting one and ensure only the compatible version is present.
Check Compatibility: Ensure that the versions of Hadoop, Hive, and other dependencies are compatible with each other. I am uisng Hadoop 3.2.4 and Hive 3.1.2 which captaible version of Hadoop3.2.4.
@@kundankumar011 thanks so much for your help will do that :)
thanks :)
@@kangja9033 pleasure ❤️. Please do subscribe to my channel and encourage me dear