![]() ![]() Step 4: After tarball extraction, we get Spark directory and Update the SPARK_HOME & PATH variables in bashrc fileĮxport SPARK_HOME=/home/slthupili/INSTALL/spark-2.x.x-bin-hadoop2. sudo mv spark-3.1.1-bin-hadoop2. tar -xvzf spark-3.1.1-bin-hadoop2.7.tgz Finally, move the extracted Spark directory to /opt directory. Step 3 : After that Extract the Downloaded tarball using below command: Now open your terminal and switch to where your downloaded file is placed and run the following command to extract the Apache Spark tar file. Step 2: Tar ball file into your Hadoop directory Step 1 : Download spark tar ball from Apache spark official website Java version must be greater than 1.6 version Now you can install the JDK for Java installation sudo apt-get install default – jdk Update the packages on Ubuntu using sudo apt-get updateĪfter entering your password it will update some packagesĢ. Nowadays mostly working and execute the data in Streaming, Machine Learning.ġ. Developed in Java, Scala, Python and R languages. ![]() Compare with Hadoop Map Reduce 100 times faster for data processing. ![]() Spark is a framework and in-memory data processing engine. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |