Error in Hadoop Installation
I'm just starting to use Linux and am trying to install Hadoop onto my computer. I downloaded the Hadoop file from a mirror recommended by Apache. The file is hadoop-2.2.0.tar.gz. Every website that I have read says that the command "tar -xzvf hadoop-2.2.0.tar.gz" should be able to unpack the file, but I keep getting the error "Error opening archive: Failed to open 'hadoop-2.2.0.tar.gz' "
I have tried both xzf and xvzf, neither seems to solve the problem. Was I perhaps supposed to do something before I unpacked the file? What is going on? (My computer is running OSX 10.9.3) Note: I just started using this forum so I wasn't sure which category I should have posted this thread under; excuse me if this is the wrong category. |
Quote:
|
Do you suggest I call Apple customer service?
|
well you paid for support (as part of your initial purchase) but i doubt they will be able to answer a question like that.
judging by the filename the command you are running should work. i have in the past tried to do programming on apple and stuff like netcat/gcc/... were surprisingly missing. can you show us the output of the file command to make sure it is indeed a gnu-zip. maybe the version of tar for apple is missing the functionality to de/compress |
Sorry for asking, but what exactly is the output of the file command?
|
man file.
just type in Code:
file <name-of-file> not to sound snarky but if you dont know the file command, how do you expect to administer a multi-node hadoop cluster with a distributed filesystem (in fact i'm not even convinced hadoop can be installed on mac -- i just looked it on duckduckgo: https://wiki.apache.org/hadoop/Runni...ode_Cluster%29) ? what are you trying to do. i am not trying to dissuade you but perhaps you are going about it the wrong way ? Quote:
|
No offense taken. This is my first computer science-related job so I'm still trying to find my way.
I'm almost certain that hadoop can be installed on Mac; there are a few websites with instructions on how to do so. I don't doubt that I could be going about it the wrong way though. Quote:
|
Macintosh:~ hadoop$ file hadoop-2.2.0.tar.gz
hadoop-2.2.0.tar.gz: cannot open `hadoop-2.2.0.tar.gz' (No such file or directory) The file is definitely in my Downloads folder. Should I move it somewhere else? |
maybe you are currenlty not in the rite directory (which would explain why its not finding it).
type in: Code:
pwd |
Macintosh:~ hadoop$ pwd
/Users/hadoop Macintosh:~ hadoop$ ls -al total 40 drwxr-xr-x+ 16 hadoop staff 544 Jun 25 20:32 . drwxr-xr-x 7 root admin 238 Jun 25 20:14 .. -rw------- 1 hadoop staff 3 Jun 25 20:12 .CFUserTextEncoding -rw-r--r--@ 1 hadoop staff 15364 Jun 25 21:06 .DS_Store drwx------ 4 hadoop staff 136 Jun 26 23:50 .Trash -rw------- 1 hadoop staff 404 Jun 26 23:50 .bash_history drwx------ 5 hadoop staff 170 Jun 25 20:34 .ssh drwx------ 3 hadoop staff 102 Jun 25 20:18 Applications drwx------+ 7 hadoop staff 238 Jun 25 21:16 Desktop drwx------+ 4 hadoop staff 136 Jun 26 18:39 Documents drwx------+ 8 hadoop staff 272 Jun 25 21:08 Downloads drwx------@ 45 hadoop staff 1530 Jun 27 14:58 Library drwx------+ 3 hadoop staff 102 Jun 25 20:12 Movies drwx------+ 3 hadoop staff 102 Jun 25 20:12 Music drwx------+ 3 hadoop staff 102 Jun 25 20:12 Pictures drwxr-xr-x+ 5 hadoop staff 170 Jun 25 20:12 Public Should I cd to Downloads? |
^ sure.
|
I think it worked! I didn't get an error this time. Thank you so much!!
In retrospect, this was a really dumb question to post. Sorry about that. I have 2 more questions: 1. After tar -xzf hadoop-2.2.0.tar.gz the instructions say to type chown -R hadoop hadoop-2.2.0.tar.gz. What does the second command do? 2. The Apache website says to verify the integrity of the downloaded hadoop file using the PGP signature. I didn't do this because I couldn't find the public keys and the asc signature file. Will this be an issue later on when I am configuring or using hadoop? |
Quote:
Quote:
|
Thanks!
So now I am supposed to edit the .bashrc file, but I can't locate the .bashrc file. Instructions say I should "update its appropriate configuration files instead of .bashrc" if I don't have a .bashrc file. (Although I'm pretty certain I do have a .bashrc file.) What are my appropriate configuration files, can you tell? Macintosh:hadoop hadoop$ cd /Users/hadoop/Downloads/hadoop-2.2.0/etc/hadoop Macintosh:hadoop hadoop$ ls capacity-scheduler.xml httpfs-site.xml configuration.xsl log4j.properties container-executor.cfg mapred-env.cmd core-site.xml mapred-env.sh hadoop-env.cmd mapred-queues.xml.template hadoop-env.sh mapred-site.xml hadoop-metrics.properties mapred-site.xml.template hadoop-metrics2.properties slaves hadoop-policy.xml ssl-client.xml.example hdfs-site.xml ssl-server.xml.example httpfs-env.sh yarn-env.cmd httpfs-log4j.properties yarn-env.sh httpfs-signature.secret yarn-site.xml |
All times are GMT -5. The time now is 07:27 AM. |