Error Opening Job Jar Hadoop-examples-1.0.3.jar
here for a quick overview of the site Help Center Detailed answers to any questions you might have Meta Discuss the workings and policies of this site About Us Learn more about Stack Overflow the company Business Learn more about hiring developers or posting ads with us Stack Overflow Questions Jobs Documentation Tags Users Badges Ask Question x Dismiss Join the Stack Overflow Community Stack Overflow is a community of 4.7 million programmers, just like you, helping each other. Join them; it only takes a minute: Sign up Hadoop preinstalled example Jars up vote 1 down vote favorite I just successfully set up Hadoop on my local machines. I am following one of the examples in a popular book I just bought. I am trying to get a list of all hadoop examples that comes with installation. I type the following command to do so: bin/hadoop jar hadoop-*-examples.jar Once I enter this I am supposed to get a list of Hadoop examples right? However all I see is this error message: Not a valid JAR: /home/user/hadoop/hadoop-*-examples.jar How do I solve this problem? Is it just a simple permission issue? hadoop error-handling terminal share|improve this question edited May 15 '14 at 1:39 hichris123 6,551113257 asked Sep 15 '13 at 4:23 GoldenSugar 33421130 add a comment| 3 Answers 3 active oldest votes up vote 0 down vote This is most probably configuration issue or usage of invalid file paths. Most probably the name of hadoop-*-examples.jar is not correct because in my version of Hadoop (1.0.0) file name is hadoop-examples-1.0.0.jar. So I have run following command to list all examples and it works like charm: bin/hadoop jar hadoop-examples-*.jar An example program must be given as the first argument. Valid program names are: aggregatewordcount: An Aggregate based map/reduce program that counts the words in the input files. aggregatewordhist: An Aggregate based map/reduce program that computes the histogram of the words in the input files. dbcount: An example job that count the pageview counts from a database. grep: A map/reduce program that counts the matches of a regex in the input. join: A job that effects a join over sorted, equally partitioned datasets multifilewc: A job that counts words from several files. pentomino: A map/reduce tile laying program to find solutions to pentomino problems. pi: A map/reduc
2013 at 3:51 pm Hello,I'm trying to install RHadoop on a test hadoop cluster with two nodes.I tried to run a simple mapreduce based on the tutorial in the wiki onGitHub:Sys.setenv(HADOOP_HOME="/opt/ibm/biginsights")Sys.setenv(HADOOP_CMD="/opt/ibm/biginsights/IHC/bin/hadoop")Sys.setenv(JAVA_HOME="/opt/ibm/biginsights/jdk/jre")Sys.setenv(HADOOP_HOME_WARN_SUPPRESS="TRUE")small.ints = to.dfs(1:1000)mapreduce(input = small.ints,map = function(k, v) cbind(v, http://stackoverflow.com/questions/18808895/hadoop-preinstalled-example-jars v^2))Unfortunately I get an Exception:Sys.setenv(HADOOP_HOME="/opt/ibm/biginsights")Sys.setenv(HADOOP_CMD="/opt/ibm/biginsights/IHC/bin/hadoop")Sys.setenv(JAVA_HOME="/opt/ibm/biginsights/jdk/jre")Sys.setenv(HADOOP_HOME_WARN_SUPPRESS="TRUE")small.ints = to.dfs(1:1000)Exception in thread "main" java.io.IOException: Error opening job jar: loadtbat org.apache.hadoop.util.RunJar.main(RunJar.java:90)Caused by: java.util.zip.ZipException: error in opening zip fileat java.util.zip.ZipFile.open(Native Method)at java.util.zip.ZipFile.(JarFile.java:149)at java.util.jar.JarFile.(RunJar.java:88)Warning message:In to.dfs(1:1000) : Converting to.dfs argument http://grokbase.com/t/gg/rhadoop/136vvw7sts/798-problems-with-the-installation-of-rhadoop-java-io-ioexception-error-opening-job-jar-loadtb to keyval with a NULL keymapreduce(+ input = small.ints,+ map = function(k, v) cbind(v, v^2))Exception in thread "main" java.io.IOException: Error opening job jar: -Dat org.apache.hadoop.util.RunJar.main(RunJar.java:90)Caused by: java.util.zip.ZipException: error in opening zip fileat java.util.zip.ZipFile.open(Native Method)at java.util.zip.ZipFile.(JarFile.java:149)at java.util.jar.JarFile.(RunJar.java:88)Error in mr(map = map, reduce = reduce, combine = combine, vectorized.reduce, :hadoop streaming failed with error code 1I'm using Hadoop 1.0.3 and R 3.0.1.What could be the reason for this Exception?Best regardsEvangelos--post: rhadoop@googlegroups.com ||unsubscribe: rhadoop+unsubscribe@googlegroups.com ||web: https://groups.google.com/d/forum/rhadoop?hl=en-US---You received this message because you are subscribed to the Google Groups "RHadoop" group.To unsubscribe from this group and stop receiving emails from it, send an email to rhadoop+unsubscribe@googleg
setting up a pseudo-distributed, single-node Hadoop cluster backed by the Hadoop Distributed File System, running on Ubuntu Linux. Are you looking for the multi-node cluster tutorial? Just head over there. http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/ Hadoop is a framework written in Java for running applications on large https://qnalist.com/questions/341269/error-opening-job-jar clusters of commodity hardware and incorporates features similar to those of the Google File System (GFS) and of the MapReduce computing paradigm. Hadoop’s HDFS is a highly fault-tolerant distributed file system and, like Hadoop in general, designed to be deployed on low-cost hardware. It provides high throughput access to application error opening data and is suitable for applications that have large data sets. The main goal of this tutorial is to get a simple Hadoop installation up and running so that you can play around with the software and learn more about it. This tutorial has been tested with the following software versions: Ubuntu Linux 10.04 LTS (deprecated: 8.10 LTS, 8.04, 7.10, 7.04) Hadoop 1.0.3, error opening job released May 2012 Figure 1: Cluster of machines running Hadoop at Yahoo! (Source: Yahoo!) Prerequisites Sun Java 6 Hadoop requires a working Java 1.5+ (aka Java 5) installation. However, using Java 1.6 (aka Java 6) is recommended for running Hadoop. For the sake of this tutorial, I will therefore describe the installation of Java 1.6. Important Note: The apt instructions below are taken from this SuperUser.com thread. I got notified that the previous instructions that I provided no longer work. Please be aware that adding a third-party repository to your Ubuntu configuration is considered a security risk. If you do not want to proceed with the apt instructions below, feel free to install Sun JDK 6 via alternative means (e.g. by downloading the binary package from Oracle) and then continue with the next section in the tutorial. 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 # Add the Ferramosca Roberto's repository to your apt repositories # See https://launchpad.net/~ferramroberto/ # $ sudo apt-get install python-software-properties $ sudo add-apt-repository ppa
thread "main" java.io.IOException: Error opening job jar: /usr/yogesh/wordcount.jar at org.apache.hadoop.util.RunJar.main(RunJar.java:90) Caused by: java.util.zip.ZipException: error in opening zip file at java.util.zip.ZipFile.open(Native Method) at java.util.zip.ZipFile.