Apache Pig，程序运行问题

发布于 2024-12-23 08:57:09 字数 1624 浏览 1 评论 0原文

REGISTER /home/hadoop/pigg/trunk/contrib/piggybank/java/piggybank.jar;

-- Use the PigStorage function to load the excite log file into the raw bag as an array of records.
-- Input: (user,time,query) 
A = LOAD 'hadoop-test-data.csv' USING PigStorage(',') AS (user: chararray, site: chararray, view: int, click: int);

B = FOREACH A GENERATE org.apache.pig.piggybank.evaluation.string.UPPER(user);
-- Use the PigStorage function to store the results. 
STORE B INTO 'test-pig-result' USING PigStorage();

这是我的代码，我只是将我的用户名转换为大写。我已将此代码存储在 pig 根文件夹中的 test.pig 中。

我正在运行此代码，

java -cp $PIGGDIR/trunk/contrib/piggybank/java/piggybank.jar:$HADOOP_HOME/conf org.apache.pig.piggybank test.pig

但它不断抛出以下错误，

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/pig/piggybank/Main
    Caused by: java.lang.ClassNotFoundException: org.apache.pig.piggybank.Main
            at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
            at java.security.AccessController.doPrivileged(Native Method)
            at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
            at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
            at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
            at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
    Could not find the main class: org.apache.pig.piggybank.Main.  Program will exit.

但如果我运行grunt 上的相同程序然后它给我正确的输出。我已经尝试了 java -cp 的倒数第二个参数的所有可能的参数。

我还需要一个示例，其中使用 CSVLoader 类。

原文

REGISTER /home/hadoop/pigg/trunk/contrib/piggybank/java/piggybank.jar;

-- Use the PigStorage function to load the excite log file into the raw bag as an array of records.
-- Input: (user,time,query) 
A = LOAD 'hadoop-test-data.csv' USING PigStorage(',') AS (user: chararray, site: chararray, view: int, click: int);

B = FOREACH A GENERATE org.apache.pig.piggybank.evaluation.string.UPPER(user);
-- Use the PigStorage function to store the results. 
STORE B INTO 'test-pig-result' USING PigStorage();

This is my code , i am just converting my username fielded in uppercase.I have stored this code in test.pig in pig root folder.

I am running this code with ,

java -cp $PIGGDIR/trunk/contrib/piggybank/java/piggybank.jar:$HADOOP_HOME/conf org.apache.pig.piggybank test.pig

But its keep throwing following error,

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/pig/piggybank/Main
    Caused by: java.lang.ClassNotFoundException: org.apache.pig.piggybank.Main
            at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
            at java.security.AccessController.doPrivileged(Native Method)
            at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
            at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
            at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
            at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
    Could not find the main class: org.apache.pig.piggybank.Main.  Program will exit.

But if I run same program on grunt then it gives me proper output.
I have tried every possible param of java -cp's second last param.

And i also need an example , in which CSVLoader class is used.

分享到QQ

分享到微博