仅在映射器作业上写入值

发布于 2024-11-19 20:47:12 字数 664 浏览 0 评论 0原文

我目前正在从事 MapReduce 作业，我只使用映射器而不使用减速器。我不需要写出密钥，因为我只需要存储在数组中的值，并希望将其写出作为我的最终输出文件。如何在 Hadoop 上实现这一点？我只对只写出值感兴趣，而不是将键和值都写入输出。这些值位于数组中。谢谢

public void pfor(TestFor pfor,LongWritable key, Text value, Context context, int times) throws IOException, InterruptedException{
    int n = 0;
    while(n < times){
        pfor.pforMap(key,value, context);
        n++;
    }
    for(int i =0;i<uv.length; i++){
        LOG.info(uv[i].get() + " Final output");
    }
    IntArrayWritable edge = new IntArrayWritable();
    edge.set(uv);
    context.write(new IntWritable(java.lang.Math.abs(randGen.nextInt())), edge);        
    uv= null;
}

原文

I am currently working on a MapReduce Job which I am only using the mapper without the reducer. I do not need to write the key out because I only need the values which are stored in an array and want to write it out as my final output file. How can achieve this on Hadoop? Instead of writing to the output both the key and the value, I am only interested in writing out only the values. The values are in an array. Thanks

public void pfor(TestFor pfor,LongWritable key, Text value, Context context, int times) throws IOException, InterruptedException{
    int n = 0;
    while(n < times){
        pfor.pforMap(key,value, context);
        n++;
    }
    for(int i =0;i<uv.length; i++){
        LOG.info(uv[i].get() + " Final output");
    }
    IntArrayWritable edge = new IntArrayWritable();
    edge.set(uv);
    context.write(new IntWritable(java.lang.Math.abs(randGen.nextInt())), edge);        
    uv= null;
}

分享到QQ

分享到微博