Skip to content
Permalink
Browse files
HBASE-26398 CellCounter fails for large tables filling up local disk (#…
…3798)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
  • Loading branch information
stoty committed Oct 28, 2021
1 parent 45f76a4 commit 60254bc18476195d60669ee4a357aee7d68797c9
Showing 1 changed file with 1 addition and 1 deletion.
@@ -216,14 +216,14 @@ public static Job createSubmittableJob(Configuration conf, String[] args)
Scan scan = getConfiguredScanForJob(conf, args);
TableMapReduceUtil.initTableMapperJob(tableName, scan,
CellCounterMapper.class, ImmutableBytesWritable.class, Result.class, job);
job.setNumReduceTasks(1);
job.setMapOutputKeyClass(Text.class);
job.setMapOutputValueClass(IntWritable.class);
job.setOutputFormatClass(TextOutputFormat.class);
job.setOutputKeyClass(Text.class);
job.setOutputValueClass(IntWritable.class);
FileOutputFormat.setOutputPath(job, outputDir);
job.setReducerClass(IntSumReducer.class);
job.setCombinerClass(IntSumReducer.class);
return job;
}

0 comments on commit 60254bc

Please sign in to comment.