|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||
java.lang.Objectorg.apache.hadoop.conf.Configured
org.apache.hadoop.hbase.mapreduce.hadoopbackport.InputSampler<K,V>
public class InputSampler<K,V>
Utility for collecting samples and writing a partition file for
TotalOrderPartitioner.
This is an identical copy of o.a.h.mapreduce.lib.partition.TotalOrderPartitioner
from Hadoop trunk at r961542, with the exception of replacing
TaskAttemptContextImpl with TaskAttemptContext.
| Nested Class Summary | |
|---|---|
static class |
InputSampler.IntervalSampler<K,V>
Sample from s splits at regular intervals. |
static class |
InputSampler.RandomSampler<K,V>
Sample from random points in the input. |
static interface |
InputSampler.Sampler<K,V>
Interface to sample using an InputFormat. |
static class |
InputSampler.SplitSampler<K,V>
Samples the first n records from s splits. |
| Constructor Summary | |
|---|---|
InputSampler(org.apache.hadoop.conf.Configuration conf)
|
|
| Method Summary | ||
|---|---|---|
static org.apache.hadoop.mapreduce.TaskAttemptContext |
getTaskAttemptContext(org.apache.hadoop.mapreduce.Job job)
This method is about making hbase portable, making it so it can run on more than just hadoop 0.20. |
|
static void |
main(String[] args)
|
|
int |
run(String[] args)
Driver for InputSampler from the command line. |
|
static
|
writePartitionFile(org.apache.hadoop.mapreduce.Job job,
InputSampler.Sampler<K,V> sampler)
Write a partition file for the given job, using the Sampler provided. |
|
| Methods inherited from class org.apache.hadoop.conf.Configured |
|---|
getConf, setConf |
| Methods inherited from class java.lang.Object |
|---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
| Methods inherited from interface org.apache.hadoop.conf.Configurable |
|---|
getConf, setConf |
| Constructor Detail |
|---|
public InputSampler(org.apache.hadoop.conf.Configuration conf)
| Method Detail |
|---|
public static org.apache.hadoop.mapreduce.TaskAttemptContext getTaskAttemptContext(org.apache.hadoop.mapreduce.Job job)
throws IOException
job -
IOException
public static <K,V> void writePartitionFile(org.apache.hadoop.mapreduce.Job job,
InputSampler.Sampler<K,V> sampler)
throws IOException,
ClassNotFoundException,
InterruptedException
TotalOrderPartitioner.getPartitionFile(org.apache.hadoop.conf.Configuration).
IOException
ClassNotFoundException
InterruptedException
public int run(String[] args)
throws Exception
writePartitionFile(org.apache.hadoop.mapreduce.Job, org.apache.hadoop.hbase.mapreduce.hadoopbackport.InputSampler.Sampler) .
run in interface org.apache.hadoop.util.ToolException
public static void main(String[] args)
throws Exception
Exception
|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||