public class RCFileOutputFormat extends <any> implements HiveOutputFormat<WritableComparable,BytesRefArrayWritable>
Constructor and Description |
---|
RCFileOutputFormat() |
Modifier and Type | Method and Description |
---|---|
static int |
getColumnNumber(Configuration conf)
Returns the number of columns set in the conf for writers.
|
FileSinkOperator.RecordWriter |
getHiveRecordWriter(JobConf jc,
Path finalOutPath,
java.lang.Class<? extends Writable> valueClass,
boolean isCompressed,
java.util.Properties tableProperties,
Progressable progress)
create the final out file.
|
<any> |
getRecordWriter(FileSystem ignored,
JobConf job,
java.lang.String name,
Progressable progress) |
static void |
setColumnNumber(Configuration conf,
int columnNum)
set number of columns into the given configuration.
|
public static void setColumnNumber(Configuration conf, int columnNum)
conf
- configuration instance which need to set the column numbercolumnNum
- column number for RCFile's Writerpublic static int getColumnNumber(Configuration conf)
conf
- public <any> getRecordWriter(FileSystem ignored, JobConf job, java.lang.String name, Progressable progress) throws java.io.IOException
java.io.IOException
public FileSinkOperator.RecordWriter getHiveRecordWriter(JobConf jc, Path finalOutPath, java.lang.Class<? extends Writable> valueClass, boolean isCompressed, java.util.Properties tableProperties, Progressable progress) throws java.io.IOException
getHiveRecordWriter
in interface HiveOutputFormat<WritableComparable,BytesRefArrayWritable>
jc
- the job configuration filefinalOutPath
- the final output file to be createdvalueClass
- the value class used for createisCompressed
- whether the content is compressed or nottableProperties
- the tableInfo of this file's corresponding tableprogress
- progress used for status reportjava.io.IOException
Copyright © 2012 The Apache Software Foundation