hadoop TeraSortConfigKeys 源码

2022-10-20
浏览 (143)

haddop TeraSortConfigKeys 代码

文件路径：/hadoop-mapreduce-project/hadoop-mapreduce-examples/src/main/java/org/apache/hadoop/examples/terasort/TeraSortConfigKeys.java

/**
 * Licensed to the Apache Software Foundation (ASF) under one
 * or more contributor license agreements.  See the NOTICE file
 * distributed with this work for additional information
 * regarding copyright ownership.  The ASF licenses this file
 * to you under the Apache License, Version 2.0 (the
 * "License"); you may not use this file except in compliance
 * with the License.  You may obtain a copy of the License at
 *
 *     http://www.apache.org/licenses/LICENSE-2.0
 *
 * Unless required by applicable law or agreed to in writing, software
 * distributed under the License is distributed on an "AS IS" BASIS,
 * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 * See the License for the specific language governing permissions and
 * limitations under the License.
 */

package org.apache.hadoop.examples.terasort;

import org.apache.hadoop.classification.InterfaceAudience.Private;
import org.apache.hadoop.classification.InterfaceStability.Unstable;

/**
 * <p>
 * TeraSort configurations.
 * </p>
 */
@Private
@Unstable
public enum TeraSortConfigKeys {

  NUM_ROWS("mapreduce.terasort.num-rows",
      "Number of rows to generate during teragen."),

  NUM_PARTITIONS("mapreduce.terasort.num.partitions",
      "Number of partitions used for sampling."),

  SAMPLE_SIZE("mapreduce.terasort.partitions.sample",
      "Sample size for each partition."),

  FINAL_SYNC_ATTRIBUTE("mapreduce.terasort.final.sync",
      "Perform a disk-persisting hsync at end of every file-write."),

  USE_TERA_SCHEDULER("mapreduce.terasort.use.terascheduler",
      "Use TeraScheduler for computing input split distribution."),

  USE_SIMPLE_PARTITIONER("mapreduce.terasort.simplepartitioner",
      "Use SimplePartitioner instead of TotalOrderPartitioner."),

  OUTPUT_REPLICATION("mapreduce.terasort.output.replication",
      "Replication factor to use for output data files.");

  private String confName;
  private String description;

  TeraSortConfigKeys(String configName, String description) {
    this.confName = configName;
    this.description = description;
  }

  public String key() {
    return this.confName;
  }

  public String toString() {
    return "<" + confName + ">     " + description;
  }

  public static final long DEFAULT_NUM_ROWS = 0L;
  public static final int DEFAULT_NUM_PARTITIONS = 10;
  public static final long DEFAULT_SAMPLE_SIZE = 100000L;
  public static final boolean DEFAULT_FINAL_SYNC_ATTRIBUTE = true;
  public static final boolean DEFAULT_USE_TERA_SCHEDULER = true;
  public static final boolean DEFAULT_USE_SIMPLE_PARTITIONER = false;
  public static final int DEFAULT_OUTPUT_REPLICATION = 1;
}

相关信息

hadoop 源码目录

相关文章

hadoop GenSort 源码

hadoop Random16 源码

hadoop TeraChecksum 源码

hadoop TeraGen 源码

hadoop TeraInputFormat 源码

hadoop TeraOutputFormat 源码

hadoop TeraScheduler 源码

hadoop TeraSort 源码

hadoop TeraValidate 源码

hadoop Unsigned16 源码

0 赞

所属分类： 大数据
本文标签： 大数据
版权声明： 原创文章如转载，请注明本文链接: https://www.seaxiang.com/blog/07dbc433e6784832b29a9973a9004296

热门推荐

1、直接访问google.com
2、 - 优质文章
3、 gate.io
4、 harmony 鸿蒙hdc使用指导
5、 harmony 鸿蒙初识ArkTS语言
6、 harmony 鸿蒙ArkUI组件（ArkTS）开发常见问题
7、 flink kafka connector scan.startup.mode 的几个选项
8、 golang
9、 openharmony
10、 Vue中input框自动聚焦

Loading...