Flink Iceberg Source 并行度推断源码解析

批读 Iceberg

Iceberg 提供了两个配置:

public static final ConfigOption<Boolean> TABLE_EXEC_ICEBERG_INFER_SOURCE_PARALLELISM =
  ConfigOptions.key("table.exec.iceberg.infer-source-parallelism")
      .booleanType()
      .defaultValue(true)
      .withDescription("If is false, parallelism of source are set by config.
" +
          "If is true, source parallelism is inferred according to splits number.
");

public static final ConfigOption<Integer> TABLE_EXEC_ICEBERG_INFER_SOURCE_PARALLELISM_MAX =
  ConfigOptions.key("table.exec.iceberg.infer-source-parallelism.max")
      .intType()
      .defaultValue(100)
      .withDescription("Sets max infer parallelism for source operator.");
    table.exec.iceberg.infer-source-parallelism:默认是 true,意味着 source 的并
批读 Iceberg Iceberg 提供了两个配置: public static final ConfigOption  TABLE_EXEC_ICEBERG_INFER_SOURCE_PARALLELISM =   ConfigOptions.key("table.exec.iceberg.infer-source-parallelism")       .booleanType()       .defaultValue(true)       .withDescription("If is false, parallelism of source are set by config. " +           "If is true, source parallelism is inferred according to splits number. "); public static final ConfigOption  TABLE_EXEC_ICEBERG_INFER_SOURCE_PARALLELISM_MAX =   ConfigOptions.key("table.exec.iceberg.infer-source-parallelism.max")       .intType()       .defaultValue(100)       .withDescription("Sets max infer parallelism for source operator."); table.exec.iceberg.infer-source-parallelism:默认是 true,意味着 source 的并
经验分享 程序员 微信小程序 职场和发展