[collection] environment do not respect flink-conf.yaml.

[damccorm]

When the Flink master is set to -[auto] and- [collection], flink-conf.yaml (from the FLINK_CONF_DIR environment variable, or the --flink-conf-dir option of the job server) is disregarded.

-This can result in some confusing behavior. For example, when [auto] creates a local environment, an empty Configuration() object is used.-

-

beam/runners/flink/src/main/java/org/apache/beam/runners/flink/FlinkExecutionEnvironments.java

Lines 82 to 85 in dd71c9a

	} else if ("[collection]".equals(flinkMasterHostPort)) {
	flinkBatchEnv = new CollectionEnvironment();
	} else if ("[auto]".equals(flinkMasterHostPort)) {
	flinkBatchEnv = ExecutionEnvironment.getExecutionEnvironment();

-

 

Imported from Jira BEAM-11612. Original Jira may contain additional context.
Reported by: ibzib.

[Abacn]

May be fixed by #23635, specifically here: https://github.com/Abacn/beam/blob/2a8077be46af9358990e888283e2a8668002932c/runners/flink/src/main/java/org/apache/beam/runners/flink/FlinkPipelineRunner.java#L81
but did not confirm.