HADOOP-18764. fs.azure.buffer.dir to be under Yarn container path on …

…yarn applications (#5788) Changing fs.azure.buffer.dir for azure so things clean up better in long-lived yarn clusters. Contributed by: Mehakmeet Singh
apache · Jun 30, 2023 · b037737 · b037737
1 parent 29362cd
commit b037737
Showing 1 changed file with 4 additions and 2 deletions.
diff --git a/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml b/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
@@ -2133,9 +2133,11 @@ The switch to turn S3A auditing on or off.
 
   <property>
     <name>fs.azure.buffer.dir</name>
-    <value>${hadoop.tmp.dir}/abfs</value>
+    <value>${env.LOCAL_DIRS:-${hadoop.tmp.dir}}/abfs</value>
     <description>Directory path for buffer files needed to upload data blocks
-      in AbfsOutputStream.</description>
+      in AbfsOutputStream.
+      Yarn container path will be used as default value on yarn applications,
+      otherwise fall back to hadoop.tmp.dir </description>
   </property>
 
 <property>