You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, each chunk is committed based on the number of messages written. This is not ideal as the message size varies which creates an uneven distribution of file sizes in HDFS. Size based file commit is preferred if the user want to create evenly distributed files in HDFS.
The text was updated successfully, but these errors were encountered:
Currently, each chunk is committed based on the number of messages written. This is not ideal as the message size varies which creates an uneven distribution of file sizes in HDFS. Size based file commit is preferred if the user want to create evenly distributed files in HDFS.
The text was updated successfully, but these errors were encountered: