Transfer Files

[wade305]

Can kafka transfer files? If can , how?

[mumrah]

Payloads are opaque to Kafka. Ultimately, you are sending bytes - so yes you can send the contents of a file. However, there are practical limitations as to the size of the payload you send.

For large files, a common pattern is to store the file in a distributed filesystem (or database), and pass the file path around in Kafka. While Kafka can certainly move data around, it's more practical to think of it as an event or notification system.

Also you might try asking on the user list: http://kafka.apache.org/contact.html

HTH

[wade305]

Thanks