Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Binary type support #420

Open
tomykaira opened this issue Apr 21, 2016 · 2 comments
Open

[Feature Request] Binary type support #420

tomykaira opened this issue Apr 21, 2016 · 2 comments

Comments

@tomykaira
Copy link

I am trying to handle msgpack encoded data with Embulk.
#121 mentions about binary type, but there are no progress.

Because I can control both input and output plugin, I consider Base64 encoding, but it is not simple solution and not applicable for all cases.
It would be great if embulk natively supports binary data type.

@toyama0919
Copy link
Contributor

+1

some use case,

  • Image recognition(deep learning)
  • Image converter(like Imagemagick)

It is easy to do a little on Embulk.

@frsyuki
Copy link
Contributor

frsyuki commented Dec 5, 2016

Sounds good idea 👍
Similar to JSON type support, we'll also need toolset around binary columns such as:

  • string conversion: base64/hex column encoder/decoder
  • compression: gzip/lz4/snappy column encoder/decoder
  • hash: md5/sha1/sha2 column encoder/decoder

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

No branches or pull requests

4 participants