XML streaming to handle large Excel files

[felipenoris]

One drawback of the current implementation for this package is that the whole XML file from a Excel package are parsed in the moment the file is read at XML.read("filename.xlsx") worksheet is parsed when accessing any information of the worksheet.

One idea is to stream XML for worksheet XML files.

I found that EzXML.jl has support for streaming XML files.

[stugorf]

@felipenoris I want to read an Excel file from an AWS S3 bucket without downloading it. It looks like this feature of ExcelFiles should work. This is how I normally read a file from a stream. Can you clarify how to read a stream using the XML Streaming feature:

file_content = S3.get_object(aws, get_config);
load(file_content, "Sheet1") |> DataFrame

Thank you.

[felipenoris]

Hi! For now it is not possible to read an excel file from stream. We would need #26 to be implemented.

[stugorf]

Thank you. Do you know of any packages that can read from stream currently?

[felipenoris]

I think there isn't. But I'll try to work on #26 though.

[stugorf]

If I can test anything, please do not hesitate to let me know! Regards,

…

--David

On Thu, Feb 28, 2019 at 9:08 AM Felipe Noronha ***@***.***> wrote: I think there isn't. But I'll try to work on #26 <#26> though. — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#3 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AFQ5eXaIrkK6bdAa2uu9ieK_pIuuPfzpks5vSAz_gaJpZM4TcSUV> .