Adding native support to query azure data explorer

[toshetah]

Hello,

My name is Tomer, and I am a developer working at Microsoft.
I am part of Azure Data Explorer, and maintaining our python packages.
We have many customers that are using pandas, and we were thinking of how to ease their usage.
We would like to expose/contribute something similar to the following:

import pandas as pd
pd.read_azure_data_explorer("query", con=connection_string)

I think that adding the ability to read Azure Data Explorer directly into pandas could potentially help many of our customers who are accustomed to pandas.
I would like to hear what do you guys think about that.

Thanks,
Tomer

[jschendel]

I suspect this would be more appropriate as a separate package, similar to pandas-gbq (xref #15347). Then, if we were to add this as a top-level pd.read_azure_data_explorer, it would just be implemented as a wrapper around the package, e.g. io/gbq.py.

[TomAugspurger]

Mostly agreed with @jschendel. Functionality-wise, I don't think it makes a difference whether this is implemented in pandas vs. a third-party package. Given that the azure data explorer team are better-equipped to develop and maintain the functionality, so I'd lean towards doing it as a third-party package. As far as promotion / informing people about this functionality, I'd suggest starting with adding it to the "pandas ecosystem" page in the pandas docs.

…

On Thu, Jan 17, 2019 at 12:41 PM Jeremy Schendel ***@***.***> wrote: I suspect this would be more appropriate as a separate package, similar to pandas-gbq <https://pandas-gbq.readthedocs.io/en/latest/> (xref #15347 <#15347>). Then, if we were to add this as a top-level pd.read_azure_data_explorer, it would just be implemented as a wrapper around the package, e.g. io/gbq.py <https://github.com/pandas-dev/pandas/blob/master/pandas/io/gbq.py>. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#24818 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ABQHIojaHf6WNShT7mSDSzwLHxKUyc46ks5vEMPXgaJpZM4aGWWF> .

[WillAyd]

Thanks for the request! I'd also lean towards this being in a separate package and given the other feedback I am going to close this.

If you end up building the package let us know and can point to it from the ecosystem docs. Can certainly reach out with questions as well on the mailing list or Gitter