hl.Table.to_pandas() generates a dtype=string dataframe which is still experimental

[mkanai]

I encountered an error in an external package when I used a Hail-generated pandas data frame, which is due to an unsupported dtype pandas.StringDtype.
pyranges/pyranges#264

Given it's still experimental in pandas, can we have an option to generate a data frame that have dtype=object string columns? or maybe, we should make dtype=object default.

hail/hail/python/hail/table.py

Lines 3345 to 3346 in c4b0995

	if hl_dtype == hl.tstr:
	pd_dtype = 'string'

[danking]

Great suggestion Masa! We can provide a types argument to to_pandas which allows the user to override the type for a subset of columns. I've marked this help wanted. If someone on the team has some spare cycles they might pick it up. We also welcome PRs to make this change!

[danking]

Closing the loop: this was released into 0.2.110!