Large svg files being generated for datasets having more than a million records

[vinnsvinay]

I am trying to visualize a decision tree for one of the random forest regression models I have built and I have noticed that the svg file size is around 1.3 gb. I have reduced the depth of the model and changed the visualization to non-fancy (fancy = false) but it still generates a 250 mb+ svg file because of which rendering fails. These huge file sizes are because of the histograms being generated at the leaf node. Is there any way to have a simple output with following fields:

1. Number of records
2. Prediction

I have gone through the code and noticed that I need to change the function regr_leaf_node in order to suppress the histogram. Please let me know what would be the next steps.

Thanks,
Vinay

[parrt]

Hiya. can you use the "nonfancy" version? There's a parameter. "fancy=False # fancy=False to remove histograms/scatterplots from decision nodes"

[vinnsvinay]

Hi Terrence,

I have used fancy = False, even then the image size is very big. It's because of the scatter plots drawn in leaf nodes. Is there an option to disable scatter plots for leaf nodes? I am currently changing the code to disable the scatterplots at leaf nodes but it just creates empty plots and makes it look very ugly.

Thanks,
Vinay

[parrt]

oh!! yeah, svg is clean but huge. Can you generate that image then convert to PNG?

[vinnsvinay]

I am trying to use online converters to convert but none of them are accepting svg files over 250 mb. I have edited the code in regr_leaf_viz function to disable drawing the scatter plot which makes it look very ugly. Will try some other visualizations to enhance the leaf nodes.

[parrt]

can you try saving svg file to disk THEN converting?

[vinnsvinay]

I saved the svg file using save_svg function and used online converters to convert it to jpg/png format

[parrt]

Why not call convert or something via os.exec()? (i.e., standard commands from command line)

[vinnsvinay]

I wasn't aware of them. I will try that. Thanks Terrance.