Loading Scenarios from Platform gets very slow over time

[glatterf42]

Thank you @khaeru. Modifying the config.json file worked very well for me at first. However, when running my code, over time it eventually gets slower and slower every time I re-initialize the scenario as seen in the following code block.

import message_ix
import ixmp as ix
from ixmp import Scenario
from message_ix import make_df
#from functions.format_demand import format_demand
import pandas as pd
from pathlib import Path
from message_ix.reporting import Reporter
from update_units import unit_correction
import numpy as np


# Stand-alone model
modelName = 'MESSAGEix_CA_Hydrogen'      # A MESSAGE model name
scenarioName = 'Carbon Price'       # A MESSAGE model scenario name
ssp = 'SSP1'

mp = ix.Platform(name="p1")

# Creating a new MESSAGE stand-alone model
msg = message_ix.Scenario(mp, modelName, scenarioName,
                            version='new', annotation='')

I've gotten to the point where it takes 20 minutes to run this simple segment of code (this took 30 seconds originally) and I have "jvmargs" set to -Xmx12G in my config.json file. If anyone has a solution to this issue that would be much appreciated. I have attempted clearing memory and temporary files etc with no success. Not sure what else I could try.

config.json

Originally posted by @brendandanaher in #694 (reply in thread)