Use stored configuration in another script

[jdubkim]

Hi, is it possible to store some of the configurations into a file and load them into another file?
For example, I have 'train.py' and a configuration file for this script.

@gin.configurable  
def train(agent, environment):  
    ...  

gin:

train.agent = @DQN
train.environment = @Gym
... # some other arguments not needed in eval.py

I have another script called 'eval.py', and I need to reload an agent and an environment.

@gin.configurable. 
def eval(agent, environment):  
    ...      

However, two functions have different names, I could not use the configuration file.

I tried to use '@gin.configurable('main')' to both functions, but since train takes additional arguments that is not needed in eval function, it did not work.

I also tried to create a function such as get_agent and get_environment which simply takes an argument and returns it, but this does not seem to be a good design choice.

Do you have any suggestion to resolve this issue?
Thank you.

[sguada]

Yeah you can define a macro/constant for the agent and the environment and the use them as needed.

Ex:

AGENT = @DQN
ENV = @Gym

train.agent = %AGENT
train.environment = %ENV
... # some other arguments for train.py

eval.agent = %AGENT
eval.environment = %ENV
... # some other arguments for eval.py

[jdubkim]

Thank you for the reply. But if I run train.py with this configuration setup, it does not recognise eval function which results in an error. If I import eval function in train.py, it solves the issue, but I think this is not an ideal solution to this problem. Can you give an advice to this? That would be so helpful. Thank you.

[sguada]

You should split the gin configuration in different files, one with the common parts, ex.. agent and env and then include it in the train.gin and the eval.gin files.

# common.gin
AGENT = @DQN
ENV = @Gym

# train.gin
include common.gin

train.agent = %AGENT
train.environment = %ENV
... # some other arguments for train.py

# eval.gin
include common.gin
eval.agent = %AGENT
eval.environment = %ENV
... # some other arguments for eval.py

[jdubkim]

Thank you so much, this was very helpful :)