devel with history #2269
Merged
devel with history #2269
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Updates the requirements on [rich](https://github.com/willmcgugan/rich) to permit the latest version. - [Release notes](https://github.com/willmcgugan/rich/releases) - [Changelog](https://github.com/willmcgugan/rich/blob/master/CHANGELOG.md) - [Commits](Textualize/rich@v10.1.0...v10.10.0) --- updated-dependencies: - dependency-name: rich dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com>
…dependabot/pip/devel/rich-gte-10.1-and-lt-10.11 requirements: update rich requirement from <10.10,>=10.1 to >=10.1,<10.11
Signed-off-by: Jan Vesely <jan.vesely@rutgers.edu>
…he next move Compare the move based on observations with the real bearing from player to prey. Signed-off-by: Jan Vesely <jan.vesely@rutgers.edu>
…the next move (PrincetonUniversity#2121) A slightly less trivial variant of the Predator-Prey model.
Signed-off-by: Jan Vesely <jan.vesely@rutgers.edu>
… of RandomState Signed-off-by: Jan Vesely <jan.vesely@rutgers.edu>
…function instead of RandomState Results change since the 'seed' parameter is converted to list before use. Signed-off-by: Jan Vesely <jan.vesely@rutgers.edu>
Drop custom in-flight function check. Remove any cost calculation and use generated random value as objective metric. Signed-off-by: Jan Vesely <jan.vesely@rutgers.edu>
…ialize parameters.random_state Fix function copy workaround to reset the seed parameter, the state will be adjusted by the seed setter function. Use DEFAULT_SEED to avoid advancing global seed. Signed-off-by: Jan Vesely <jan.vesely@rutgers.edu>
Instead of resetting the PRNG state once per context, the new approach compares the originally used seed with the new value (either new setting or modulation). This allows for better match in multi-trial executions with OCM: Simulations will only reset PRNG if the modulated seed is different from the one in the current execution context. The result of evaluation will thus match the result of trial even if OCM selects the same seed as originally used by the execution. The PRNG state is also reset on direct seed modification to preserve the old behaviour in situations like; Func1.seed = n Func2.seed = n # Both Func1 and Func2 now follow the same random sequence irrespective # of their original seed Signed-off-by: Jan Vesely <jan.vesely@rutgers.edu>
…ials Construct the expected values in the test instead of using constants to verify the semantics of reusing random seeds. Signed-off-by: Jan Vesely <jan.vesely@rutgers.edu>
Signed-off-by: Jan Vesely <jan.vesely@rutgers.edu>
Signed-off-by: Jan Vesely <jan.vesely@rutgers.edu>
…/is not Signed-off-by: Jan Vesely <jan.vesely@rutgers.edu>
…function definition Signed-off-by: Jan Vesely <jan.vesely@rutgers.edu>
Signed-off-by: Jan Vesely <jan.vesely@rutgers.edu>
Use == to compare strings Drop unused imports. Use is or is not when comparing to True or False. 2 blank lines after function/class definition.
Updates the requirements on [rich](https://github.com/willmcgugan/rich) to permit the latest version. - [Release notes](https://github.com/willmcgugan/rich/releases) - [Changelog](https://github.com/willmcgugan/rich/blob/master/CHANGELOG.md) - [Commits](Textualize/rich@v10.1.0...v10.11.0) --- updated-dependencies: - dependency-name: rich dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com>
…dependabot/pip/devel/rich-gte-10.1-and-lt-10.12 requirements: update rich requirement from <10.11,>=10.1 to >=10.1,<10.12
The original semantics was to reset random state once per context with the most up-to-date value of the seed. The new approach is to reset random state every time the seed value changes, whether through direct assignment or modulation. The practical change in semantics is subtle and helps match results between virtual executions and the simulated composition (see the comments in 'test_modulation_of_random_state' for details).
… if IntEnum Bitwise combination of flags is still a flag. Signed-off-by: Jan Vesely <jan.vesely@rutgers.edu>
Signed-off-by: Jan Vesely <jan.vesely@rutgers.edu>
Signed-off-by: Jan Vesely <jan.vesely@rutgers.edu>
fixes bug in which attributes of SharedParameter would not reference the attributes on their source Parameter. Caused by setting these attributes during setting of the _inherited attribute upon construction
SharedParameter improvements
…incetonUniversity#2249) parameters with getters would not be called during initialization due to condition order, and as a result values would not be populated. Component: set variable to default when determined in init
* -
* -
* -
* -
* • composition.py
- __init__: moved controller instantiation until after nodes, projections and pathways
* • composition.py
- __init__: restored add_controller position
* llvm/struct generation: Make sure num_estimats per trial is always integer
Signed-off-by: Jan Vesely <jan.vesely@rutgers.edu>
* -
* • composition.py:
- _update_controller: added
- add_controller and _analyze_graph(): call _update_controller
* -
* • composition.py
_update_controller: fixed to loop through all input_ports of comp INPUT nodes
* • test_control.py
- test_agent_rep_assignement_as_controller_and_replacement:
updated to test that shadowing projections to state_input_ports
are properly added and deleted
* • optimizationfunctions.py:
- _function: refactored to put use aggregation_function at end
- _grid_evaluate: still needs to return all_samples
* -
* • composition.py
- added call to _update_controller to add_node
- moved test for projections to controller.state_input_ports to run()
* -
* • composition.py:
moved calls to _update_controller to _complete_init_of_partially_initialized_nodes
moved _update_controller to ocm._update_state_input_ports
• optimizationcontrolmechanism.py:
added _update_state_input_ports [**still needed work**]
* • composition.py:
moved calls to _update_controller to _complete_init_of_partially_initialized_nodes
moved _update_controller to ocm._update_state_input_ports
_instantiate_controller_shadow_projections [still needs to be implemented]
• optimizationcontrolmechanism.py:
added _update_state_input_ports [**still needed work**]
* • composition.py
added needs_update_controller
* -
* • composition.py:
- implemented self.needs_update_controller
- moved implementation of controlsignal projections
from add_controller to _instantiate_control_projections
that is called in _complete_init_of_partially_initialized_nodes
Note: still need to set self.needs_update_controller to False
after instantiating state_input_ports and projections to them
* -
* -
* -
* -
* -
* -
* -
* -
* • Passing all test_control tests except test_mode_based_num_estimates
* • Passing all test_control tests
* -
* • optimizationcontrolmechanism.py
- _update_state_input_ports_for_controller: handle nested input nodes
* -
* • optimizationcontrolmechanism.py
_update_state_input_ports_for_controller: fixed bug with > 1 INPUT node in Composition
* • test_show_graph.py: passes all tests
* -
* • test_report.py: passing all tests
* • Passes all tests!
* -
* -
* • composition.py: reorganize with #region and #enregions
* • composition.py: reorganize with #region and #enregions
* • controlmechanism.py, optimizationcontrolmechanism.py:
- _instantiate_monitor_for_control_input_ports -> _parse_monitor_control_input_ports
- refactored to support allow_probes option on ocm
* -
* -
* -
* • controlmechanism.py, optimizationcontrolmechanism.py:
- _instantiate_monitor_for_control_input_ports -> _parse_monitor_control_input_ports
- refactored to support allow_probes option on ocm
* • controlmechanism.py, optimizationcontrolmechanism.py:
- _instantiate_monitor_for_control_input_ports -> _parse_monitor_control_input_ports
- refactored to support allow_probes option on ocm
* -
* • composition.py:
__init__: move controller to after add_nodes and add_linear_pathway
* -
* - test_control: only test_hanging_control_spec_outer_controller not passing
* -
* -
* -
* -
* -
* -
* • composition.py:
_instantiate_control_projections:
weird requirement for double-call to controller._instantiate_control_signal
* • test_paremtercomposition.py:
restored parameter spec that causes crash ('threshold',Decision2)
* ª Attempt to fix problem with partially overlapping local and ocm control specs
- composition.py
- _get_control_signals_for_composition: (see 11/20/21)
- added (but commented out change) to "if node.controller" to "if not node.controller"
- changed append to extend
- _instantiation_control_projection:
- got rid of try and except double-call to controller._instantiate_control_signals
- outdented call to self.controller._activate_projections_for_composition at end
- controlmechanism.py:
- _check_for_duplicates: add warning and return duplicates
- optimizationcontrolmechanism._instantiate_control_signals:
- add call to self.agent_rep._get_control_signals_for_composition() to get local control specs (on mechs in comp)
- eliminate duplicates with control_signal specs on OCM
- instantiate local + ocm control_signals
- parameterestimationcomposition.py
- added context to various calls
* see later commit
* see later commit
* see later commit
* see later commit
* - This branch passes all tests except:
- test_parameterestimationcomposition
- test_composition/test_partially_overlapping_control_specs (ADDED IN THIS COMMINT)
- All relevant changes to this branch are marked as "11/21/21."
However, most are commented out as they break other things.
- The tests above both involve local control specifications (on mechanism within a nested comp)
and on the OCM for the outer composition, some of which are for the same nested mechs
- Both tests fail with:
"AttributeError: 'NoneType' object has no attribute '_get_by_time_scale'" (in component.py LINE 3276)
This may be due to a problem with context setting, since the error is because the modulation Parameter
of the ControlProjection is returning "None" rather than "multiplicative_param" (when called with get(context)),
whereas "multiplicative_param" is returned with a call to get() (i.e., with no context specified)
- Most of test_partially_overlapping_control_specs is passed if
changes marked "11/21/21 NEW" in optimizationcontrolmechanism.py (LINE 1390) are implemented,
but it does not properly route ControlProjections through parameter_CIMS (see last assert in test).
Furthermore, test_parameterestimationcompsition fails with the mod param error, even though the
model has similar structure (i.e., outer composition -- in this case a ParameterEstimationComposition)
with an OCM that is given control specs that overlap with ones in a nested composition.
- There are also several other things in composition I found puzzling and tried modifying, but that cuased failures:
- _get_control_signals_for_composition():
- seems "if node.controller" should be "if **not** node.controller" (emphasis added just for comment)
- "append" should be "extend"
- _instantiate_control_projection():
- call to self.controller._activate_projections_for_composition (at end of method) should not be indented
* - small mods; don't impact anything relevant to prior commit message
* - small mods; don't impact anything relevant to prior commit message
* - small mods; don't impact anything relevant to prior commit message
* - finished adding formatting regions to composition.py
* -
* • composition.py:
- rename _check_projection_initialization_status -> _check_controller_initialization_status
- add _check_nodes_initialization_status(context=context)
(and calls it with _check_controller_initialization_status)
* • show_graph.py: addressed bug associated with ocm.allow_direct_probe
* • show_graph.py: addressed bug associated with ocm.allow_direct_probe
* -
* Composition: add_controller: set METHOD as context source early
* -
* • composition.py
retore append of control_signals in _instantiate_control_projections()
* • composition.py
restore append of control_signals in _instantiate_control_projections()
• test_composition.py:
add test_partially_overlapping_local_and_control_mech_control_specs_in_unnested_and_nested_comp
* • test_partially_overlapping_local_and_control_mech_control_specs_in_unnested_and_nested_comp():
- added clear_registry() to allow names to be reused in both runs of test
* • composition.py
docstring: added projections entry to list of attributes
- add_controller: added call to _add_node_aux_components() for controller
* • composition.py
_add_node_aux_components(): added deletion of item from aux_components if instantiated
* • composition.py
- comment out _add_node_aux_components() (causing new failures)
- move _instantiate_control_projections to be with _instantiate_control_projections,
after self.add_node(self.controller.objective_mechanism (to be more orderly)
* -
* - confirm that it passes all tests exception test_composition/test_partially_overlapping...
(with addition of _add_aux_components in add_controller commented out)
* • composition.py: some more fixed to add_controller that now fail only one test:
- test_agent_rep_assignement_as_controller_and_replacement
* • Passes *all* current tests
* • composition.py:
- add_controller: few more minor mods;
still passes all tests
* -
* -
* -
* • controlmechanism.py:
- __init__: resrict specification to only one of control, modulatory_signals, or control_signals (synonyms)
* -
* • composition.py: in progress fix of bug in instantiating shadow projections for ocm.state_input_ports
* • composition.py:
- _get_original_senders(): added support for nested composition
needs to be checked for more than one level
needs to be refactored to be recursive
* • optimizationcontrolmechanism.py
- _update_state_input_ports_for_controller: fix invalid_state_features to allow input_CIM of nested comp in agent_rep
* -
* • composition.py
- _get_original_senders: made recursive
* • test_show_graph.py: update for fixes
* -
* • tests: passes all in test_show_graph.py and test_report.py
* Passes all tests
* - comment clean-up
* • composition.py
- add_controller and _get_nested_node_CIM_port:
added support for forced assignment of NodeRole.OUTPUT for nodes specified in OCM.monitor_for_control,
but referenced 'allow_probes' attribute still needs to be implemented
* • composition.py, optimizationcontrolmechanism.py:
allow_probes fully implemented
* • show_graph.py: fixed bug causing extra projections to OCM
* • composition.py:
- _update_shadow_projections(): fix handling of deep nesting
* • optimizationcontrolmechanism.py: add agent_rep_type property
* • optimizationcontrolmechanism.py:
- state_feature_function -> state_feature_functions
* • optimizationcontrolmechanism.py:
- _validate_params: validate state_feature_functions
- _update_state_input_ports_for_controller: implement assignment of state_feature_functions
* -
* -
* • Passes all tests except test_json with 'model_with_control'
* -
* • composition.py
- add_projection: delete instantiation of shadow projections (handled by _update_shadow_projections)
* • composition.py
- add_projection: delete instantiation of shadow projections (handled by _update_shadow_projections)
- remove calls to _update_shadows_dict
* • composition.py
- add_projection: delete instantiation of shadow projections (handled by _update_shadow_projections)
- remove calls to _update_shadows_dict
* -
* • test_two_origins_two_input_ports: crashes on failure of C->B to update
* -
* • composition.py
- added property shadowing_dict that has shadowing ports as keys and the ports they shadow as values
- refactored _update_shadowing_projections to use shadowing_dict
* • optimizationcontrolmechanism.py
- _update_state_input_ports: modified validations for nested nodes; still failing some tests
* • optimizationcontrolmechanism.py
- _update_state_input_ports:
more careful and informative validation that state_input_ports are in comp or nested comp and are INPUT nodes thereof;
passes all tests except test_two_origins_two_input_ports as before
* • composition.py
_get_invalid_aux_components(): defer all shadow projections until _update_shadow_projections
* • composition.py
_get_invalid_aux_components(): bug fix in test for shadow projections
* Port: _remove_projection_to_port: don't reduce variable below length 1
even ports with no incoming projections have variable at least length 1
* • composition.py
add_node(): marked (but haven't removed) code block instantiating shadow_projections
that seems now to be redundant with _update_shadow_projection
* • show_graph.py
- _assign_cim_components: supress showing projections not in composition
* • composition.py:
_analyze_graph(): add extra call to _determine_node_roles after _update_shadow_projections
_run(): moved block of code at beginning initializing scheduler to after
_complete_init_of_partially_initialized_nodes and _analyze_graph()
• show_graph.py
- add test to all loops on projections: "if proj in composition.projection"
* • show_graph.py
- add show_projections_not_in_composition option for debugging
* • composition.py
_update_shadow_projections(): delete unused shadow projections and corresponding ports
* • composition.py
_update_shadow_projections(): fix bug in deletion of unused shadow projections and ports
• test_show_graph: tests failing, need mods to accomodate changes
* • composition.py:
_analyze_graph(): add extra call to _determine_node_roles after _update_shadow_projections
_run(): moved block of code at beginning initializing scheduler to after
_complete_init_of_partially_initialized_nodes and _analyze_graph()
• show_graph.py
- add test to all loops on projections: "if proj in composition.projection"
* • show_graph.py
fixes; now passes all show_graph tests
* -
* • composition.py
_update_shadow_projections: raise error for attempt to shadow INTERNAL Node of nested comp
* -
* -
* • test_composition.py
implemented test_shadow_nested_nodes that tests shadowing of nested nodes
* -
* -
* -
* -
* • optimizationcontrolmechanism.py: docstring mods
* • composition.py:
- add allow_probes and exclude_probes_from_output
* • composition.py:
- docstring mods re: allow_probes
• optimizationcontrolmechanism.py:
- allow_probes: eliminate DIRECT setting
- remove _parse_monitor_for_control_input_ports (no longer needed without allow_probes=DIRECT)
* • composition.py:
- change "exclude_probes_from_output" -> "include_probes_in_output"
* • composition.py:
- docstring mods re: allow_probes and include_probes_in_output
* • composition.py:
- docstring mods re: allow_probes and include_probes_in_output
* • controlmechanism.py:
- add allow_probes handling (moved from OCM)
• optimizationcontrolmechanism.py:
- move allow_probes to controlmechanism.py
• composition.py:
- refactor handling of allow_probes to permit for any ControlMechanism
• objectivemechanism.py:
- add modulatory_mechanism attribute
* • controlmechanism.py:
- add allow_probes handling (moved from OCM)
• optimizationcontrolmechanism.py:
- move allow_probes to controlmechanism.py
• composition.py:
- refactor handling of allow_probes to permit for any ControlMechanism
- add _handle_allow_probes_for_control() to reconcile setting on Composition and ControlMechanism
• objectivemechanism.py:
- add modulatory_mechanism attribute
* • composition.py
add assignment of learning_mechanism to objective_mechanism.modulatory_mechanism for add_learning methods
* • docstring mods
* -
* -
* • optimizationcontrolmechanism.py: docstring revs
* -
* -
* • test_composition.py:
- add test_unnested_PROBE
- add test_nested_PROBES
TBD: test include_probes_in_output
* -
* • composition.py
- add_node(): support tuple with required_role
* -
* • composition.py:
- _determine_node_roles:
fix bug in which nested comp was prevented from being an OUTPUT Node if,
in addition to Nodes that qualifed as OUTPUT, it also had nodes that projected
to Nodes in an outer comp (making it look like it was INTERNAL)
* -
* • composition.py:
- add_node(): enforce include_probes_in_output = True for nested Compositions
- execute():
- replace return of output_value with get_output_value()
* -
* • CompositionInterfaceMechanism.rst:
- correct path ref
• compositioninterfacemechanism.py:
- docstring fixes
* • compositioninterfacemechanism.py:
- docstring edits
* -
* -
* -
* -
* -
* -
* -
* -
* -
* • composition.py:
add_projection: _parse_projection_spec -> _instantiate_projection_from_spec
* • composition.py:
add_projection: _parse_projection_spec -> _instantiate_projection_from_spec
* • composition.py
- add_linear_processing_pathway:
support one->many and many->one configurations in pathway specification
(see docstring for method)
* -
* • composition.py
_add_linear_processing_pathway, add_projection, _is_pathway_entry_spec:
- support many->one and one->many projections between mech and comps in pathway spec: working
- support set of Projections as legal entry in pathway spec: TBI
* • composition.py
_add_linear_processing_pathway, add_projection, _is_pathway_entry_spec:
- support many->one and one->many projections between mech and comps in pathway spec: working
- support set of Projections as legal entry in pathway spec: TBI
* • show_graph.py
_assign_cim_components(): fix bug in which comp1_output_cim->comp2_input_cim was skipped
* • compositioninterfacemechanism.py: docstring mod
* -
* • composition.py: minor formatting
* • composition.py
add_linear_processing_pathway(): eliminate TARGET Nodes from one->many
* -
* • composition.py:
- add_linear_processing_pathway(): add recursive search for nested INPUT and OUTPUT nodes
* • composition.py:
- add_linear_processing_pathway():
- exclude Target Nodes from search for INPUT nodes (handled by learning)
- add recursive search for nested INPUT and OUTPUT nodes
* -
* -
* • composition.py
add_projection: working on adding support for projection sets
* -
* -
* • composition.py
- add _get_nested_nodes_with_same_roles_at_all_levels
- add_linear_processing_pathway:
call _get_nested_nodes_with_same_roles_at_all_levels
* • composition.py
- add_linear_processing_pathway: add support for inline specification of set of Projections
* -
* -
* • composition.py
add_linear_processing_pathway: refactored to support inline specification of sets of Projections
* • composition.py
add_linear_processing_pathway: docstring edits for Projection set specification
* -
* -
* -
* -
* -
* • test_composition.py:
- add test_add_multiple_projections_for_nested_compositions - IN PROGRESS
* • test_composition.py:
- add test_add_multiple_projections_for_nested_compositions - passes
* -
* -
Co-authored-by: Jan Vesely <jan.vesely@rutgers.edu>
Co-authored-by: jdcpni <pniintel55>
Co-authored-by: Katherine Mantel <kmantel@princeton.edu>
* -
* -
* • composition.py
- __init__: moved controller instantiation until after nodes, projections and pathways
* • composition.py
- __init__: restored add_controller position
* llvm/struct generation: Make sure num_estimats per trial is always integer
Signed-off-by: Jan Vesely <jan.vesely@rutgers.edu>
* -
* • composition.py:
- _update_controller: added
- add_controller and _analyze_graph(): call _update_controller
* -
* • composition.py
_update_controller: fixed to loop through all input_ports of comp INPUT nodes
* • test_control.py
- test_agent_rep_assignement_as_controller_and_replacement:
updated to test that shadowing projections to state_input_ports
are properly added and deleted
* • optimizationfunctions.py:
- _function: refactored to put use aggregation_function at end
- _grid_evaluate: still needs to return all_samples
* -
* • composition.py
- added call to _update_controller to add_node
- moved test for projections to controller.state_input_ports to run()
* -
* • composition.py:
moved calls to _update_controller to _complete_init_of_partially_initialized_nodes
moved _update_controller to ocm._update_state_input_ports
• optimizationcontrolmechanism.py:
added _update_state_input_ports [**still needed work**]
* • composition.py:
moved calls to _update_controller to _complete_init_of_partially_initialized_nodes
moved _update_controller to ocm._update_state_input_ports
_instantiate_controller_shadow_projections [still needs to be implemented]
• optimizationcontrolmechanism.py:
added _update_state_input_ports [**still needed work**]
* • composition.py
added needs_update_controller
* -
* • composition.py:
- implemented self.needs_update_controller
- moved implementation of controlsignal projections
from add_controller to _instantiate_control_projections
that is called in _complete_init_of_partially_initialized_nodes
Note: still need to set self.needs_update_controller to False
after instantiating state_input_ports and projections to them
* -
* -
* -
* -
* -
* -
* -
* -
* • Passing all test_control tests except test_mode_based_num_estimates
* • Passing all test_control tests
* -
* • optimizationcontrolmechanism.py
- _update_state_input_ports_for_controller: handle nested input nodes
* -
* • optimizationcontrolmechanism.py
_update_state_input_ports_for_controller: fixed bug with > 1 INPUT node in Composition
* • test_show_graph.py: passes all tests
* -
* • test_report.py: passing all tests
* • Passes all tests!
* -
* -
* • composition.py: reorganize with #region and #enregions
* • composition.py: reorganize with #region and #enregions
* • controlmechanism.py, optimizationcontrolmechanism.py:
- _instantiate_monitor_for_control_input_ports -> _parse_monitor_control_input_ports
- refactored to support allow_probes option on ocm
* -
* -
* -
* • controlmechanism.py, optimizationcontrolmechanism.py:
- _instantiate_monitor_for_control_input_ports -> _parse_monitor_control_input_ports
- refactored to support allow_probes option on ocm
* • controlmechanism.py, optimizationcontrolmechanism.py:
- _instantiate_monitor_for_control_input_ports -> _parse_monitor_control_input_ports
- refactored to support allow_probes option on ocm
* -
* • composition.py:
__init__: move controller to after add_nodes and add_linear_pathway
* -
* - test_control: only test_hanging_control_spec_outer_controller not passing
* -
* -
* -
* -
* -
* -
* • composition.py:
_instantiate_control_projections:
weird requirement for double-call to controller._instantiate_control_signal
* • test_paremtercomposition.py:
restored parameter spec that causes crash ('threshold',Decision2)
* ª Attempt to fix problem with partially overlapping local and ocm control specs
- composition.py
- _get_control_signals_for_composition: (see 11/20/21)
- added (but commented out change) to "if node.controller" to "if not node.controller"
- changed append to extend
- _instantiation_control_projection:
- got rid of try and except double-call to controller._instantiate_control_signals
- outdented call to self.controller._activate_projections_for_composition at end
- controlmechanism.py:
- _check_for_duplicates: add warning and return duplicates
- optimizationcontrolmechanism._instantiate_control_signals:
- add call to self.agent_rep._get_control_signals_for_composition() to get local control specs (on mechs in comp)
- eliminate duplicates with control_signal specs on OCM
- instantiate local + ocm control_signals
- parameterestimationcomposition.py
- added context to various calls
* see later commit
* see later commit
* see later commit
* see later commit
* - This branch passes all tests except:
- test_parameterestimationcomposition
- test_composition/test_partially_overlapping_control_specs (ADDED IN THIS COMMINT)
- All relevant changes to this branch are marked as "11/21/21."
However, most are commented out as they break other things.
- The tests above both involve local control specifications (on mechanism within a nested comp)
and on the OCM for the outer composition, some of which are for the same nested mechs
- Both tests fail with:
"AttributeError: 'NoneType' object has no attribute '_get_by_time_scale'" (in component.py LINE 3276)
This may be due to a problem with context setting, since the error is because the modulation Parameter
of the ControlProjection is returning "None" rather than "multiplicative_param" (when called with get(context)),
whereas "multiplicative_param" is returned with a call to get() (i.e., with no context specified)
- Most of test_partially_overlapping_control_specs is passed if
changes marked "11/21/21 NEW" in optimizationcontrolmechanism.py (LINE 1390) are implemented,
but it does not properly route ControlProjections through parameter_CIMS (see last assert in test).
Furthermore, test_parameterestimationcompsition fails with the mod param error, even though the
model has similar structure (i.e., outer composition -- in this case a ParameterEstimationComposition)
with an OCM that is given control specs that overlap with ones in a nested composition.
- There are also several other things in composition I found puzzling and tried modifying, but that cuased failures:
- _get_control_signals_for_composition():
- seems "if node.controller" should be "if **not** node.controller" (emphasis added just for comment)
- "append" should be "extend"
- _instantiate_control_projection():
- call to self.controller._activate_projections_for_composition (at end of method) should not be indented
* - small mods; don't impact anything relevant to prior commit message
* - small mods; don't impact anything relevant to prior commit message
* - small mods; don't impact anything relevant to prior commit message
* - finished adding formatting regions to composition.py
* -
* • composition.py:
- rename _check_projection_initialization_status -> _check_controller_initialization_status
- add _check_nodes_initialization_status(context=context)
(and calls it with _check_controller_initialization_status)
* • show_graph.py: addressed bug associated with ocm.allow_direct_probe
* • show_graph.py: addressed bug associated with ocm.allow_direct_probe
* -
* Composition: add_controller: set METHOD as context source early
* -
* • composition.py
retore append of control_signals in _instantiate_control_projections()
* • composition.py
restore append of control_signals in _instantiate_control_projections()
• test_composition.py:
add test_partially_overlapping_local_and_control_mech_control_specs_in_unnested_and_nested_comp
* • test_partially_overlapping_local_and_control_mech_control_specs_in_unnested_and_nested_comp():
- added clear_registry() to allow names to be reused in both runs of test
* • composition.py
docstring: added projections entry to list of attributes
- add_controller: added call to _add_node_aux_components() for controller
* • composition.py
_add_node_aux_components(): added deletion of item from aux_components if instantiated
* • composition.py
- comment out _add_node_aux_components() (causing new failures)
- move _instantiate_control_projections to be with _instantiate_control_projections,
after self.add_node(self.controller.objective_mechanism (to be more orderly)
* -
* - confirm that it passes all tests exception test_composition/test_partially_overlapping...
(with addition of _add_aux_components in add_controller commented out)
* • composition.py: some more fixed to add_controller that now fail only one test:
- test_agent_rep_assignement_as_controller_and_replacement
* • Passes *all* current tests
* • composition.py:
- add_controller: few more minor mods;
still passes all tests
* -
* -
* -
* • controlmechanism.py:
- __init__: resrict specification to only one of control, modulatory_signals, or control_signals (synonyms)
* -
* • composition.py: in progress fix of bug in instantiating shadow projections for ocm.state_input_ports
* • composition.py:
- _get_original_senders(): added support for nested composition
needs to be checked for more than one level
needs to be refactored to be recursive
* • optimizationcontrolmechanism.py
- _update_state_input_ports_for_controller: fix invalid_state_features to allow input_CIM of nested comp in agent_rep
* -
* • composition.py
- _get_original_senders: made recursive
* • test_show_graph.py: update for fixes
* -
* • tests: passes all in test_show_graph.py and test_report.py
* Passes all tests
* - comment clean-up
* • composition.py
- add_controller and _get_nested_node_CIM_port:
added support for forced assignment of NodeRole.OUTPUT for nodes specified in OCM.monitor_for_control,
but referenced 'allow_probes' attribute still needs to be implemented
* • composition.py, optimizationcontrolmechanism.py:
allow_probes fully implemented
* • show_graph.py: fixed bug causing extra projections to OCM
* • composition.py:
- _update_shadow_projections(): fix handling of deep nesting
* • optimizationcontrolmechanism.py: add agent_rep_type property
* • optimizationcontrolmechanism.py:
- state_feature_function -> state_feature_functions
* • optimizationcontrolmechanism.py:
- _validate_params: validate state_feature_functions
- _update_state_input_ports_for_controller: implement assignment of state_feature_functions
* -
* -
* • Passes all tests except test_json with 'model_with_control'
* -
* • composition.py
- add_projection: delete instantiation of shadow projections (handled by _update_shadow_projections)
* • composition.py
- add_projection: delete instantiation of shadow projections (handled by _update_shadow_projections)
- remove calls to _update_shadows_dict
* • composition.py
- add_projection: delete instantiation of shadow projections (handled by _update_shadow_projections)
- remove calls to _update_shadows_dict
* -
* • test_two_origins_two_input_ports: crashes on failure of C->B to update
* -
* • composition.py
- added property shadowing_dict that has shadowing ports as keys and the ports they shadow as values
- refactored _update_shadowing_projections to use shadowing_dict
* • optimizationcontrolmechanism.py
- _update_state_input_ports: modified validations for nested nodes; still failing some tests
* • optimizationcontrolmechanism.py
- _update_state_input_ports:
more careful and informative validation that state_input_ports are in comp or nested comp and are INPUT nodes thereof;
passes all tests except test_two_origins_two_input_ports as before
* • composition.py
_get_invalid_aux_components(): defer all shadow projections until _update_shadow_projections
* • composition.py
_get_invalid_aux_components(): bug fix in test for shadow projections
* Port: _remove_projection_to_port: don't reduce variable below length 1
even ports with no incoming projections have variable at least length 1
* • composition.py
add_node(): marked (but haven't removed) code block instantiating shadow_projections
that seems now to be redundant with _update_shadow_projection
* • show_graph.py
- _assign_cim_components: supress showing projections not in composition
* • composition.py:
_analyze_graph(): add extra call to _determine_node_roles after _update_shadow_projections
_run(): moved block of code at beginning initializing scheduler to after
_complete_init_of_partially_initialized_nodes and _analyze_graph()
• show_graph.py
- add test to all loops on projections: "if proj in composition.projection"
* • show_graph.py
- add show_projections_not_in_composition option for debugging
* • composition.py
_update_shadow_projections(): delete unused shadow projections and corresponding ports
* • composition.py
_update_shadow_projections(): fix bug in deletion of unused shadow projections and ports
• test_show_graph: tests failing, need mods to accomodate changes
* • composition.py:
_analyze_graph(): add extra call to _determine_node_roles after _update_shadow_projections
_run(): moved block of code at beginning initializing scheduler to after
_complete_init_of_partially_initialized_nodes and _analyze_graph()
• show_graph.py
- add test to all loops on projections: "if proj in composition.projection"
* • show_graph.py
fixes; now passes all show_graph tests
* -
* • composition.py
_update_shadow_projections: raise error for attempt to shadow INTERNAL Node of nested comp
* -
* -
* • test_composition.py
implemented test_shadow_nested_nodes that tests shadowing of nested nodes
* -
* -
* -
* -
* • optimizationcontrolmechanism.py: docstring mods
* • composition.py:
- add allow_probes and exclude_probes_from_output
* • composition.py:
- docstring mods re: allow_probes
• optimizationcontrolmechanism.py:
- allow_probes: eliminate DIRECT setting
- remove _parse_monitor_for_control_input_ports (no longer needed without allow_probes=DIRECT)
* • composition.py:
- change "exclude_probes_from_output" -> "include_probes_in_output"
* • composition.py:
- docstring mods re: allow_probes and include_probes_in_output
* • composition.py:
- docstring mods re: allow_probes and include_probes_in_output
* • controlmechanism.py:
- add allow_probes handling (moved from OCM)
• optimizationcontrolmechanism.py:
- move allow_probes to controlmechanism.py
• composition.py:
- refactor handling of allow_probes to permit for any ControlMechanism
• objectivemechanism.py:
- add modulatory_mechanism attribute
* • controlmechanism.py:
- add allow_probes handling (moved from OCM)
• optimizationcontrolmechanism.py:
- move allow_probes to controlmechanism.py
• composition.py:
- refactor handling of allow_probes to permit for any ControlMechanism
- add _handle_allow_probes_for_control() to reconcile setting on Composition and ControlMechanism
• objectivemechanism.py:
- add modulatory_mechanism attribute
* • composition.py
add assignment of learning_mechanism to objective_mechanism.modulatory_mechanism for add_learning methods
* • docstring mods
* -
* -
* • optimizationcontrolmechanism.py: docstring revs
* -
* -
* • test_composition.py:
- add test_unnested_PROBE
- add test_nested_PROBES
TBD: test include_probes_in_output
* -
* • composition.py
- add_node(): support tuple with required_role
* -
* • composition.py:
- _determine_node_roles:
fix bug in which nested comp was prevented from being an OUTPUT Node if,
in addition to Nodes that qualifed as OUTPUT, it also had nodes that projected
to Nodes in an outer comp (making it look like it was INTERNAL)
* -
* • composition.py:
- add_node(): enforce include_probes_in_output = True for nested Compositions
- execute():
- replace return of output_value with get_output_value()
* -
* • CompositionInterfaceMechanism.rst:
- correct path ref
• compositioninterfacemechanism.py:
- docstring fixes
* • compositioninterfacemechanism.py:
- docstring edits
* -
* -
* -
* -
* -
* -
* -
* -
* -
* • composition.py:
add_projection: _parse_projection_spec -> _instantiate_projection_from_spec
* • composition.py:
add_projection: _parse_projection_spec -> _instantiate_projection_from_spec
* • composition.py
- add_linear_processing_pathway:
support one->many and many->one configurations in pathway specification
(see docstring for method)
* -
* • composition.py
_add_linear_processing_pathway, add_projection, _is_pathway_entry_spec:
- support many->one and one->many projections between mech and comps in pathway spec: working
- support set of Projections as legal entry in pathway spec: TBI
* • composition.py
_add_linear_processing_pathway, add_projection, _is_pathway_entry_spec:
- support many->one and one->many projections between mech and comps in pathway spec: working
- support set of Projections as legal entry in pathway spec: TBI
* • show_graph.py
_assign_cim_components(): fix bug in which comp1_output_cim->comp2_input_cim was skipped
* • compositioninterfacemechanism.py: docstring mod
* -
* • composition.py: minor formatting
* • composition.py
add_linear_processing_pathway(): eliminate TARGET Nodes from one->many
* -
* • composition.py:
- add_linear_processing_pathway(): add recursive search for nested INPUT and OUTPUT nodes
* • composition.py:
- add_linear_processing_pathway():
- exclude Target Nodes from search for INPUT nodes (handled by learning)
- add recursive search for nested INPUT and OUTPUT nodes
* -
* -
* • composition.py
add_projection: working on adding support for projection sets
* -
* -
* • composition.py
- add _get_nested_nodes_with_same_roles_at_all_levels
- add_linear_processing_pathway:
call _get_nested_nodes_with_same_roles_at_all_levels
* • composition.py
- add_linear_processing_pathway: add support for inline specification of set of Projections
* -
* -
* • composition.py
add_linear_processing_pathway: refactored to support inline specification of sets of Projections
* • composition.py
add_linear_processing_pathway: docstring edits for Projection set specification
* -
* -
* -
* -
* -
* • test_composition.py:
- add test_add_multiple_projections_for_nested_compositions - IN PROGRESS
* • test_composition.py:
- add test_add_multiple_projections_for_nested_compositions - passes
* -
* -
* • compositioninterfacemechanism.py: add figure and example
Co-authored-by: Jan Vesely <jan.vesely@rutgers.edu>
Co-authored-by: jdcpni <pniintel55>
Co-authored-by: Katherine Mantel <kmantel@princeton.edu>
functions: set fallback_default=True for seed parameter
* • test_report.py: passing all tests
* • Passes all tests!
* -
* -
* • composition.py: reorganize with #region and #enregions
* • composition.py: reorganize with #region and #enregions
* • controlmechanism.py, optimizationcontrolmechanism.py:
- _instantiate_monitor_for_control_input_ports -> _parse_monitor_control_input_ports
- refactored to support allow_probes option on ocm
* -
* -
* -
* • controlmechanism.py, optimizationcontrolmechanism.py:
- _instantiate_monitor_for_control_input_ports -> _parse_monitor_control_input_ports
- refactored to support allow_probes option on ocm
* • controlmechanism.py, optimizationcontrolmechanism.py:
- _instantiate_monitor_for_control_input_ports -> _parse_monitor_control_input_ports
- refactored to support allow_probes option on ocm
* -
* • composition.py:
__init__: move controller to after add_nodes and add_linear_pathway
* -
* - test_control: only test_hanging_control_spec_outer_controller not passing
* -
* -
* -
* -
* -
* -
* • composition.py:
_instantiate_control_projections:
weird requirement for double-call to controller._instantiate_control_signal
* • test_paremtercomposition.py:
restored parameter spec that causes crash ('threshold',Decision2)
* ª Attempt to fix problem with partially overlapping local and ocm control specs
- composition.py
- _get_control_signals_for_composition: (see 11/20/21)
- added (but commented out change) to "if node.controller" to "if not node.controller"
- changed append to extend
- _instantiation_control_projection:
- got rid of try and except double-call to controller._instantiate_control_signals
- outdented call to self.controller._activate_projections_for_composition at end
- controlmechanism.py:
- _check_for_duplicates: add warning and return duplicates
- optimizationcontrolmechanism._instantiate_control_signals:
- add call to self.agent_rep._get_control_signals_for_composition() to get local control specs (on mechs in comp)
- eliminate duplicates with control_signal specs on OCM
- instantiate local + ocm control_signals
- parameterestimationcomposition.py
- added context to various calls
* see later commit
* see later commit
* see later commit
* see later commit
* - This branch passes all tests except:
- test_parameterestimationcomposition
- test_composition/test_partially_overlapping_control_specs (ADDED IN THIS COMMINT)
- All relevant changes to this branch are marked as "11/21/21."
However, most are commented out as they break other things.
- The tests above both involve local control specifications (on mechanism within a nested comp)
and on the OCM for the outer composition, some of which are for the same nested mechs
- Both tests fail with:
"AttributeError: 'NoneType' object has no attribute '_get_by_time_scale'" (in component.py LINE 3276)
This may be due to a problem with context setting, since the error is because the modulation Parameter
of the ControlProjection is returning "None" rather than "multiplicative_param" (when called with get(context)),
whereas "multiplicative_param" is returned with a call to get() (i.e., with no context specified)
- Most of test_partially_overlapping_control_specs is passed if
changes marked "11/21/21 NEW" in optimizationcontrolmechanism.py (LINE 1390) are implemented,
but it does not properly route ControlProjections through parameter_CIMS (see last assert in test).
Furthermore, test_parameterestimationcompsition fails with the mod param error, even though the
model has similar structure (i.e., outer composition -- in this case a ParameterEstimationComposition)
with an OCM that is given control specs that overlap with ones in a nested composition.
- There are also several other things in composition I found puzzling and tried modifying, but that cuased failures:
- _get_control_signals_for_composition():
- seems "if node.controller" should be "if **not** node.controller" (emphasis added just for comment)
- "append" should be "extend"
- _instantiate_control_projection():
- call to self.controller._activate_projections_for_composition (at end of method) should not be indented
* - small mods; don't impact anything relevant to prior commit message
* - small mods; don't impact anything relevant to prior commit message
* - small mods; don't impact anything relevant to prior commit message
* - finished adding formatting regions to composition.py
* -
* • composition.py:
- rename _check_projection_initialization_status -> _check_controller_initialization_status
- add _check_nodes_initialization_status(context=context)
(and calls it with _check_controller_initialization_status)
* • show_graph.py: addressed bug associated with ocm.allow_direct_probe
* • show_graph.py: addressed bug associated with ocm.allow_direct_probe
* -
* Composition: add_controller: set METHOD as context source early
* -
* • composition.py
retore append of control_signals in _instantiate_control_projections()
* • composition.py
restore append of control_signals in _instantiate_control_projections()
• test_composition.py:
add test_partially_overlapping_local_and_control_mech_control_specs_in_unnested_and_nested_comp
* • test_partially_overlapping_local_and_control_mech_control_specs_in_unnested_and_nested_comp():
- added clear_registry() to allow names to be reused in both runs of test
* • composition.py
docstring: added projections entry to list of attributes
- add_controller: added call to _add_node_aux_components() for controller
* • composition.py
_add_node_aux_components(): added deletion of item from aux_components if instantiated
* • composition.py
- comment out _add_node_aux_components() (causing new failures)
- move _instantiate_control_projections to be with _instantiate_control_projections,
after self.add_node(self.controller.objective_mechanism (to be more orderly)
* -
* - confirm that it passes all tests exception test_composition/test_partially_overlapping...
(with addition of _add_aux_components in add_controller commented out)
* • composition.py: some more fixed to add_controller that now fail only one test:
- test_agent_rep_assignement_as_controller_and_replacement
* • Passes *all* current tests
* • composition.py:
- add_controller: few more minor mods;
still passes all tests
* -
* -
* -
* • controlmechanism.py:
- __init__: resrict specification to only one of control, modulatory_signals, or control_signals (synonyms)
* -
* • composition.py: in progress fix of bug in instantiating shadow projections for ocm.state_input_ports
* • composition.py:
- _get_original_senders(): added support for nested composition
needs to be checked for more than one level
needs to be refactored to be recursive
* • optimizationcontrolmechanism.py
- _update_state_input_ports_for_controller: fix invalid_state_features to allow input_CIM of nested comp in agent_rep
* -
* • composition.py
- _get_original_senders: made recursive
* • test_show_graph.py: update for fixes
* -
* • tests: passes all in test_show_graph.py and test_report.py
* Passes all tests
* - comment clean-up
* • composition.py
- add_controller and _get_nested_node_CIM_port:
added support for forced assignment of NodeRole.OUTPUT for nodes specified in OCM.monitor_for_control,
but referenced 'allow_probes' attribute still needs to be implemented
* • composition.py, optimizationcontrolmechanism.py:
allow_probes fully implemented
* • show_graph.py: fixed bug causing extra projections to OCM
* • composition.py:
- _update_shadow_projections(): fix handling of deep nesting
* • optimizationcontrolmechanism.py: add agent_rep_type property
* • optimizationcontrolmechanism.py:
- state_feature_function -> state_feature_functions
* • optimizationcontrolmechanism.py:
- _validate_params: validate state_feature_functions
- _update_state_input_ports_for_controller: implement assignment of state_feature_functions
* -
* -
* • Passes all tests except test_json with 'model_with_control'
* -
* • composition.py
- add_projection: delete instantiation of shadow projections (handled by _update_shadow_projections)
* • composition.py
- add_projection: delete instantiation of shadow projections (handled by _update_shadow_projections)
- remove calls to _update_shadows_dict
* • composition.py
- add_projection: delete instantiation of shadow projections (handled by _update_shadow_projections)
- remove calls to _update_shadows_dict
* -
* • test_two_origins_two_input_ports: crashes on failure of C->B to update
* -
* • composition.py
- added property shadowing_dict that has shadowing ports as keys and the ports they shadow as values
- refactored _update_shadowing_projections to use shadowing_dict
* • optimizationcontrolmechanism.py
- _update_state_input_ports: modified validations for nested nodes; still failing some tests
* • optimizationcontrolmechanism.py
- _update_state_input_ports:
more careful and informative validation that state_input_ports are in comp or nested comp and are INPUT nodes thereof;
passes all tests except test_two_origins_two_input_ports as before
* • composition.py
_get_invalid_aux_components(): defer all shadow projections until _update_shadow_projections
* • composition.py
_get_invalid_aux_components(): bug fix in test for shadow projections
* Port: _remove_projection_to_port: don't reduce variable below length 1
even ports with no incoming projections have variable at least length 1
* • composition.py
add_node(): marked (but haven't removed) code block instantiating shadow_projections
that seems now to be redundant with _update_shadow_projection
* • show_graph.py
- _assign_cim_components: supress showing projections not in composition
* • composition.py:
_analyze_graph(): add extra call to _determine_node_roles after _update_shadow_projections
_run(): moved block of code at beginning initializing scheduler to after
_complete_init_of_partially_initialized_nodes and _analyze_graph()
• show_graph.py
- add test to all loops on projections: "if proj in composition.projection"
* • show_graph.py
- add show_projections_not_in_composition option for debugging
* • composition.py
_update_shadow_projections(): delete unused shadow projections and corresponding ports
* • composition.py
_update_shadow_projections(): fix bug in deletion of unused shadow projections and ports
• test_show_graph: tests failing, need mods to accomodate changes
* • composition.py:
_analyze_graph(): add extra call to _determine_node_roles after _update_shadow_projections
_run(): moved block of code at beginning initializing scheduler to after
_complete_init_of_partially_initialized_nodes and _analyze_graph()
• show_graph.py
- add test to all loops on projections: "if proj in composition.projection"
* • show_graph.py
fixes; now passes all show_graph tests
* -
* • composition.py
_update_shadow_projections: raise error for attempt to shadow INTERNAL Node of nested comp
* -
* -
* • test_composition.py
implemented test_shadow_nested_nodes that tests shadowing of nested nodes
* -
* -
* -
* -
* • optimizationcontrolmechanism.py: docstring mods
* • composition.py:
- add allow_probes and exclude_probes_from_output
* • composition.py:
- docstring mods re: allow_probes
• optimizationcontrolmechanism.py:
- allow_probes: eliminate DIRECT setting
- remove _parse_monitor_for_control_input_ports (no longer needed without allow_probes=DIRECT)
* • composition.py:
- change "exclude_probes_from_output" -> "include_probes_in_output"
* • composition.py:
- docstring mods re: allow_probes and include_probes_in_output
* • composition.py:
- docstring mods re: allow_probes and include_probes_in_output
* • controlmechanism.py:
- add allow_probes handling (moved from OCM)
• optimizationcontrolmechanism.py:
- move allow_probes to controlmechanism.py
• composition.py:
- refactor handling of allow_probes to permit for any ControlMechanism
• objectivemechanism.py:
- add modulatory_mechanism attribute
* • controlmechanism.py:
- add allow_probes handling (moved from OCM)
• optimizationcontrolmechanism.py:
- move allow_probes to controlmechanism.py
• composition.py:
- refactor handling of allow_probes to permit for any ControlMechanism
- add _handle_allow_probes_for_control() to reconcile setting on Composition and ControlMechanism
• objectivemechanism.py:
- add modulatory_mechanism attribute
* • composition.py
add assignment of learning_mechanism to objective_mechanism.modulatory_mechanism for add_learning methods
* • docstring mods
* -
* -
* • optimizationcontrolmechanism.py: docstring revs
* -
* -
* • test_composition.py:
- add test_unnested_PROBE
- add test_nested_PROBES
TBD: test include_probes_in_output
* -
* • composition.py
- add_node(): support tuple with required_role
* -
* • composition.py:
- _determine_node_roles:
fix bug in which nested comp was prevented from being an OUTPUT Node if,
in addition to Nodes that qualifed as OUTPUT, it also had nodes that projected
to Nodes in an outer comp (making it look like it was INTERNAL)
* -
* • composition.py:
- add_node(): enforce include_probes_in_output = True for nested Compositions
- execute():
- replace return of output_value with get_output_value()
* -
* • CompositionInterfaceMechanism.rst:
- correct path ref
• compositioninterfacemechanism.py:
- docstring fixes
* • compositioninterfacemechanism.py:
- docstring edits
* -
* -
* -
* -
* -
* -
* -
* -
* -
* • composition.py:
add_projection: _parse_projection_spec -> _instantiate_projection_from_spec
* • composition.py:
add_projection: _parse_projection_spec -> _instantiate_projection_from_spec
* • composition.py
- add_linear_processing_pathway:
support one->many and many->one configurations in pathway specification
(see docstring for method)
* -
* • composition.py
_add_linear_processing_pathway, add_projection, _is_pathway_entry_spec:
- support many->one and one->many projections between mech and comps in pathway spec: working
- support set of Projections as legal entry in pathway spec: TBI
* • composition.py
_add_linear_processing_pathway, add_projection, _is_pathway_entry_spec:
- support many->one and one->many projections between mech and comps in pathway spec: working
- support set of Projections as legal entry in pathway spec: TBI
* • show_graph.py
_assign_cim_components(): fix bug in which comp1_output_cim->comp2_input_cim was skipped
* • compositioninterfacemechanism.py: docstring mod
* -
* • composition.py: minor formatting
* • composition.py
add_linear_processing_pathway(): eliminate TARGET Nodes from one->many
* -
* • composition.py:
- add_linear_processing_pathway(): add recursive search for nested INPUT and OUTPUT nodes
* • composition.py:
- add_linear_processing_pathway():
- exclude Target Nodes from search for INPUT nodes (handled by learning)
- add recursive search for nested INPUT and OUTPUT nodes
* -
* -
* • composition.py
add_projection: working on adding support for projection sets
* -
* -
* • composition.py
- add _get_nested_nodes_with_same_roles_at_all_levels
- add_linear_processing_pathway:
call _get_nested_nodes_with_same_roles_at_all_levels
* • composition.py
- add_linear_processing_pathway: add support for inline specification of set of Projections
* -
* -
* • composition.py
add_linear_processing_pathway: refactored to support inline specification of sets of Projections
* • composition.py
add_linear_processing_pathway: docstring edits for Projection set specification
* -
* -
* -
* -
* -
* • test_composition.py:
- add test_add_multiple_projections_for_nested_compositions - IN PROGRESS
* • test_composition.py:
- add test_add_multiple_projections_for_nested_compositions - passes
* -
* -
* • compositioninterfacemechanism.py: add figure and example
* • composition.py:
- get_inputs_format(): add method
- run(): allow inputs arg to take names of nodes
* • composition.py:
- get_inputs_format():
- implemented num_trials arg
- TBI: nested and labels
* -
* • composition.py
- get_input_format(): implement show_nested_input_nodes
* • composition.py
- get_input_format(): implement use_labels
* -
* -
* -
* -
* -
* -
* -
* -
* -
* -
* -
* • composition.py
get_input_format() - working; TBD: tests and documentation in composition docstring
* • composition.py
get_results_format() - working; TBD: tests and documentation in composition docstring
* -
* • composition.py: add error messages to _parse_label() and _validate_single_input()
* • composition.py: add error messages to _parse_label() and _validate_single_input()
* -
* • composition.py: docstring mods
* • composition.py - reorganize docstring section on execution
* -
* -
* -
* -
* • test_composition.py / test_input_labels_and_no_orphaning_of_nested_output_nodes:
added tests for lables in input
* • composition.py: _validate_single_input - get rid of tests (taken care of in _parse_labels)
* • test_composition.py/test_input_labels_and_results_by_node_and_no_orphaning_of_nested_output_nodes:
- renamed, add test for get_results_by_node
* • composition.py
- _parse_labels: suppress warning about targets if no learning_components in pway
* -
* • composition.py: further docstring updates for get_input_format() and get_results_by_node()
* -
* -
* -
* -
* -
* • composition.py
- get_results_by_node(): add use_labels option
Co-authored-by: jdcpni <pniintel55>
Co-authored-by: Katherine Mantel <kmantel@princeton.edu>
uses same suffixing to add ports for any subfunctions of subfunctions instead of just those of the primary object.
Create ParameterPorts for all functions of functions
* -
* • composition.py:
_instantiate_control_projections:
weird requirement for double-call to controller._instantiate_control_signal
* • test_paremtercomposition.py:
restored parameter spec that causes crash ('threshold',Decision2)
* ª Attempt to fix problem with partially overlapping local and ocm control specs
- composition.py
- _get_control_signals_for_composition: (see 11/20/21)
- added (but commented out change) to "if node.controller" to "if not node.controller"
- changed append to extend
- _instantiation_control_projection:
- got rid of try and except double-call to controller._instantiate_control_signals
- outdented call to self.controller._activate_projections_for_composition at end
- controlmechanism.py:
- _check_for_duplicates: add warning and return duplicates
- optimizationcontrolmechanism._instantiate_control_signals:
- add call to self.agent_rep._get_control_signals_for_composition() to get local control specs (on mechs in comp)
- eliminate duplicates with control_signal specs on OCM
- instantiate local + ocm control_signals
- parameterestimationcomposition.py
- added context to various calls
* see later commit
* see later commit
* see later commit
* see later commit
* - This branch passes all tests except:
- test_parameterestimationcomposition
- test_composition/test_partially_overlapping_control_specs (ADDED IN THIS COMMINT)
- All relevant changes to this branch are marked as "11/21/21."
However, most are commented out as they break other things.
- The tests above both involve local control specifications (on mechanism within a nested comp)
and on the OCM for the outer composition, some of which are for the same nested mechs
- Both tests fail with:
"AttributeError: 'NoneType' object has no attribute '_get_by_time_scale'" (in component.py LINE 3276)
This may be due to a problem with context setting, since the error is because the modulation Parameter
of the ControlProjection is returning "None" rather than "multiplicative_param" (when called with get(context)),
whereas "multiplicative_param" is returned with a call to get() (i.e., with no context specified)
- Most of test_partially_overlapping_control_specs is passed if
changes marked "11/21/21 NEW" in optimizationcontrolmechanism.py (LINE 1390) are implemented,
but it does not properly route ControlProjections through parameter_CIMS (see last assert in test).
Furthermore, test_parameterestimationcompsition fails with the mod param error, even though the
model has similar structure (i.e., outer composition -- in this case a ParameterEstimationComposition)
with an OCM that is given control specs that overlap with ones in a nested composition.
- There are also several other things in composition I found puzzling and tried modifying, but that cuased failures:
- _get_control_signals_for_composition():
- seems "if node.controller" should be "if **not** node.controller" (emphasis added just for comment)
- "append" should be "extend"
- _instantiate_control_projection():
- call to self.controller._activate_projections_for_composition (at end of method) should not be indented
* - small mods; don't impact anything relevant to prior commit message
* - small mods; don't impact anything relevant to prior commit message
* - small mods; don't impact anything relevant to prior commit message
* - finished adding formatting regions to composition.py
* -
* • composition.py:
- rename _check_projection_initialization_status -> _check_controller_initialization_status
- add _check_nodes_initialization_status(context=context)
(and calls it with _check_controller_initialization_status)
* • show_graph.py: addressed bug associated with ocm.allow_direct_probe
* • show_graph.py: addressed bug associated with ocm.allow_direct_probe
* -
* Composition: add_controller: set METHOD as context source early
* -
* • composition.py
retore append of control_signals in _instantiate_control_projections()
* • composition.py
restore append of control_signals in _instantiate_control_projections()
• test_composition.py:
add test_partially_overlapping_local_and_control_mech_control_specs_in_unnested_and_nested_comp
* • test_partially_overlapping_local_and_control_mech_control_specs_in_unnested_and_nested_comp():
- added clear_registry() to allow names to be reused in both runs of test
* • composition.py
docstring: added projections entry to list of attributes
- add_controller: added call to _add_node_aux_components() for controller
* • composition.py
_add_node_aux_components(): added deletion of item from aux_components if instantiated
* • composition.py
- comment out _add_node_aux_components() (causing new failures)
- move _instantiate_control_projections to be with _instantiate_control_projections,
after self.add_node(self.controller.objective_mechanism (to be more orderly)
* -
* - confirm that it passes all tests exception test_composition/test_partially_overlapping...
(with addition of _add_aux_components in add_controller commented out)
* • composition.py: some more fixed to add_controller that now fail only one test:
- test_agent_rep_assignement_as_controller_and_replacement
* • Passes *all* current tests
* • composition.py:
- add_controller: few more minor mods;
still passes all tests
* -
* -
* -
* • controlmechanism.py:
- __init__: resrict specification to only one of control, modulatory_signals, or control_signals (synonyms)
* -
* • composition.py: in progress fix of bug in instantiating shadow projections for ocm.state_input_ports
* • composition.py:
- _get_original_senders(): added support for nested composition
needs to be checked for more than one level
needs to be refactored to be recursive
* • optimizationcontrolmechanism.py
- _update_state_input_ports_for_controller: fix invalid_state_features to allow input_CIM of nested comp in agent_rep
* -
* • composition.py
- _get_original_senders: made recursive
* • test_show_graph.py: update for fixes
* -
* • tests: passes all in test_show_graph.py and test_report.py
* Passes all tests
* - comment clean-up
* • composition.py
- add_controller and _get_nested_node_CIM_port:
added support for forced assignment of NodeRole.OUTPUT for nodes specified in OCM.monitor_for_control,
but referenced 'allow_probes' attribute still needs to be implemented
* • composition.py, optimizationcontrolmechanism.py:
allow_probes fully implemented
* • show_graph.py: fixed bug causing extra projections to OCM
* • composition.py:
- _update_shadow_projections(): fix handling of deep nesting
* • optimizationcontrolmechanism.py: add agent_rep_type property
* • optimizationcontrolmechanism.py:
- state_feature_function -> state_feature_functions
* • optimizationcontrolmechanism.py:
- _validate_params: validate state_feature_functions
- _update_state_input_ports_for_controller: implement assignment of state_feature_functions
* -
* -
* • Passes all tests except test_json with 'model_with_control'
* -
* • composition.py
- add_projection: delete instantiation of shadow projections (handled by _update_shadow_projections)
* • composition.py
- add_projection: delete instantiation of shadow projections (handled by _update_shadow_projections)
- remove calls to _update_shadows_dict
* • composition.py
- add_projection: delete instantiation of shadow projections (handled by _update_shadow_projections)
- remove calls to _update_shadows_dict
* -
* • test_two_origins_two_input_ports: crashes on failure of C->B to update
* -
* • composition.py
- added property shadowing_dict that has shadowing ports as keys and the ports they shadow as values
- refactored _update_shadowing_projections to use shadowing_dict
* • optimizationcontrolmechanism.py
- _update_state_input_ports: modified validations for nested nodes; still failing some tests
* • optimizationcontrolmechanism.py
- _update_state_input_ports:
more careful and informative validation that state_input_ports are in comp or nested comp and are INPUT nodes thereof;
passes all tests except test_two_origins_two_input_ports as before
* • composition.py
_get_invalid_aux_components(): defer all shadow projections until _update_shadow_projections
* • composition.py
_get_invalid_aux_components(): bug fix in test for shadow projections
* Port: _remove_projection_to_port: don't reduce variable below length 1
even ports with no incoming projections have variable at least length 1
* • composition.py
add_node(): marked (but haven't removed) code block instantiating shadow_projections
that seems now to be redundant with _update_shadow_projection
* • show_graph.py
- _assign_cim_components: supress showing projections not in composition
* • composition.py:
_analyze_graph(): add extra call to _determine_node_roles after _update_shadow_projections
_run(): moved block of code at beginning initializing scheduler to after
_complete_init_of_partially_initialized_nodes and _analyze_graph()
• show_graph.py
- add test to all loops on projections: "if proj in composition.projection"
* • show_graph.py
- add show_projections_not_in_composition option for debugging
* • composition.py
_update_shadow_projections(): delete unused shadow projections and corresponding ports
* • composition.py
_update_shadow_projections(): fix bug in deletion of unused shadow projections and ports
• test_show_graph: tests failing, need mods to accomodate changes
* • composition.py:
_analyze_graph(): add extra call to _determine_node_roles after _update_shadow_projections
_run(): moved block of code at beginning initializing scheduler to after
_complete_init_of_partially_initialized_nodes and _analyze_graph()
• show_graph.py
- add test to all loops on projections: "if proj in composition.projection"
* • show_graph.py
fixes; now passes all show_graph tests
* -
* • composition.py
_update_shadow_projections: raise error for attempt to shadow INTERNAL Node of nested comp
* -
* -
* • test_composition.py
implemented test_shadow_nested_nodes that tests shadowing of nested nodes
* -
* -
* -
* -
* • optimizationcontrolmechanism.py: docstring mods
* • composition.py:
- add allow_probes and exclude_probes_from_output
* • composition.py:
- docstring mods re: allow_probes
• optimizationcontrolmechanism.py:
- allow_probes: eliminate DIRECT setting
- remove _parse_monitor_for_control_input_ports (no longer needed without allow_probes=DIRECT)
* • composition.py:
- change "exclude_probes_from_output" -> "include_probes_in_output"
* • composition.py:
- docstring mods re: allow_probes and include_probes_in_output
* • composition.py:
- docstring mods re: allow_probes and include_probes_in_output
* • controlmechanism.py:
- add allow_probes handling (moved from OCM)
• optimizationcontrolmechanism.py:
- move allow_probes to controlmechanism.py
• composition.py:
- refactor handling of allow_probes to permit for any ControlMechanism
• objectivemechanism.py:
- add modulatory_mechanism attribute
* • controlmechanism.py:
- add allow_probes handling (moved from OCM)
• optimizationcontrolmechanism.py:
- move allow_probes to controlmechanism.py
• composition.py:
- refactor handling of allow_probes to permit for any ControlMechanism
- add _handle_allow_probes_for_control() to reconcile setting on Composition and ControlMechanism
• objectivemechanism.py:
- add modulatory_mechanism attribute
* • composition.py
add assignment of learning_mechanism to objective_mechanism.modulatory_mechanism for add_learning methods
* • docstring mods
* -
* -
* • optimizationcontrolmechanism.py: docstring revs
* -
* -
* • test_composition.py:
- add test_unnested_PROBE
- add test_nested_PROBES
TBD: test include_probes_in_output
* -
* • composition.py
- add_node(): support tuple with required_role
* -
* • composition.py:
- _determine_node_roles:
fix bug in which nested comp was prevented from being an OUTPUT Node if,
in addition to Nodes that qualifed as OUTPUT, it also had nodes that projected
to Nodes in an outer comp (making it look like it was INTERNAL)
* -
* • composition.py:
- add_node(): enforce include_probes_in_output = True for nested Compositions
- execute():
- replace return of output_value with get_output_value()
* -
* • CompositionInterfaceMechanism.rst:
- correct path ref
• compositioninterfacemechanism.py:
- docstring fixes
* • compositioninterfacemechanism.py:
- docstring edits
* -
* -
* -
* -
* -
* -
* -
* -
* -
* • composition.py:
add_projection: _parse_projection_spec -> _instantiate_projection_from_spec
* • composition.py:
add_projection: _parse_projection_spec -> _instantiate_projection_from_spec
* • composition.py
- add_linear_processing_pathway:
support one->many and many->one configurations in pathway specification
(see docstring for method)
* -
* • composition.py
_add_linear_processing_pathway, add_projection, _is_pathway_entry_spec:
- support many->one and one->many projections between mech and comps in pathway spec: working
- support set of Projections as legal entry in pathway spec: TBI
* • composition.py
_add_linear_processing_pathway, add_projection, _is_pathway_entry_spec:
- support many->one and one->many projections between mech and comps in pathway spec: working
- support set of Projections as legal entry in pathway spec: TBI
* • show_graph.py
_assign_cim_components(): fix bug in which comp1_output_cim->comp2_input_cim was skipped
* • compositioninterfacemechanism.py: docstring mod
* -
* • composition.py: minor formatting
* • composition.py
add_linear_processing_pathway(): eliminate TARGET Nodes from one->many
* -
* • composition.py:
- add_linear_processing_pathway(): add recursive search for nested INPUT and OUTPUT nodes
* • composition.py:
- add_linear_processing_pathway():
- exclude Target Nodes from search for INPUT nodes (handled by learning)
- add recursive search for nested INPUT and OUTPUT nodes
* -
* -
* • composition.py
add_projection: working on adding support for projection sets
* -
* -
* • composition.py
- add _get_nested_nodes_with_same_roles_at_all_levels
- add_linear_processing_pathway:
call _get_nested_nodes_with_same_roles_at_all_levels
* • composition.py
- add_linear_processing_pathway: add support for inline specification of set of Projections
* -
* -
* • composition.py
add_linear_processing_pathway: refactored to support inline specification of sets of Projections
* • composition.py
add_linear_processing_pathway: docstring edits for Projection set specification
* -
* -
* -
* -
* -
* • test_composition.py:
- add test_add_multiple_projections_for_nested_compositions - IN PROGRESS
* • test_composition.py:
- add test_add_multiple_projections_for_nested_compositions - passes
* -
* -
* • compositioninterfacemechanism.py: add figure and example
* • composition.py:
- get_inputs_format(): add method
- run(): allow inputs arg to take names of nodes
* • composition.py:
- get_inputs_format():
- implemented num_trials arg
- TBI: nested and labels
* -
* • composition.py
- get_input_format(): implement show_nested_input_nodes
* • composition.py
- get_input_format(): implement use_labels
* -
* -
* -
* -
* -
* -
* -
* -
* -
* -
* -
* • composition.py
get_input_format() - working; TBD: tests and documentation in composition docstring
* • composition.py
get_results_format() - working; TBD: tests and documentation in composition docstring
* -
* • composition.py: add error messages to _parse_label() and _validate_single_input()
* • composition.py: add error messages to _parse_label() and _validate_single_input()
* -
* • composition.py: docstring mods
* • composition.py - reorganize docstring section on execution
* -
* -
* -
* -
* • test_composition.py / test_input_labels_and_no_orphaning_of_nested_output_nodes:
added tests for lables in input
* • composition.py: _validate_single_input - get rid of tests (taken care of in _parse_labels)
* • test_composition.py/test_input_labels_and_results_by_node_and_no_orphaning_of_nested_output_nodes:
- renamed, add test for get_results_by_node
* • composition.py
- _parse_labels: suppress warning about targets if no learning_components in pway
* -
* • composition.py: further docstring updates for get_input_format() and get_results_by_node()
* -
* -
* -
* -
* -
* • composition.py
- get_results_by_node(): add use_labels option
* -
* -
* -
* • composition.py
- get_results_by_nodes: allow specification of individual nodes
* • composition.py
- get_results_by_nodes: allow specification of individual nodes
* • composition.py
- get_results_by_nodes: allow specification of individual nodes
* -
* -
* • mechanism.py:
add input_labels and output_labels as args to constructor
* -
* -
* • project: remove scale from figures
* -
* -
* -
* • README.rst and composition.py: add links to CGO paper
* • README.rst, index.rst and composition.py:
- updates to contribtors
- add links to CGO paper
Co-authored-by: Katherine Mantel <kmantel@princeton.edu>
Co-authored-by: jdcpni <pniintel55>
|
please do not 'squash' this PR |
|
This PR causes the following changes to the html docs (ubuntu-latest-3.7-x64): See CI logs for the full diff. |
1 similar comment
|
This PR causes the following changes to the html docs (ubuntu-latest-3.7-x64): See CI logs for the full diff. |
A follow up merge to preserve history.
|
This PR causes the following changes to the html docs (ubuntu-latest-3.7-x64): See CI logs for the full diff. |
kmantel
approved these changes
Jan 4, 2022
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.