Current regression testing 2025-03-09

[ue71603]

failing in swissinterchange_r:

2025-03-09 15:22:48,989 - script_runner - INFO - swissinterchange_r - step: 8: gtfs_db_to_db.py d:/aux_testing_processing/swissinterchange_r/07-ch-inter-gtfs.duckdb d:/aux_testing_processing/swissinterchange_r/08-ch-inter-2-gtfs.duckdb
Database StopPlace does not exist, creating it.
Database PassengerStopAssignment does not exist, creating it.
Database ScheduledStopPoint does not exist, creating it.
gtfs_operator_line_memory
2025-03-09 15:22:49,136 - script_runner - ERROR - None Traceback (most recent call last):
File "D:\development\github\reference\gtfs-netex-test\tool_script_runner.py", line 345, in
main(args.script_file, args.log_file, args.log_level, args.blockname, begin_step=args.begin_step,end_step=args.end_step, this_step=args.this_step)
File "D:\development\github\reference\gtfs-netex-test\tool_script_runner.py", line 306, in main
result=load_and_run(script_name, script_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\development\github\reference\gtfs-netex-test\tool_script_runner.py", line 79, in load_and_run
result = mod(*args1)
^^^^^^^^^^^
File "D:\development\github\reference\gtfs-netex-test\gtfs_db_to_db.py", line 30, in main
gtfs_operator_line_memory(db_read, db_write, {})
File "D:\development\github\reference\gtfs-netex-test\transformers\gtfs.py", line 67, in gtfs_operator_line_memory
operator: Operator = db_read.get_single(db_read.get_class_by_name(role_assignment.responsible_organisation_ref.name_of_ref_class), role_assignment.responsible_organisation_ref.ref, role_assignment.responsible_organisation_ref.version)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\development\github\reference\gtfs-netex-test\netexio\database.py", line 486, in get_class_by_name
return self.serializer.name_object[name]
~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^
KeyError: None

Process finished with exit code 0

[skinkie]

Lets start with updating the naming there to use lmdb?

[ue71603]

names updated. Somehow the error in interchange_r did not occur here.

[skinkie]

Most of the issues I have observed have to do with "old data" in the database. I think clearing it up may be a good idea.

[skinkie]

This one still exists.

[skinkie]

@ue71603 the reason why this fails is because the reference does not specify which class it is referencing. As you are well aware, the XSD would allow multiple objects to be referenced, and given that each of them have their own id space, one could never truly know what id is being referenced unless the class is specified. Now you could say something like: consider a key-class relationship. I really think if you want that it would be firstly a new feature, secondly I think it would be foolish to do this on the fly. I would say tag the nameOfRefClass for potentially ambigious types. I think we might already have the information in the referencing table.

What we can't guarentee have is this information when parsing the file. It is well possible that we get broken reference, before any object that can potentially claim it.

                <ResponsibilityRoleAssignment id="ch:1:ResponsibilityRoleAssignment:AAG_811_AAG:1" version="any">
                  <StakeholderRoleType>EntityLegalOwnership</StakeholderRoleType>
                  <ResponsibleOrganisationRef version="any" ref="ch:1:Operator:811"/>
                </ResponsibilityRoleAssignment>
                <ResponsibilityRoleAssignment id="ch:1:ResponsibilityRoleAssignment:AAG_811_AAG:2" version="any">
                  <StakeholderRoleType>Operation</StakeholderRoleType>
                  <ResponsibleOrganisationRef version="any" ref="ch:1:Operator:811"/>
                </ResponsibilityRoleAssignment>

<xsd:keyref name="Organisation_AnyKeyRef" refer="netex:Organisation_AnyVersionedKey">
        <xsd:selector xpath=".//netex:OrganisationRef | .//netex:ResponsibleOrganisationRef | .//netex:ProvidedByRef"/>
        <xsd:field xpath="@ref"/>
        <xsd:field xpath="@version"/>
</xsd:keyref>
<xsd:key name="Organisation_AnyVersionedKey">
        <xsd:selector xpath=".//netex:GeneralOrganisation | .//netex:Authority | .//netex:Operator | .//netex:ServicedOrganisation | .//netex:TravelAgent | .//netex:ManagementAgent | .//netex:RetailConsortium | .//netex:OnlineServiceOperator"/>
        <xsd:field xpath="@id"/>
        <xsd:field xpath="@version"/>
</xsd:key>