Testing: Ingest expected files and input workfile

[tokejepsen]

Changelog Description

This ingests the Maya workfile from the Drive storage. Have changed the format to MayaAscii so its easier to see what changes are happening in a PR. This meant changing the expected files and database entries as well.

Testing notes:

.\openpype_console.bat runtests C:\Users\tokejepsen\OpenPype\tests\integration\hosts\maya\test_publish_in_maya.py --mongo_url "mongodb://localhost:2707/"

Split from #5644

[kalisp]

Implemented LocalFileHandler to load from folder in repo. (And to match all other folder comparison.)
Test name added to structure to separate files for each test.

Removed superfluous files to keep other Maya test working

[tokejepsen]

@kalisp nice solution!

I've fixed some issues and added a suggestion to skip directories when checking the folder structure, otherwise I get this error when testing Maya:

___________________________ TestPublishInMaya.test_folder_structure_same ____________________________

self = <test_publish_in_maya.TestPublishInMaya object at 0x000002E6D52E2760>
dbcon = <openpype.pipeline.mongodb.AvalonMongoDB object at 0x000002E6D50BBF40>
publish_finished = True, download_test_data = 'C:\\Users\\TOKEJE~1\\AppData\\Local\\Temp\\tmpc71s9xn6'
output_folder_url = 'C:\\Users\\TOKEJE~1\\AppData\\Local\\Temp\\tmpc71s9xn6\\output'
skip_compare_folders = [], setup_only = None

    def test_folder_structure_same(self, dbcon, publish_finished,
                                   download_test_data, output_folder_url,
                                   skip_compare_folders,
                                   setup_only):
        """Check if expected and published subfolders contain same files.

            Compares only presence, not size nor content!
        """
        if setup_only or self.SETUP_ONLY:
            print("Creating only setup for test, not launching app")
            return

        published_dir_base = output_folder_url
        expected_dir_base = os.path.join(download_test_data,
                                         "expected")

        print(
            "Comparing published:'{}' : expected:'{}'".format(
                published_dir_base, expected_dir_base
            )
        )

        def get_files(dir_base):
            result = set()

            for f in glob.glob(dir_base + "\\**", recursive=True):
                #if os.path.isdir(f):
                #    continue

                if f != dir_base and os.path.exists(f):
                    result.add(f.replace(dir_base, ""))

            return result

        published = get_files(published_dir_base)
        expected = get_files(expected_dir_base)

        filtered_published = self._filter_files(
            published, skip_compare_folders
        )

        # filter out temp files also in expected
        # could be polluted by accident by copying 'output' to zip file
        filtered_expected = self._filter_files(expected, skip_compare_folders)

        not_matched = filtered_expected.symmetric_difference(
            filtered_published
        )
        if not_matched:
>           raise AssertionError(
                "Missing {} files".format("\n".join(sorted(not_matched)))
            )
E           AssertionError: Missing \test_project\test_asset\work\test_task\cache
E           \test_project\test_asset\work\test_task\cache\alembic files

..\tests\lib\testing_classes.py:413: AssertionError

We could maybe look at preventing Maya from creating the empty folder in the first place, but I dont think that is worth the effort. And is there any point in testing for empty folders?

[kalisp]

I think there is no need to test empty folders, just wondering why it haven't happened for me.

(Oh, I know, thats probably git, it will not create empty folders but I copied them.)

[kalisp]

Does this still depend on #5785 ? I think that one should be closed and only this PR used.

[tokejepsen]

Does this still depend on #5785 ? I think that one should be closed and only this PR used.

No its does not depend on #5785 anymore. Will close that PR when this gets merged.