test: add non-debian based tests for gawk

[donheshanthaka]

Add Fedora rpm and openwrt ipk files to gawk tests

fixes: #3409

[donheshanthaka]

Hey there @terriko some of the tests are failing and i'm not sure how to debug them, i'm getting errors when running the scanner tests locally as well. I have attached a copy of my local ouput. Will you be able to help me on this?

FAILED test/test_scanner.py::TestScanner::test_version_in_package[https://downloads.openwrt.org/releases/22.03.0/packages/x86_64/routing/-bird1-ipv4_1.6.8-2_x86_64.ipk-bird-1.6.8-other_products54] - AssertionError: bird not found in bird1-ipv4_1.6.8-2_x86_64.ipk. FAILED test/test_scanner.py::TestScanner::test_version_in_package[http://rpmfind.net/linux/openmandriva/cooker/repository/aarch64/main/release/-bison-3.8.2-6-omv4090.aarch64.rpm-bison-3.8.2-other_products55] - AssertionError: bison not found in bison-3.8.2-6-omv4090.aarch64.rpm. FAILED test/test_scanner.py::TestScanner::test_version_in_package[http://rpmfind.net/linux/openmandriva/cooker/repository/x86_64/main/release/-bison-3.8.2-6-omv4090.x86_64.rpm-bison-3.8.2-other_products56] - AssertionError: bison not found in bison-3.8.2-6-omv4090.x86_64.rpm. FAILED test/test_scanner.py::TestScanner::test_version_in_package[http://ftp.fr.debian.org/debian/pool/main/b/bison/-bison_3.0.2.dfsg-2_amd64.deb-bison-3.0.2-other_products57] - AssertionError: bison not found in bison_3.0.2.dfsg-2_amd64.deb. FAILED test/test_scanner.py::TestScanner::test_version_in_package[http://ftp.fr.debian.org/debian/pool/main/b/bison/-bison_3.0.2.dfsg-2_armel.deb-bison-3.0.2-other_products58] - AssertionError: bison not found in bison_3.0.2.dfsg-2_armel.deb. FAILED test/test_scanner.py::TestScanner::test_version_in_package[http://rpmfind.net/linux/fedora/linux/development/rawhide/Everything/aarch64/os/Packages/b/-bluez-5.66-5.fc38.aarch64.rpm-bluez-5.66-other_products59] - AssertionError: bluez not found in bluez-5.66-5.fc38.aarch64.rpm. FAILED test/test_scanner.py::TestScanner::test_version_in_package[http://ftp.fr.debian.org/debian/pool/main/b/bluez/-bluez_5.50-1.2~deb10u2_amd64.deb-bluez-5.50-other_products60] - AssertionError: bluez not found in bluez_5.50-1.2~deb10u2_amd64.deb. FAILED test/test_scanner.py::TestScanner::test_version_in_package[https://downloads.openwrt.org/releases/packages-19.07/x86_64/packages/-bluez-daemon_5.50-5_x86_64.ipk-bluez-5.50-other_products61] - AssertionError: bluez not found in bluez-daemon_5.50-5_x86_64.ipk. FAILED test/test_scanner.py::TestScanner::test_version_in_package[http://rpmfind.net/linux/opensuse/ports/aarch64/tumbleweed/repo/oss/aarch64/-libboinc7-7.20.2-1.3.aarch64.rpm-boinc-7.20.2-other_products62] - AssertionError: boinc not found in libboinc7-7.20.2-1.3.aarch64.rpm. FAILED test/test_scanner.py::TestScanner::test_version_in_package[http://ftp.fr.debian.org/debian/pool/main/b/boinc/-boinc-client_7.10.2+dfsg-2~bpo9+1_amd64.deb-boinc-7.10.2-other_products63] - AssertionError: boinc not found in boinc-client_7.10.2+dfsg-2~bpo9+1_amd64.deb. FAILED test/test_scanner.py::TestScanner::test_version_in_package[https://downloads.openwrt.org/releases/packages-19.07/x86_64/packages/-boinc_7.16.16-1_x86_64.ipk-boinc-7.16.16-other_products64] - AssertionError: boinc not found in boinc_7.16.16-1_x86_64.ipk. FAILED test/test_scanner.py::TestScanner::test_version_in_package[http://rpmfind.net/linux/opensuse/ports/i586/tumbleweed/repo/oss/i586/-libbotan-2-19-2.19.3-1.2.i586.rpm-botan-2.19.3-other_products65] - AssertionError: botan not found in libbotan-2-19-2.19.3-1.2.i586.rpm. FAILED test/test_scanner.py::TestScanner::test_version_in_package[http://ftp.fr.debian.org/debian/pool/main/b/botan/-libbotan-2-4_2.4.0-5~bpo9+1_amd64.deb-botan-2.4.0-other_products66] - AssertionError: botan not found in libbotan-2-4_2.4.0-5~bpo9+1_amd64.deb.

[terriko]

Hm, I'm not seeing any of the things you're seeing, and they're not occurring in github actions -- maybe try updating your data cache if they're still happening for you?

that said, I am getting a single error on the tests claiming that the condensed downloads weren't committed. I see them in this PR, so I'm not sure what went wrong, but you might need to re-generate them and re-commit?

 =========================== short test summary info ============================
FAILED test/test_condensed_downloads.py::test_condensed_downloads - AssertionError: Condensed downloads are not commited
assert False
 +  where False = all(<generator object test_condensed_downloads.<locals>.<genexpr> at 0x7f38474f7a70>)
===== 1 failed, 1853 passed, 21 skipped, 68 warnings in 1925.11s (0:32:05) =====

[donheshanthaka]

Thank you terriko for the reply, i checked on it agaion and it was the binary files that caused the issue, i had the put the .deb files instead of the binaries previously. Hope it's all good now :)

[terriko]

Glad you got it sorted, looks like we're ready to merge then!