Pre/beta - Unit Tests

[codebeaver-ai]

CodeBeaver PR Summary

I started working from Pre/beta

🔄 1 test file added.
🐛 Found 1 bug
🛠️ 1/3 tests passed

🔄 Test Updates

I've added 1 tests. They all pass ☑️
New Tests:

• tests/test_generate_answer_node.py

No existing tests required updates.

🐛 Bug Detection

Potential issues found in the following files:

• scrapegraphai/nodes/parse_node.py

  The test is written to patch the url_pattern so that it correctly recognizes an absolute URL such as "https://external.com/page". However, when the test is run, the code’s URL extraction logic wrongly concatenates or “loses” the protocol and domain information. Specifically, the patched regex returns only the captured part (e.g. “/page”) instead of the full URL. Later, when all URLs are processed using urljoin with the provided source ("https://mysite.com"), the absolute URL becomes "https://mysite.com/page" rather than "https://external.com/page". This discrepancy between the expected and the actual link in the node’s output indicates a bug in the extraction logic of the code being tested rather than an issue with the test design or the test configuration.
  Thus, the error is caused by a bug in the code.

/bug

🛠️ Test Results

1/3 tests passed ⚠️

tests/graphs/scrape_graph_test.py

View error

ImportError while importing test module '/app/temp_workspace/tests/graphs/scrape_graph_test.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
/usr/local/lib/python3.11/importlib/__init__.py:126: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
tests/graphs/scrape_graph_test.py:10: in <module>
    from scrapegraphai.graphs import ScrapeGraph
E   ImportError: cannot import name 'ScrapeGraph' from 'scrapegraphai.graphs' (/app/temp_workspace/scrapegraphai/graphs/__init__.py)

_{tests/graphs/scrape_graph_test.py}

tests/graphs/xml_scraper_openai_test.py

View error

ImportError while importing test module '/app/temp_workspace/tests/graphs/xml_scraper_openai_test.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
/usr/local/lib/python3.11/importlib/__init__.py:126: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
tests/graphs/xml_scraper_openai_test.py:11: in <module>
    from scrapegraphai.utils import convert_to_csv, convert_to_json, prettify_exec_info
E   ImportError: cannot import name 'convert_to_csv' from 'scrapegraphai.utils' (/app/temp_workspace/scrapegraphai/utils/__init__.py)

_{tests/graphs/xml_scraper_openai_test.py}

☂️ Coverage Improvements

Coverage improvements by file:

• tests/test_generate_answer_node.py

  New coverage: 76.98%
  Improvement: +76.98%

🎨 Final Touches

• I ran the hooks included in the pre-commit config.

---

_{Settings | Logs | CodeBeaver}

[github-actions]

🎉 This PR is included in version 1.41.0-beta.1 🎉

The release is available on:

• v1.41.0-beta.1
• GitHub release

Your semantic-release bot 📦🚀

[github-actions]

🎉 This PR is included in version 1.41.0 🎉

The release is available on:

• v1.41.0
• GitHub release

Your semantic-release bot 📦🚀