Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: implement ErrorSnapshotter for error context capture #2332

Merged
merged 29 commits into from
May 16, 2024
Merged

feat: implement ErrorSnapshotter for error context capture #2332

merged 29 commits into from
May 16, 2024

Commits on Feb 12, 2024

  1. feat: Implement ErrorSnapshotter for error context capture (crawlee#2… 

    …280)

This commit introduces the ErrorSnapshotter class to the crawlee package, providing functionality to capture screenshots and HTML snapshots when an error occurs during web crawling.
    @HamzaAlwan
    HamzaAlwan committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    1c6b730 View commit details
    Browse the repository at this point in the history

  2. fix: update imports in error_snapshotter.ts and error_tracker.ts

    @HamzaAlwan
    HamzaAlwan committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    994965d View commit details
    Browse the repository at this point in the history

  3. refactor: error handling and snapshot capture

    @HamzaAlwan
    HamzaAlwan committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    5f50e30 View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2024

  1. fix: update import statement in error_tracker.ts

    @HamzaAlwan
    HamzaAlwan committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    4061fed View commit details
    Browse the repository at this point in the history

  2. refactor: updated ErrorSnapshotter class snapshot methods and handled… 

    … local snapshots paths
    @HamzaAlwan
    HamzaAlwan committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    512b3ff View commit details
    Browse the repository at this point in the history

  3. refactor: update file paths for error snapshots

    @HamzaAlwan
    HamzaAlwan committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    3301944 View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2024

  1. refactor: shorten the code in error_snapshotter.ts and update error f… 

    …iles names
    @HamzaAlwan
    HamzaAlwan committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    00c7d1a View commit details
    Browse the repository at this point in the history

  2. chore: add tests for ErrorSnapshotter

    @HamzaAlwan
    HamzaAlwan committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    3205465 View commit details
    Browse the repository at this point in the history

  3. fix: conditionally generate screenshot and html file names based on A… 

    …PIFY_IS_AT_HOME env variable
    @HamzaAlwan
    HamzaAlwan committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    778a2bc View commit details
    Browse the repository at this point in the history

  4. refactor: move error_snapshotter.ts and error_tracker.ts to core package

    @HamzaAlwan
    HamzaAlwan committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    efa5437 View commit details
    Browse the repository at this point in the history

  5. refactor: update actor and package names for error snapshot tests

    @HamzaAlwan
    HamzaAlwan committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    865454e View commit details
    Browse the repository at this point in the history

  6. refactor: add a new function addAsyncin error_tracker and revert th… 

    …e changes on `add` function
    @HamzaAlwan
    HamzaAlwan committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    6982e03 View commit details
    Browse the repository at this point in the history

  7. fix: add partial types in typedefs.ts

    @HamzaAlwan
    HamzaAlwan committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    c79e3b1 View commit details
    Browse the repository at this point in the history

  8. fix: update puppeteer and playwright utils test

    @HamzaAlwan
    HamzaAlwan committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    9eec3ee View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2024

  1. fix: lint issue

    @HamzaAlwan
    HamzaAlwan committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    e08a3cf View commit details
    Browse the repository at this point in the history

Commits on Mar 11, 2024

  1. refactor: error_tracker add methods handling and error_snapshotter tests

    @HamzaAlwan
    HamzaAlwan committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    e56e1cb View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. fix: readd error-tracker.ts file to packages/utils to avoid breaking … 

    …changes
    @HamzaAlwan
    HamzaAlwan committed May 14, 2024
    Configuration menu
    Copy the full SHA
    d2b2c31 View commit details
    Browse the repository at this point in the history

  2. refactor: remove the extension logic when saving screenshot

    @HamzaAlwan
    HamzaAlwan committed May 14, 2024
    Configuration menu
    Copy the full SHA
    a509de6 View commit details
    Browse the repository at this point in the history

  3. refactor: Update error_tracker to remove the new addAsync function an… 

    …d revert changes to add function
    @HamzaAlwan
    HamzaAlwan committed May 14, 2024
    Configuration menu
    Copy the full SHA
    967def2 View commit details
    Browse the repository at this point in the history

  4. chore: update node version in Dockerfile for error_tracker tests

    @HamzaAlwan
    HamzaAlwan committed May 14, 2024
    Configuration menu
    Copy the full SHA
    224d512 View commit details
    Browse the repository at this point in the history

  5. refactor: Update ErrorSnapshotter class

    @HamzaAlwan
    HamzaAlwan committed May 14, 2024
    Configuration menu
    Copy the full SHA
    deed57b View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. refactor: Update ErrorSnapshotter class

    @HamzaAlwan
    HamzaAlwan committed May 15, 2024
    Configuration menu
    Copy the full SHA
    084cb0c View commit details
    Browse the repository at this point in the history

  2. revert: Dockerfile node version

    @HamzaAlwan
    HamzaAlwan committed May 15, 2024
    Configuration menu
    Copy the full SHA
    f239415 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. refactor: Update ErrorSnapshotter class and removed hardcoded paths

    @HamzaAlwan
    HamzaAlwan committed May 16, 2024
    Configuration menu
    Copy the full SHA
    912c2a3 View commit details
    Browse the repository at this point in the history

  2. refactor: Update ErrorSnapshotter class to use more descriptive prope… 

    …rty names for snapshot files
    @HamzaAlwan
    HamzaAlwan committed May 16, 2024
    Configuration menu
    Copy the full SHA
    70c104d View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into feat/save-screenshot-and-html-on-first-error

    @B4nan
    B4nan committed May 16, 2024
    Configuration menu
    Copy the full SHA
    7fd25a7 View commit details
    Browse the repository at this point in the history

  4. fix tests

    @B4nan
    B4nan committed May 16, 2024
    Configuration menu
    Copy the full SHA
    bdcd0dc View commit details
    Browse the repository at this point in the history

  5. revert to addAsync method

    @B4nan
    B4nan committed May 16, 2024
    Configuration menu
    Copy the full SHA
    3cf793c View commit details
    Browse the repository at this point in the history

  6. make it configurable and opt-in

    @B4nan
    B4nan committed May 16, 2024
    Configuration menu
    Copy the full SHA
    4a59c07 View commit details
    Browse the repository at this point in the history