build(html-tracing): create package html-tracing #1
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* build(dependencies): install dependencies for Flask * build(flask): setup minimal server with Flask, templates and statics files * build(dependencies): install dependencies to fetch and parse an url * ci(ruff): config pydocstyle with numpy * build(pandas): install pandas and update python version for numpy * ci(gitignore): update gitignore with temp and datas folders * build(proxies): implement proxy utilities * ci(coverage): remove coverage threshold * style(lint): fix missing new lines
* docs(proxies): update docstring description of proxies * docs(useragents): create user agents class and update docstring description * build(useragents): implementing user agents helpers * docs(poxies): update docstring documentation * build(user-agents): add helpers to extract a list of user agents * docs(proxies): move docstring descrption to proxies * build(session): create session helper to request using proxies and agents * refactor(agents): renaming user agents file * build(session): update session messages log * build(utilities): create refresh helper to fetch and format * build(utilities): rename helpers functions names * docs(utilities): update docstring description
* build(agents): remove logger * build(session): update session with internal function * build(clone): implement functions to clone a website * build(proxies): enable reuse of dataframe in query * build(logger): implement logging utilities * build(logger): update logger logic with tracing * build(logger): update logging with new line config * build(logger): update logger with internal logging * build(logger): use logger in utilities methods to visualise progression * build(clone): skip fetch if file exists * build(session): add delay between request * docs(session): update docstring with delay time * build(session): update request with delay for access and read * refactor(clone): update clone logic * build(packages): enable imports from different packages * refactor(project): update project structure
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PULL REQUEST
Description
Please describe the reason related to the changes:
Breaking Change
Does your changes introduce a breaking change?
Information (issue, links, logs, etc.)
Please list any other useful information: