Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Find the common root for URL fields #16

Open
manycoding opened this issue Nov 30, 2018 · 1 comment
Open

Find the common root for URL fields #16

manycoding opened this issue Nov 30, 2018 · 1 comment
Assignees
@manycoding
Labels
Type: Feature New feature or request
Milestone
0.3.7

Comments

@manycoding
Copy link
Contributor

Say, we scrape one website from different categories. In this case all items will have the same root, e.g.
https://pandas.pydata.org/pandas-docs/stable/categorical.html
https://pandas.pydata.org/pandas-docs/stable/merging.html
have https://pandas.pydata.org/pandas-docs/stable/ in common.

By returning this information, we can analyze urls without json schema.
@manycoding manycoding transferred this issue from another repository Mar 18, 2019
@Gallaecio Gallaecio added the Type: Feature New feature or request label Jul 3, 2019
@manycoding
Copy link
Contributor Author

pandas-profiling does something similar https://github.com/pandas-profiling/pandas-profiling/blob/master/pandas_profiling/model/base.py#L122

@manycoding manycoding added this to the 0.3.7 milestone Jul 6, 2019
@manycoding manycoding self-assigned this Oct 24, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@manycoding manycoding

Labels
Type: Feature New feature or request
Projects
None yet
Milestone
0.3.7
Development

No branches or pull requests
2 participants
@Gallaecio @manycoding