Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Restore banz scraper and lawgit functionality #18

Closed
wants to merge 3 commits into from

Conversation

jbruechert
Copy link
Contributor

No description provided.

@jbruechert
Copy link
Contributor Author

Bisher funktioniert von den scrapern nur der banz_scraper (wir bekommen also nur Daten vom Bundesanzeiger). Mir fehlt noch das Hintergrundwissen ob wir damit Gesetzesänderungen verpassen, oder ob auch alles im BAnz veröffentlicht wird

@darkdragon-001
Copy link
Collaborator

darkdragon-001 commented Mar 27, 2021

We should coordinate our efforts. I have Python3 functionality restored in #17 and am working on the BGBl scraper in #20.

@jbruechert
Copy link
Contributor Author

This pull request is mostly about the banz scraper, I can probably get the first commit rebased on top of your automated porting work.

@ulfgebhardt
Copy link
Member

@jbruechert jbruechert changed the title Draft: Restore functionality Draft: Restore banz scraper functionality Mar 27, 2021
@jbruechert
Copy link
Contributor Author

Can we maybe just open issues for things we are working on? I'd like to avoid having to read yet another chat service.

@ulfgebhardt
Copy link
Member

I am totally fine with issues - this is just for convenience, voice & video chat if needed for coordination

@jbruechert jbruechert force-pushed the restore-functionality branch 2 times, most recently from b4f4cc3 to 44644fc Compare March 28, 2021 01:18
@joacmue joacmue mentioned this pull request Mar 28, 2021
@jbruechert jbruechert changed the title Draft: Restore banz scraper functionality Restore banz scraper functionality Mar 28, 2021
@jbruechert jbruechert changed the title Restore banz scraper functionality Restore banz scraper and lawgit functionality Mar 28, 2021
@jbruechert
Copy link
Contributor Author

This should be ready now. At least if you are okay with the added log function in lawgit, which I found useful to debug whether something is happening while it prints the same message multiple times so the console would not visibly change.

@jbruechert jbruechert force-pushed the restore-functionality branch 2 times, most recently from c068f87 to f0b6ba6 Compare March 28, 2021 18:36
@jbruechert
Copy link
Contributor Author

GitHub seems to be a bit stupid again, on the branch the checks ran just fine, but they are not displayed here: https://github.com/JBBgameich/gesetze-tools/commits/restore-functionality. Is there anything I can do about it?

I added some typing for me to understand the script, and kept it because it will probably also help others.
I also added a small log function, to see if something is happening when the same message is printed multiple times
@ulfgebhardt
Copy link
Member

You need to rebase

@ulfgebhardt
Copy link
Member

your branch > rebase from master > force push > your branch > profit

@jbruechert
Copy link
Contributor Author

I already did that, as mentioned, the checks run fine on the branch

@ulfgebhardt
Copy link
Member

Maybe thats a security feature to not expose potential secrets. I recommend to work directly on this Repo instead of a fork. I never had this problem before tho...

@jbruechert
Copy link
Contributor Author

It's a GitHub bug, the new pull request works.

@jbruechert jbruechert closed this Mar 28, 2021
@ulfgebhardt
Copy link
Member

ulfgebhardt commented Mar 28, 2021

I think its about security. If you change the workflow and write a script which would expose a secret to the log it would be bad. But yeahr - makes forks even less usable as they already are - so considering it a bug might be valid ;)

@jbruechert
Copy link
Contributor Author

I doubt this is a security feature. The workflow ran just fine. The result was just not propagated to the pull request.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants