-
Notifications
You must be signed in to change notification settings - Fork 12
Accessibile as a CLI binary. #5
Comments
Issue Status: 1. Open 2. Started 3. Submitted 4. Done This issue now has a funding of 0.5 ETH (67.12 USD @ $134.25/ETH) attached to it as part of the AccessibleSoftware fund.
|
@zyfrank, great, let me know if you have any questions. 💯 |
@ChrisCates, I make a first investigation, I think what I can do are:
What's is your opinion? |
@zyfrank, you can use this as a reference: https://commoncrawl.s3.amazonaws.com/ for navigating files in common crawl. If this goes well. I will be adding another bounty for 1 ETH on the goveralls issue (#1) next week if you'd like to take it. |
Issue Status: 1. Open 2. Started 3. Submitted 4. Done Work for 0.5 ETH (68.81 USD @ $137.61/ETH) has been submitted by: @ChrisCates please take a look at the submitted work:
|
seems travis has authentication error |
Is this issue already closed or should someone still work on it? |
Hi @pedrojor2, If @zyfrank is up to retrying. I think he should still get a chance. I actually do want to refactor this repository. Simply so that the formatting is better and easier to use. I'm not sure if @zyfrank completely understood what my intention was in order to build it into a CLI executable. I am looking to allocate a couple of hours this Friday. |
Issue Status: 1. Open 2. Started 3. Submitted 4. Done Work has been started. These users each claimed they can complete the work by 7 months, 4 weeks ago. 1) josprachi has started work. I am learning Golang. I want to work on this issue i've been working with go for 2 years now and also expert in docker containers and tooling. Learn more on the Gitcoin Issue Details page. |
Hi I need help When I tried to run it, I am getting an error |
Hi @josprachi. |
Hello @ChrisCates I am using following elementary OS |
Okay, are you able to run Docker in that OS?
If so, we can debug from there.
|
Hi I am able to run docker now |
@ChrisCates Do you want me to take this? |
I submitted a bounty for #10. |
@ChrisCates let's discuss this |
@iamonuwa, great, yes! So in https://github.com/ChrisCates/CommonCrawler/blob/master/README.md I've specified a configuration that I'd like for us to use. If you have any questions about the proposed command line interface, let me know. |
What does each of these commands do?
|
Do you wish to build a full cli tool from this project? |
@iamonuwa, those are configurations for using it as a binary. An example of usage: commoncrawler start --base-uri https://commoncrawler.com And that would use a different base path for where CommonCrawl files are stored. This should update the The intended functionality should work both as a library and as a CLI tool when compiled. I will be preparing an issue (with bounty) for making it fully usable as a library. So for now, just focus on it being a CLI tool. |
It will affect the project structure abit. But will try to capture the expected result |
@iamonuwa, absolutely, that is expected. Just ensure that functionality is relatively the same and it works as intended. |
@ChrisCates this Bounty Is still active? |
We will be revisiting all bounties on this repository at a later date. |
@ChrisCates is it still active? i would love to work on it |
Any updates? |
Summary
Make this program both accessible via Golang and Terminal. Ensure that it works correctly in the terminal.
Requirements
Must have a download archive feature so that you can get latest entries from 2019 and beyond.
Must download files autonomously from a certain date range.
Must be able to extract compressed
.wet
files.Please review the
README.md
for the proposed functionality.Payment
The text was updated successfully, but these errors were encountered: