Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix curl "missing url" and discrepancies in README #6

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

ax-i-om
Copy link

@ax-i-om ax-i-om commented Mar 9, 2024

I was in the process of configuring search.0t.rocks on a local machine and ran into an issue when running on step 3, where we execute run.sh.

I noticed in the commit: 4c71edd (Update run.sh), the curl commands switched from using a hard-coded host address and port number like so:
curl 'http://localhost:8983/solr/BigData/schema?wt=json'
to using variables specified by the user:
curl 'http://$ip:$port/solr/BigData/schema?wt=json'

This layout prevented the variables from expanding, meaning curl was using $ip:$port as the URL, literally. This lead to the error: curl: (3) URL using bad/illegal format or missing URL for each curl statement. In this pull-request, all I've done is switch the single quotes (') to double quotes (") so that the variables could successfully expand. I also updated the README accordingly.

Thank you for open-sourcing such a wonderful tool!

@GitHubQueenn
Copy link

GitHubQueenn commented Mar 13, 2024

Thank you for open-sourcing such a wonderful tool!

Hi, I have a question for you since I don't see a place to get help with this on here....How exactly do I get the search results to work? I am on Windows 10. I installed Docker, have the instance running, but I am stuck at the "Importing Data" part here. I download a copy of the binary release of Solr and extracted the .zip to my Desktop. I am basically trying to have the "sample.jsonl" results show up when I search info on this project.

The author uses bin/post -c BigData -p 8983 -host <your host> path/to/your/file as the example, but how does this work with Windows? I copied sample.jsonl to the Solr folder on my Desktop. I then open Power Shell in the Solr folder and use the command: bin/post -c BigData -p 8983 -host localhost sample.jsonl but the result it gives me is a .txt file basically saying I did it wrong. I have also tried bin/post -c BigData -p 8983 -host localhost C:\Users\User\Desktop\solr-9.5.0 and bin/post -c BigData -p 8983 -host localhost sample.jsonl and get the same output. Help?

@ax-i-om
Copy link
Author

ax-i-om commented Mar 13, 2024

During my initial testing, I encountered a similar issue. As far as I know, the sample.jsonl file is not actually valid data that can be posted without further sanitation.

Did you run the run.sh file? If so, could you try again and paste the logs/error output here?

In my experimentation, I also prepared a valid sample of CSV data that can be successfully posted under the basic configuration. None of the information below was procured through compromised data. It was all fabricated/randomly generated.

id,emails,passwords,firstName,lastName
ficticiousbreach-03122024-1,rapture@demo.com,VK9RSuK0wSSXNc0gF8iYW1f6,axiom,estimate
ficticiousbreach-03122024-2,rapture@demo.com,N7cblKU9ypU727lwiTr9espw,garble,vortex
ficticiousbreach-03122024-3,rapture@demo.com,eP0u9cM0jAa2QeUVI3d88rYn,vertiable,slap
ficticiousbreach-03122024-4,rapture@demo.com,QxtyRMAx3KniskzjGDg6tHdl,axiom,terrific
ficticiousbreach-03122024-5,rapture@demo.com,cirSMQZp7Enh98KLb6r8JT1I,garble,eighty
ficticiousbreach-03122024-6,rapture@demo.com,9J53HQEetTv5E2xCJKe4tdaP,veritable,tumble
ficticiousbreach-03122024-7,rapture@demo.com,3sZ7NPb54Fk0Qy2LXlLejwCu,axiom,slipper
ficticiousbreach-03122024-8,rapture@demo.com,OxoZGbn3v0tvBMyWA0Jds0Ea,garble,chord
ficticiousbreach-03122024-9,rapture@demo.com,et8ggkgUeyQ3ge7ua2YNsOLd,veritable,baffle

If this posts successfully, then we can conclude that the error you are facing lies within attempting to post data that requires further sanitation.

@GitHubQueenn
Copy link

GitHubQueenn commented Mar 14, 2024

Did you run the run.sh file? If so, could you try again and paste the logs/error output here?

Hey! So, yeah, that was the other thing I forgot to mention: For the run.sh file, when it says to enter the IP & port, do I just use the defaults it has in brackets (127.0.0.1 & 8983)? & the shard thing it asks, I have no idea what to put there, so I've tried "1" and "2." Because no matter what I put for those, the terminal just spams: "curl: (3) URL rejected: Port number was not a decimal number between 0 and 65535." This happens with the default run.sh file as well as the one you provided/fixed.

I also prepared a valid sample of CSV data that can be successfully posted under the basic configuration.

Yeah, I'm also trying to figure out how to do this

@ax-i-om
Copy link
Author

ax-i-om commented Mar 14, 2024

I see, I am happy to help in debugging your issue but would like to avoid cluttering this PR.

Feel free to message me on Discord, my username is []

If you have a alternative method of communication that you would like to use, please let me know!

@GitHubQueenn
Copy link

I see, I am happy to help in debugging your issue but would like to avoid cluttering this PR.

Feel free to message me on Discord, my username is ax.om

If you have a alternative method of communication that you would like to use, please let me know!

Sure thing! Do you use Signal Messenger (they have username now, so phone number isn't exposed)? If not, I can make a Discord account.

@ax-i-om
Copy link
Author

ax-i-om commented Mar 14, 2024

Signal works! Feel free to email me the information, my email address is displayed on my profile.

@GitHubQueenn
Copy link

Signal works! Feel free to email me the information, my email address is displayed on my profile.

Actually, just sent friend request on Discord, haha! Sorry

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants