Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

T-Pot 19.03 - netselect-apt needs ICMP #332

Closed
UncleRaymondo opened this issue Apr 1, 2019 · 25 comments
Closed

T-Pot 19.03 - netselect-apt needs ICMP #332

UncleRaymondo opened this issue Apr 1, 2019 · 25 comments

Comments

@UncleRaymondo
Copy link

M,

Not sure what's going on here but I've tried this twice and it's not working.

Installed Debian 9.8 via it's smaller netinst image (not sure if the base system requires the full install image), selecting only standard system utilities to keep it headless, netinst seems to complete successfully. Installed Git (which is not part of the standard utilities), cloned tpotce and ran the installer per the Post Install User instructions.

Install completes, although I notice numerous issues as I'm reading the progress...

  • npm not found
  • pip not found
  • exim-base not found
  • docker.io not found? (something like that as I'm reading it on the fly)

Can't recall where the log file for the installation process is (if there is one)...

On reboot, it looks like everything is installed normally but everything is down. Tried to start T-Pot, fails with docker.service not found?

dps.sh also has an OSError / stack trace

image

What am I missing here? I'm under the impression that all dependencies are installed by default?

Let me know what I can do to test this further and resolve :)

Cheers,
R

@t3chn0m4g3
Copy link
Member

service is deprecated, please try systemctl start tpot or systemctl stop tpot

@t3chn0m4g3
Copy link
Member

Can you attach /install.log and install.err, please.

@UncleRaymondo
Copy link
Author

Same... Docker seems to be installed though???

image

@t3chn0m4g3
Copy link
Member

That is the old docker from 9.8.

@t3chn0m4g3
Copy link
Member

It looks if the move to unstable did not work ...
What are the contents of /etc/apt/source.list?
If you run netselect-apt -n -a amd64 unstable and then cat sources.list?

@UncleRaymondo
Copy link
Author

Hmmm... weird...

I'll screenshot the errors as the system is isolated and no way to extract the files from it ;)

install.err

image
image
image
image

install.log

image
image
image
image
image
image
image

@UncleRaymondo
Copy link
Author

Yeah definitely no unstable repositories here...

image

The netselect command seems to repeat those Duplicate Address messages in the screenshots above...

@t3chn0m4g3
Copy link
Member

t3chn0m4g3 commented Apr 1, 2019

Thanks, found it. But this will need some more time for tweaking. netselect-apt does not work correctly for some reason in your setup. Need to properly intercept the error and write a generic sources.list if it occurs.

@UncleRaymondo
Copy link
Author

I've just noticed this error...

image

ICMP is blocked outbound... are you telling me that netselect is that incompetent that it needs ICMP or UDP Traceroute?

@t3chn0m4g3
Copy link
Member

Unfortunately it looks that way 🙁 I am as surprised by that as you are.

@UncleRaymondo
Copy link
Author

Let me open up ICMP outbound, blow the box away again, reinstall 9.8 via netinst and try clone and build again... give me 30 mins :)

@UncleRaymondo
Copy link
Author

Looks like it definitely needs ICMP Outbound... it's flooding through on unstable installs now...

image

@t3chn0m4g3
Copy link
Member

Thanks, not sure though it if is not better to leave it this way and document it. Especially with Australia and Asia as region the default mirror was reported to us as too slow.

What do you think?

@UncleRaymondo
Copy link
Author

UncleRaymondo commented Apr 1, 2019

I would document that ICMP Outbound is required due to the incompetence of netselect, but also have a fall back to protect the amateurs. Do a test ping, if it fails, write a manual sources.list, skipping the netselect process entirely. If it works, proceed as normal with netselect.

Everything in Australia is slow :P but my ISP has a localised Debian mirror so I don't really notice much slowness. All the mirrors above except the last two are Australian hosted/based. If you're going to do a manual script, the aarnet.edu.au mirror is a safe bet with ftp.au.debian.org as a fall back.

@UncleRaymondo
Copy link
Author

It ultimately seems like that netselect ICMP issue was the problem... install's still going, docker's pulling images now, seems to be running smoothly so far...

@t3chn0m4g3
Copy link
Member

Will have a fallback option.
How does the netselect-apt chosen mirror work for you? Is the automatic choice bearable with regard to speed, a.k.a. does netselect do a good job?

@UncleRaymondo
Copy link
Author

I think it does a pretty reasonable job... I'm on 100Mbps down, 40 Mbps here, fibre to the home. It is also 3:20am so network is pretty quiet.

In saying that, installation is done...

image

30 mins to rebuild Debian 9.8 from the netinst image, and to install T-Pot 19.03... I think that's pretty reasonable ;)

t3chn0m4g3 added a commit that referenced this issue Apr 1, 2019
@t3chn0m4g3
Copy link
Member

Perfect! Thanks for the prompt feedback!

@UncleRaymondo
Copy link
Author

Looks like all is healthy

image

@t3chn0m4g3
Copy link
Member

That's how I like my dps.sh 😄

@UncleRaymondo
Copy link
Author

Now to go get some sleep - and play with it more tomorrow!
Enjoy the rest of your day :)

@t3chn0m4g3
Copy link
Member

Thanks and have a good night!

@t3chn0m4g3 t3chn0m4g3 changed the title T-Pot 19.03 - NEXTGEN Install Missing Dependencies / Fails to Start T-Pot 19.03 - netselect-apt needs ICMP Apr 1, 2019
@UncleRaymondo
Copy link
Author

M,

Just thinking - maybe make a note as well that it's only required during the installation process. Yet to confirm but I can't see any other reason why this needs to remain open after install...

Cheers,
R

@t3chn0m4g3
Copy link
Member

Can you check out the fast branch, please. Should fix and improve speed even more.

@t3chn0m4g3
Copy link
Member

@UncleRaymondo Now in master.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants