Fix race condition bug which causes hang at accept