Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

os: could not iterate over named pipes on Windows #32423

Open
Codehardt opened this issue Jun 4, 2019 · 10 comments
Open

os: could not iterate over named pipes on Windows #32423

Codehardt opened this issue Jun 4, 2019 · 10 comments
Labels
NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-Windows
Milestone

Comments

@Codehardt
Copy link

What version of Go are you using (go version)?

$ go version
go version go1.12.5 windows/amd64

Does this issue reproduce with the latest release?

yes

What operating system and processor architecture are you using (go env)?

go env Output
$ go env
set GOARCH=amd64
set GOBIN=
set GOCACHE=C:\Users\mars9\AppData\Local\go-build
set GOEXE=.exe
set GOFLAGS=
set GOHOSTARCH=amd64
set GOHOSTOS=windows
set GOOS=windows
set GOPATH=C:\Users\mars9\go
set GOPROXY=
set GORACE=
set GOROOT=C:\Go
set GOTMPDIR=
set GOTOOLDIR=C:\Go\pkg\tool\windows_amd64
set GCCGO=gccgo
set CC=gcc
set CXX=g++
set CGO_ENABLED=1
set GOMOD=
set CGO_CFLAGS=-g -O2
set CGO_CPPFLAGS=
set CGO_CXXFLAGS=-g -O2
set CGO_FFLAGS=-g -O2
set CGO_LDFLAGS=-g -O2
set PKG_CONFIG=pkg-config
set GOGCCFLAGS=-m64 -mthreads -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -fdebug-prefix-map=C:\Users\mars9\AppData\Local\Temp\go-build413446826=/tmp/go-build -gno-record-gcc-switches

What did you do?

I wanted to iterate over Windows' named pipes using os package:

	f, err := os.Open(`\\.\pipe`)
	if err != nil {
		log.Fatalf("Could not open pipe list: %s", err)
	}
	defer f.Close()
	stat, err := f.Stat()
	if err != nil {
		log.Fatalf("Could not get file stats: %s", err)
	}
	log.Printf("Is Directory: %t", stat.IsDir()) // output: false
	pipelist, err := f.Readdir(-1)
	if os.IsNotExist(err) {
		log.Print("Pipe list does not exist")
	} else if err != nil {
		log.Printf("Could not read pipe list: %s", err)
	}
	for _, pipe := range pipelist {
		log.Printf("Pipe found: %s", pipe.Name())
	}

What did you expect to see?

The same result as in Python:

for pipeName in os.listdir(r'\\.\pipe'):
    print("Pipe found: %s" % pipeName)
Pipe found: InitShutdown
Pipe found: lsass
Pipe found: ntsvcs
Pipe found: scerpc
...

What did you see instead?

Is Directory: false
Pipe list does not exist
@mdlayher
Copy link
Member

mdlayher commented Jun 5, 2019

It isn't clear to me if this is something that the standard library itself should handle, but I recently wrote some Go code to do just this if it helps: https://github.com/WireGuard/wgctrl-go/blob/master/internal/wguser/conn_windows.go#L196.

@mdlayher mdlayher changed the title Could not iterate over named pipes on Windows os: could not iterate over named pipes on Windows Jun 5, 2019
@mdlayher
Copy link
Member

mdlayher commented Jun 5, 2019

/cc @alexbrainman

@mdlayher mdlayher added the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label Jun 5, 2019
@alexbrainman
Copy link
Member

Or sure, maybe we could fix that code.

I don't have time to debug this, but, if someone is interested, maybe they could make code above work. Maybe FindFirstFile and FindNextFile could be used to read that directory.

Alex

@gopherbot
Copy link
Contributor

Change https://golang.org/cl/181057 mentions this issue: os: treat the Windows named pipe root as a directory

@Codehardt
Copy link
Author

Codehardt commented Jun 7, 2019

Maybe FindFirstFile and FindNextFile could be used to read that directory.

Thanks, this solved my issue.

@mdlayher
Copy link
Member

mdlayher commented Jun 7, 2019

I've submitted a patch that makes this work with package os, but it needs a bit more work and it probably won't land until Go 1.14 at this point.

@bradfitz bradfitz added this to the Go1.14 milestone Jun 7, 2019
@rsc rsc modified the milestones: Go1.14, Backlog Oct 9, 2019
@smasher164 smasher164 modified the milestones: Backlog, Go1.14 Oct 11, 2019
@iwdgo
Copy link
Contributor

iwdgo commented Nov 10, 2019

Documentation states explicitly that it is not possible to list pipes using Win 32 API. For the same reason, >dir \\.\\pipe\\ does not return anything but an error.

The same documentation suggests to use NtQueryDirectoryFile of library NtosKrnl which is unavailable in the syscall package.
For completeness, the Powershell instruction to list pipes on Windows is [System.IO.Directory]::GetFiles("\\.\\pipe\\"). The directory value is currently not supported by the files method which uses FindFirstFileW.

Adding the relevant call require seems more like a proposal.

@alexbrainman
Copy link
Member

It isn't clear to me if this is something that the standard library itself should handle, but I recently wrote some Go code to do just this if it helps: https://github.com/WireGuard/wgctrl-go/blob/master/internal/wguser/conn_windows.go#L196.

@mdlayher the code you are referring to, implements functionality to connect to Windows named pipe. What we want in this issue is to list all files under \\.\pipe. Not the same thing.

The same documentation suggests to use NtQueryDirectoryFile of library NtosKrnl which is unavailable in the syscall package.
...
Adding the relevant call require seems more like a proposal.

@iwdgo using NtQueryDirectoryFile sounds like it might work. And you don't need to add NtQueryDirectoryFile to syscall package. We can put it in internal/syscall/windows if it works.

Alex

@ianlancetaylor ianlancetaylor modified the milestones: Go1.14, Backlog Dec 5, 2019
@iwdgo
Copy link
Contributor

iwdgo commented Dec 7, 2019

Following code can help until fixed.

// List pipes on Windows
package main

import (
	"bytes"
	"fmt"
	"log"
	"os/exec"
	"strings"
	"syscall"
)

// https://github.com/golang/go/issues/32423

const (
	windows10Pipes = "\\\\.\\pipe\\\\"
)

func cmdListPipes() (pipes []string, err error ) {
	cmd := exec.Command("cmd")
	out := new(bytes.Buffer)
	cmd.Stdout = out
	cmd.Stderr = out
	cmd.SysProcAttr = &syscall.SysProcAttr{
		HideWindow: false,
		CmdLine:    "/C \"dir " + windows10Pipes + " /B \" ",
		CreationFlags:     0,
		Token:             0,
		ProcessAttributes: nil,
		ThreadAttributes:  nil,
	}
	err = cmd.Run()
	if err != nil {
		fmt.Errorf("%v", err)
		if cmd.Stderr != nil {
			out, _ := cmd.CombinedOutput()
			log.Fatalf("%s", out)
		}
	}
	return strings.Split(out.String(), "\n"), nil
}

func main() {
	pipes, err := cmdListPipes()
	if err != nil {
		fmt.Println(err)
	}
	for _, p := range pipes {
		fmt.Println(p)
	}
	if len(pipes) == 0 {
		fmt.Println("no output")
	}
}









@qmuntal
Copy link
Contributor

qmuntal commented Sep 28, 2023

The issue here is that Windows is not treating \\.\pipe in the same way as \\.\pipe\ (notice the trailing slash). You can iterate over the later, but not over the former. In fact, using go1.21.1 I can iterate over all the named pipes if opening the root with os.Open(\\.\pipe\).

This behavior is weird, can't see it documented anywhere, but it is what it is. Python's os.listdir(r'\\.\pipe') work because they call FindFirstFileW(r'\\.\pipe\*') under the hood.

We could special-case \\.\pipe in os.Open so it opens \\.\pipe\ instead, but I don't know the implications, documentation lacking.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-Windows
Projects
None yet
Development

No branches or pull requests

10 participants