cmd/cgo: support cross compilation with cgo enabled #4714

minux · Jan 27, 2013

currently cmd/cgo (and cmd/go)  hardcode the executable name of the compiler
to be "gcc", and cmd/go forbids using cgo when it's cross compiling.

We need a proper way to support cross compiling with cgo enabled because
it's infeasible to do native compile sometimes (for example, iOS and low-end
ARM machines)

Another use for this is remote testing, it's quite difficult to find an ARMv5
machine with enough RAM (>=512MiB) for make.bash, but if we support this,
maybe we can build on a PC and remote test on ARM machines, and 256MiB
is more than enough for testing.

Comment 2:

This would also mean I could cross-compile linux-arm-cgo Android child helper binaries
from darwin-amd64 and be able to do proper Android DNS lookups.  Currently, without cgo,
I can't do native DNS so I'm resorting to hacks like using os/exec and parsing the first
line output of "ping -c 1 $HOSTNAME" for my http.Transport's net.Dial function.

bradfitz · Jan 28, 2013

Comment 2:

This would also mean I could cross-compile linux-arm-cgo Android child helper binaries
from darwin-amd64 and be able to do proper Android DNS lookups.  Currently, without cgo,
I can't do native DNS so I'm resorting to hacks like using os/exec and parsing the first
line output of "ping -c 1 $HOSTNAME" for my http.Transport's net.Dial function.

Comment 3:

Hi brad, for now you can use a gcc wrapper to enable cgo cross compilation with Android
NDK,
https://golang.org/cl/6454055/

minux · Jan 29, 2013

Comment 3:

Hi brad, for now you can use a gcc wrapper to enable cgo cross compilation with Android
NDK,
https://golang.org/cl/6454055/

Comment 4:

Labels changed: removed go1.1maybe.

robpike · Mar 7, 2013

Comment 4:

Labels changed: removed go1.1maybe.

Comment 5:

Issue #5848 has been merged into this issue.

rsc · Jul 30, 2013

Comment 5:

Issue #5848 has been merged into this issue.

Comment 6:

Labels changed: added go1.2maybe.

rsc · Jul 30, 2013

Comment 6:

Labels changed: added go1.2maybe.

Comment 7:

What's needed to resolve this? FWIW I'm successfully cross compiling from darwin amd64
to linux 386 via 'CC=$(CC) CGO_ENABLED=1 GOOS=linux GOARCH=386 go build -x
-ldflags="-extld=$(CC)"' (where $(CC) is "i686-nptl-linux-gnu-gcc" in this instance) and
disabling the "cannot use cgo" error in src/cmd/go/build.go:
diff -r 3d177aef8dd3 src/cmd/go/build.go
--- a/src/cmd/go/build.go   Mon Jul 22 23:02:27 2013 +0400
+++ b/src/cmd/go/build.go   Thu Aug 01 13:34:13 2013 +0200
@@ -1854,9 +1854,9 @@
 )
 func (b *builder) cgo(p *Package, cgoExe, obj string, gccfiles []string, gxxfiles []string) (outGo, outObj []string, err error) {
-   if goos != toolGOOS {
-       return nil, nil, errors.New("cannot use cgo when compiling for a different operating
system")
-   }
+   // if goos != toolGOOS {
+   //  return nil, nil, errors.New("cannot use cgo when compiling for a different
operating system")
+   // }
    cgoCPPFLAGS := stringList(envList("CGO_CPPFLAGS"), p.CgoCPPFLAGS)
    cgoCFLAGS := stringList(envList("CGO_CFLAGS"), p.CgoCFLAGS)

quarnster · Aug 1, 2013

Comment 7:

What's needed to resolve this? FWIW I'm successfully cross compiling from darwin amd64
to linux 386 via 'CC=$(CC) CGO_ENABLED=1 GOOS=linux GOARCH=386 go build -x
-ldflags="-extld=$(CC)"' (where $(CC) is "i686-nptl-linux-gnu-gcc" in this instance) and
disabling the "cannot use cgo" error in src/cmd/go/build.go:
diff -r 3d177aef8dd3 src/cmd/go/build.go
--- a/src/cmd/go/build.go   Mon Jul 22 23:02:27 2013 +0400
+++ b/src/cmd/go/build.go   Thu Aug 01 13:34:13 2013 +0200
@@ -1854,9 +1854,9 @@
 )
 func (b *builder) cgo(p *Package, cgoExe, obj string, gccfiles []string, gxxfiles []string) (outGo, outObj []string, err error) {
-   if goos != toolGOOS {
-       return nil, nil, errors.New("cannot use cgo when compiling for a different operating
system")
-   }
+   // if goos != toolGOOS {
+   //  return nil, nil, errors.New("cannot use cgo when compiling for a different
operating system")
+   // }
    cgoCPPFLAGS := stringList(envList("CGO_CPPFLAGS"), p.CgoCPPFLAGS)
    cgoCFLAGS := stringList(envList("CGO_CFLAGS"), p.CgoCFLAGS)

Comment 8:

This would be nice but it didn't happen for 1.2.

Labels changed: added go1.3, removed go1.2maybe.

ianlancetaylor · Sep 4, 2013

Comment 8:

This would be nice but it didn't happen for 1.2.

Labels changed: added go1.3, removed go1.2maybe.

Comment 10:

Labels changed: added release-go1.3.

rsc · Dec 4, 2013

Comment 10:

Labels changed: added release-go1.3.

Comment 11:

Labels changed: removed go1.3.

rsc · Dec 4, 2013

Comment 11:

Labels changed: removed go1.3.

Comment 12:

Labels changed: added repo-main.

rsc · Dec 4, 2013

Comment 12:

Labels changed: added repo-main.

Comment 13:

Started: https://golang.org/cl/57100043

eliasnaur · Jan 26, 2014

Comment 13:

Started: https://golang.org/cl/57100043

Comment 14:

This issue was updated by revision 2dc759d.

LGTM=minux.ma, iant
R=golang-codereviews, minux.ma, iant, rsc, dominik.honnef
CC=golang-codereviews
https://golang.org/cl/57100043
Committer: Ian Lance Taylor

ianlancetaylor · Feb 6, 2014

Comment 14:

This issue was updated by revision 2dc759d.

LGTM=minux.ma, iant
R=golang-codereviews, minux.ma, iant, rsc, dominik.honnef
CC=golang-codereviews
https://golang.org/cl/57100043
Committer: Ian Lance Taylor

Comment 15:

As of rev. 6d3bdbd27761, the missing parts of this issue are, as I see them:
1. make.bat/make.rc support for CC_FOR_TARGET.
2. Support for remote testing. Minux tells me that the upcoming NaCL port includes a
mechanism for go test to use a helper binary to execute cross compiled tests. I think
Dave is working on getting that port up to date and submitted.
3. Documentation for setting up various cross compilers.

eliasnaur · Feb 7, 2014

Comment 15:

As of rev. 6d3bdbd27761, the missing parts of this issue are, as I see them:
1. make.bat/make.rc support for CC_FOR_TARGET.
2. Support for remote testing. Minux tells me that the upcoming NaCL port includes a
mechanism for go test to use a helper binary to execute cross compiled tests. I think
Dave is working on getting that port up to date and submitted.
3. Documentation for setting up various cross compilers.

Comment 16 by joe@prevoty.com:

As of right now this patch isn't working. I've attempted to setup a cross compile
toolchain on OS X for linux, both on am64 with the following commands from the go tip
repo:
GOOS=linux GOARCH=amd64 CGO_ENABLED=1 CC_FOR_TARGET=/opt/local/bin/x86_64-elf-gcc
CXX_FOR_TARGET=/opt/local/bin/x86_64-elf-g++ ./make.bash
After building I attempted to build source of a project which imports a library that
uses CGo using the following command:
CGO_ENABLED=1 GOOS=linux GOARCH=amd64 go build
And get the following result:
go build runtime/cgo: cannot use cgo when compiling for a different operating system

gopherbot · Feb 7, 2014

Comment 16 by joe@prevoty.com:

As of right now this patch isn't working. I've attempted to setup a cross compile
toolchain on OS X for linux, both on am64 with the following commands from the go tip
repo:
GOOS=linux GOARCH=amd64 CGO_ENABLED=1 CC_FOR_TARGET=/opt/local/bin/x86_64-elf-gcc
CXX_FOR_TARGET=/opt/local/bin/x86_64-elf-g++ ./make.bash
After building I attempted to build source of a project which imports a library that
uses CGo using the following command:
CGO_ENABLED=1 GOOS=linux GOARCH=amd64 go build
And get the following result:
go build runtime/cgo: cannot use cgo when compiling for a different operating system

Comment 17:

Thank you. It seems I missed a check in the rework of the previous CL. Created
https://golang.org/cl/57210046.

eliasnaur · Feb 8, 2014

Comment 17:

Thank you. It seems I missed a check in the rework of the previous CL. Created
https://golang.org/cl/57210046.

Comment 18:

This issue was updated by revision 9b0736f.

LGTM=iant
R=iant
CC=golang-codereviews
https://golang.org/cl/57210046
Committer: Ian Lance Taylor

ianlancetaylor · Feb 14, 2014

Comment 18:

This issue was updated by revision 9b0736f.

LGTM=iant
R=iant
CC=golang-codereviews
https://golang.org/cl/57210046
Committer: Ian Lance Taylor

Comment 20:

It's marked as Go1.3. What is the status of this? It blocks race cross builds as well.

dvyukov · Mar 15, 2014

Comment 20:

It's marked as Go1.3. What is the status of this? It blocks race cross builds as well.

Comment 22:

From my viewpoint, the status is as described in #15. The various make.* needs updating,
documentation on cross compiler setups are missing and I haven't done anything about
remote testing.

eliasnaur · Mar 15, 2014

Comment 22:

From my viewpoint, the status is as described in #15. The various make.* needs updating,
documentation on cross compiler setups are missing and I haven't done anything about
remote testing.

Comment 23:

The piece about testing is the -exec flag for 'go build' and 'go test'.

rsc · Apr 3, 2014

Comment 23:

The piece about testing is the -exec flag for 'go build' and 'go test'.

Comment 24:

I guess this just needs documentation but I'm not the one to write it. Anyone? If not
we'll just not include any mention in the release. It seems like this is working and
just needs documentation.

Labels changed: added release-go1.3maybe, removed release-go1.3.

rsc · May 9, 2014

Comment 24:

I guess this just needs documentation but I'm not the one to write it. Anyone? If not
we'll just not include any mention in the release. It seems like this is working and
just needs documentation.

Labels changed: added release-go1.3maybe, removed release-go1.3.

Comment 25:

Did you have something like https://golang.org/cl/100390043 in mind?

eliasnaur · May 11, 2014

Comment 25:

Did you have something like https://golang.org/cl/100390043 in mind?

Comment 26:

CL https://golang.org/cl/100390043 mentions this issue.

gopherbot · May 11, 2014

Comment 26:

CL https://golang.org/cl/100390043 mentions this issue.

Comment 27:

This issue was updated by revision 88d07b2.

LGTM=iant, minux.ma, rsc
R=rsc, iant, r, minux.ma
CC=golang-codereviews
https://golang.org/cl/100390043
Committer: Russ Cox

rsc · May 20, 2014

Comment 27:

This issue was updated by revision 88d07b2.

LGTM=iant, minux.ma, rsc
R=rsc, iant, r, minux.ma
CC=golang-codereviews
https://golang.org/cl/100390043
Committer: Russ Cox

Comment 28:

Status changed to Fixed.

rsc · May 20, 2014

Comment 28:

Status changed to Fixed.

minux added fixed labels May 20, 2014

rsc referenced this issue Dec 8, 2014
Closed
cmd/go: allow cross-compiling with cgo #5848

dcarter referenced this issue Dec 31, 2014
Closed
Connection reset by peer #24

rsc added this to the Go1.3 milestone Apr 14, 2015

rsc removed the release-go1.3maybe label Apr 14, 2015

ghost referenced this issue Feb 16, 2016
Open
Abstract the Git operation level to allow alternative Git backends #2592

golang locked and limited conversation to collaborators Jun 24, 2016

gopherbot added the FrozenDueToAge label Jun 24, 2016

This issue was closed.

golang/go

Join GitHub today

cmd/cgo: support cross compilation with cgo enabled #4714

Comments

minux commented Jan 27, 2013

This comment has been minimized.

bradfitz commented Jan 28, 2013

This comment has been minimized.

minux commented Jan 29, 2013

This comment has been minimized.

robpike commented Mar 7, 2013

This comment has been minimized.

rsc commented Jul 30, 2013

This comment has been minimized.

rsc commented Jul 30, 2013

This comment has been minimized.

quarnster commented Aug 1, 2013

This comment has been minimized.

ianlancetaylor commented Sep 4, 2013

This comment has been minimized.

rsc commented Dec 4, 2013

This comment has been minimized.

rsc commented Dec 4, 2013

This comment has been minimized.

rsc commented Dec 4, 2013

This comment has been minimized.

eliasnaur commented Jan 26, 2014

This comment has been minimized.

ianlancetaylor commented Feb 6, 2014

This comment has been minimized.

eliasnaur commented Feb 7, 2014

This comment has been minimized.

gopherbot commented Feb 7, 2014

This comment has been minimized.

eliasnaur commented Feb 8, 2014

This comment has been minimized.

ianlancetaylor commented Feb 14, 2014

This comment has been minimized.

dvyukov commented Mar 15, 2014

This comment has been minimized.

eliasnaur commented Mar 15, 2014

This comment has been minimized.

rsc commented Apr 3, 2014

This comment has been minimized.

rsc commented May 9, 2014

This comment has been minimized.

eliasnaur commented May 11, 2014

This comment has been minimized.

gopherbot commented May 11, 2014

This comment has been minimized.

rsc commented May 20, 2014

This comment has been minimized.

rsc commented May 20, 2014

minux added fixed labels May 20, 2014

rsc referenced this issue Dec 8, 2014

dcarter referenced this issue Dec 31, 2014

rsc added this to the Go1.3 milestone Apr 14, 2015

rsc removed the release-go1.3maybe label Apr 14, 2015

ghost referenced this issue Feb 16, 2016

golang locked and limited conversation to collaborators Jun 24, 2016

gopherbot added the FrozenDueToAge label Jun 24, 2016

This issue was closed.