Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

externalLoadBalancers:targetGroupARN doesn't seem to work #5791

Closed
montyz opened this Issue Sep 15, 2018 · 4 comments

Comments

Projects
None yet
3 participants
@montyz
Copy link

montyz commented Sep 15, 2018

1. What kops version are you running? The command kops version, will display
this information.

Version 1.9.2 (git-cb54c6a52)

2. What Kubernetes version are you running? kubectl version will print the
version if a cluster is running or provide the Kubernetes version specified as
a kops flag.

Client Version: version.Info{Major:"1", Minor:"9", GitVersion:"v1.9.8", GitCommit:"c138b85178156011dc934c2c9f4837476876fb07", GitTreeState:"clean", BuildDate:"2018-05-21T19:01:12Z", GoVersion:"go1.9.3", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"9", GitVersion:"v1.9.9", GitCommit:"57729ea3d9a1b75f3fc7bbbadc597ba707d47c8a", GitTreeState:"clean", BuildDate:"2018-06-29T01:07:01Z", GoVersion:"go1.9.3", Compiler:"gc", Platform:"linux/amd64"}

3. What cloud provider are you using?

AWS

4. What commands did you run? What is the simplest way to reproduce this issue?
Had this in my spec yaml:

apiVersion: kops/v1alpha2
kind: InstanceGroup
metadata:
  creationTimestamp: null
  labels:
    kops.k8s.io/cluster: k8s-dev8a.lark.com
  name: nodes
spec:
  additionalSecurityGroups:
  - sg-0dcc837d
  associatePublicIp: false
  image: 727799750006/lark-k8s-node-acb6360-2018-08-06T18-58-59Z-encrypted
  externalLoadBalancers:
  - targetGroupARN: arn:aws:elasticloadbalancing:us-east-1:727799750006:targetgroup/dev8-public-ingress/033fb3e7488f2e0a
  - targetGroupARN: arn:aws:elasticloadbalancing:us-east-1:727799750006:targetgroup/dev8a-private-ingress/5e0436582989479c
  machineType: r4.2xlarge
  maxSize: 8
  minSize: 8
  nodeLabels:
    kops.k8s.io/instancegroup: nodes
  role: Node
  subnets:
  - dev8a-private.us-east-1a
  - dev8a-private.us-east-1b
  - dev8a-private.us-east-1c
  tenancy: default

Ran

kops replace -f admin/kops-edited-$NAME.yaml
kops update cluster $NAME --yes
kops rolling-update cluster --yes

5. What happened after the commands executed?

Nodes restarted but nothings showed up in the target groups I had specified.

6. What did you expect to happen?

The nodes to be members of the target groups I specified.

7. Please provide your cluster manifest. Execute
kops get --name my.example.com -o yaml to display your cluster manifest.
You may want to remove your cluster name and other sensitive information.

Significantly, my externalLoadBalancer section doesn't appear at all after the update:

---

apiVersion: kops/v1alpha2
kind: InstanceGroup
metadata:
  creationTimestamp: 2018-09-15T00:06:04Z
  labels:
    kops.k8s.io/cluster: k8s-dev8a.lark.com
  name: nodes
spec:
  additionalSecurityGroups:
  - sg-0dcc837d
  associatePublicIp: false
  image: 727799750006/lark-k8s-node-acb6360-2018-08-06T18-58-59Z-encrypted
  machineType: r4.2xlarge
  maxSize: 8
  minSize: 8
  nodeLabels:
    kops.k8s.io/instancegroup: nodes
  role: Node
  subnets:
  - dev8a-private.us-east-1a
  - dev8a-private.us-east-1b
  - dev8a-private.us-east-1c
  tenancy: default

8. Please run the commands with most verbose logging by adding the -v 10 flag.
Paste the logs into this report, or in a gist and provide the gist link here.

[jovyan@6a5424d93ae3 notebooks (⎈ |k8s-dev8a.lark.com:default)]$ kops replace -v 10 -f admin/kops-edited-$NAME.yaml
I0915 00:08:12.744964     640 aws_utils.go:39] Querying EC2 for all valid regions
I0915 00:08:13.552337     640 aws_cloud.go:981] Querying EC2 for all valid zones in region "us-east-1"
I0915 00:08:13.552532     640 request_logger.go:45] AWS request: ec2/DescribeAvailabilityZones
I0915 00:08:13.720336     640 status.go:57] Querying AWS for etcd volumes
I0915 00:08:13.720410     640 status.go:68] Listing EC2 Volumes
I0915 00:08:13.720622     640 request_logger.go:45] AWS request: ec2/DescribeVolumes
I0915 00:08:13.971437     640 status.go:40] Cluster status (from cloud): {}
I0915 00:08:14.542603     640 s3context.go:172] Found bucket "k8s-dev8a.lark.com" in region "us-east-1"
I0915 00:08:14.542657     640 s3fs.go:210] Reading file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/config"
I0915 00:08:14.682547     640 s3fs.go:210] Reading file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/config"
I0915 00:08:14.825322     640 s3fs.go:210] Reading file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/config"
I0915 00:08:14.956858     640 s3fs.go:128] Writing file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/config"
I0915 00:08:14.956900     640 s3fs.go:156] Calling S3 PutObject Bucket="k8s-dev8a.lark.com" Key="k8s-dev8a.lark.com/config" SSE="AES256" ACL=""
I0915 00:08:15.106650     640 s3fs.go:210] Reading file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/config"
I0915 00:08:15.236911     640 s3fs.go:210] Reading file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/instancegroup/master-us-east-1a"
I0915 00:08:15.376368     640 s3fs.go:210] Reading file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/instancegroup/master-us-east-1a"
I0915 00:08:15.509590     640 s3fs.go:128] Writing file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/instancegroup/master-us-east-1a"
I0915 00:08:15.509631     640 s3fs.go:156] Calling S3 PutObject Bucket="k8s-dev8a.lark.com" Key="k8s-dev8a.lark.com/instancegroup/master-us-east-1a" SSE="AES256" ACL=""
I0915 00:08:15.658047     640 s3fs.go:210] Reading file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/config"
I0915 00:08:15.800768     640 s3fs.go:210] Reading file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/instancegroup/master-us-east-1b"
I0915 00:08:15.953105     640 s3fs.go:210] Reading file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/instancegroup/master-us-east-1b"
I0915 00:08:16.089238     640 s3fs.go:128] Writing file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/instancegroup/master-us-east-1b"
I0915 00:08:16.089276     640 s3fs.go:156] Calling S3 PutObject Bucket="k8s-dev8a.lark.com" Key="k8s-dev8a.lark.com/instancegroup/master-us-east-1b" SSE="AES256" ACL=""
I0915 00:08:16.243922     640 s3fs.go:210] Reading file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/config"
I0915 00:08:16.650248     640 s3fs.go:210] Reading file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/instancegroup/master-us-east-1c"
I0915 00:08:16.790802     640 s3fs.go:210] Reading file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/instancegroup/master-us-east-1c"
I0915 00:08:16.935182     640 s3fs.go:128] Writing file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/instancegroup/master-us-east-1c"
I0915 00:08:16.935294     640 s3fs.go:156] Calling S3 PutObject Bucket="k8s-dev8a.lark.com" Key="k8s-dev8a.lark.com/instancegroup/master-us-east-1c" SSE="AES256" ACL=""
I0915 00:08:17.089536     640 s3fs.go:210] Reading file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/config"
I0915 00:08:17.231200     640 s3fs.go:210] Reading file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/instancegroup/nodes"
I0915 00:08:17.394419     640 s3fs.go:210] Reading file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/instancegroup/nodes"
I0915 00:08:17.533214     640 s3fs.go:128] Writing file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/instancegroup/nodes"
I0915 00:08:17.533369     640 s3fs.go:156] Calling S3 PutObject Bucket="k8s-dev8a.lark.com" Key="k8s-dev8a.lark.com/instancegroup/nodes" SSE="AES256" ACL=""
I0915 00:08:17.679631     640 s3fs.go:210] Reading file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/config"
I0915 00:08:17.814172     640 s3fs.go:210] Reading file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/instancegroup/bastions"
I0915 00:08:17.965676     640 s3fs.go:210] Reading file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/instancegroup/bastions"
I0915 00:08:18.108013     640 s3fs.go:128] Writing file "s3://k8s-dev8a.lark.com/k8s-dev8a.lark.com/instancegroup/bastions"
I0915 00:08:18.108093     640 s3fs.go:156] Calling S3 PutObject Bucket="k8s-dev8a.lark.com" Key="k8s-dev8a.lark.com/instancegroup/bastions" SSE="AES256" ACL=""

9. Anything else do we need to know?

Some kind of typo? Hard for me to tell.

@montyz

This comment has been minimized.

Copy link
Author

montyz commented Sep 18, 2018

I upgraded to 1.10 and this is working now.

@montyz montyz closed this Sep 18, 2018

@avmusa

This comment has been minimized.

Copy link

avmusa commented Jan 26, 2019

Does not work with kops 1.11.0 (git-2c2042465).
I created cluster from a file. When I edit my ig, I see

spec:
 externalLoadBalancers:
  - {}

@avmusa

This comment has been minimized.

Copy link

avmusa commented Jan 26, 2019

Looks like it must be targetGroupArn instead targetGroupARN

  externalLoadBalancers:
  - targetGroupArn: <my-tg-arn>
@ferhimedamine

This comment has been minimized.

Copy link

ferhimedamine commented Feb 20, 2019

@avmusa thanks for the hint! did work 🙏 ☮️

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.