[Functionbeat] Docker

[CEikermann]

Hello,

we want to deploy functionbeat changes via our CI/CD pipeline. Our idea was to run a small docker container to execute functionbeat commands instead of downloading the functionbeat binary for the right platform.

Can you provide a docker image for functionbeat as well like for all other beats?

Best regards,
Christian

[pawarrchetan]

@andresrc I would also like to have a docker image for Functionbeats.
I am trying to deploy a serverless function for centralized logging. However the normal alpine image gives below error while executing functionbeat.

$ docker run -it --entrypoint sh functionbeat-v9:latest                                                                   [14:41:58]
/ #
/ # which functionbeat
/bin/functionbeat
/ #
/ # functionbeat
sh: functionbeat: not found

My Dockerfile looks like below.

FROM alpine:latest

ARG FUNCTIONBEAT_VERSION=7.6.1

ADD https://artifacts.elastic.co/downloads/beats/functionbeat/functionbeat-${FUNCTIONBEAT_VERSION}-linux-x86_64.tar.gz /tmp

RUN apk add --update --no-cache curl && \
    tar xzvf /tmp/functionbeat-${FUNCTIONBEAT_VERSION}-linux-x86_64.tar.gz && \
    mv functionbeat-${FUNCTIONBEAT_VERSION}-linux-x86_64/functionbeat /bin/ && \
    chmod a+x /bin/functionbeat

ENV PATH /bin/functionbeat:$PATH

ENTRYPOINT ["/bin/functionbeat"]`

[pawarrchetan]

@CEikermann @andresrc

The working Dockerfile looks like this -

FROM debian:latest

ARG FUNCTIONBEAT_VERSION=7.6.1

ADD https://artifacts.elastic.co/downloads/beats/functionbeat/functionbeat-${FUNCTIONBEAT_VERSION}-linux-x86_64.tar.gz /tmp

RUN \
    apt-get update \
    && apt-get install -y --no-install-recommends \
    curl \
    && rm -rf /var/lib/apt/lists/* && \
    tar xzvf /tmp/functionbeat-${FUNCTIONBEAT_VERSION}-linux-x86_64.tar.gz && \
    mv functionbeat-${FUNCTIONBEAT_VERSION}-linux-x86_64/functionbeat /bin/functionbeat && \
    chmod a+x /bin/functionbeat

ENV PATH /bin/functionbeat:$PATH

ENTRYPOINT ["functionbeat"]

[kvch]

Thank you for sharing!

[nefelim4ag]

FROM ubuntu:latest

ARG FUNCTIONBEAT_VERSION=7.7.1

ADD https://artifacts.elastic.co/downloads/beats/functionbeat/functionbeat-${FUNCTIONBEAT_VERSION}-linux-x86_64.tar.gz /tmp

RUN \
    apt-get update \
    && apt-get install -y --no-install-recommends \
    curl \
    && rm -rf /var/lib/apt/lists/* && \
    tar xzvf /tmp/functionbeat-${FUNCTIONBEAT_VERSION}-linux-x86_64.tar.gz && \
    mv -v functionbeat-${FUNCTIONBEAT_VERSION}-linux-x86_64 /opt/functionbeat

WORKDIR /opt/functionbeat
ENV PATH /opt/functionbeat:$PATH

ENTRYPOINT ["functionbeat"]

I got error "Missing pkg/functionbeat-aws" for above dockerfile, so i fix it for current version

[DanielWagner87]

I get the following error each time:

Function: functionbeat, could not deploy, error: bucket 'functionbeat-deployment' already exist and you don't have permission to access it.

I pass the AWS credentials into the container as environment variables. Locally (without Docker Image), the deployment works with my credentials.

This is my docker run command:

docker run -it --rm \
-v $(pwd)/config:/functionbeat/config:ro \
--env AWS_ACCESS_KEY_ID=$AWS_ACCESS_KEY_ID \
--env AWS_SECRET_ACCESS_KEY=$AWS_SECRET_ACCESS_KEY \
--env AWS_SESSION_TOKEN=$AWS_SESSION_TOKEN \
--env AWS_SECURITY_TOKEN=$AWS_SECURITY_TOKEN \
--env AWS_REGION=eu-central-1 \
--env AWS_DEFAULT_REGION=eu-central-1 \
myorga/functionbeat:latest \
deploy functionbeat -c /functionbeat/config/functionbeat.yml -e -v -d "*"

I have no idea what I am doing wrong. I also have the problem with the above Dockerfile.

[elasticmachine]

Pinging @elastic/integrations-services (Team:Services)

[DanielWagner87]

Together with @mmathea-ep we could now solve the problem and build a running Docker Image. Apparently Python is required for the functionbeat executable to work.

This is our Dockerfile:

FROM python:3.7.9-slim-buster as functionbeat-download

ENV FUNCTIONBEAT_VERSION=7.8.1
ENV FUNCTIONBEAT_PACKAGE=functionbeat-${FUNCTIONBEAT_VERSION}-linux-x86_64

ADD https://artifacts.elastic.co/downloads/beats/functionbeat/${FUNCTIONBEAT_PACKAGE}.tar.gz /tmp
RUN mkdir -p /functionbeat && \
    tar -xvf /tmp/${FUNCTIONBEAT_PACKAGE}.tar.gz --strip 1 -C /functionbeat

FROM python:3.7.9-slim-buster

RUN addgroup functionbeat \
 && useradd -g functionbeat --no-create-home functionbeat

USER functionbeat

ENV PATH /bin/functionbeat:$PATH

ENTRYPOINT ["/bin/functionbeat"]
CMD ["help"]

WORKDIR /functionbeat
VOLUME ["/functionbeat/config"]

COPY --from=functionbeat-download /functionbeat/functionbeat /bin/functionbeat
COPY --from=functionbeat-download /functionbeat/pkg/functionbeat-aws /functionbeat/pkg/functionbeat-aws

You can run it via:

docker run -it --rm \
-v $(pwd)/config:/functionbeat/config:ro \
--env AWS_ACCESS_KEY_ID=$AWS_ACCESS_KEY_ID \
--env AWS_SECRET_ACCESS_KEY=$AWS_SECRET_ACCESS_KEY \
--env AWS_SESSION_TOKEN=$AWS_SESSION_TOKEN \
--env AWS_DEFAULT_REGION=$AWS_DEFAULT_REGION \
{{ DOCKER IMAGE }} \
deploy {{ FUNCTIONBEAT_NAME }} -c /functionbeat/config/functionbeat.yml -e -v -d "*"

Starting from your current directory the folder /config is mounted into the container. In this folder you should place the config file functionbeat.yml.

[elasticmachine]

Pinging @elastic/elastic-agent-data-plane (Team:Elastic-Agent-Data-Plane)

[botelastic]

Hi!
We just realized that we haven't looked into this issue in a while. We're sorry!

We're labeling this issue as Stale to make it hit our filters and make sure we get back to it as soon as possible. In the meantime, it'd be extremely helpful if you could take a look at it as well and confirm its relevance. A simple comment with a nice emoji will be enough :+1.
Thank you for your contribution!