Skip to content

fogfish/serverless

Repository files navigation

serverless

Serverless Erlang runtime for AWS Lambda Service, widen horizon of Erlang applications.

Build Status Coverage Status Hex.pm

Inspiration

Run code without provisioning or managing servers is a modern way to deliver applications. This library enables Erlang runtime at AWS Lambda service using AWS Lambda Runtime Interface. The Erlang runtime is deployed as AWS Lambda Layer to your AWS account.

The library uses escript executable to package, debug and deploy lambda functions.

Key features

  • Implements Erlang runtime for AWS Lambda service.
  • Deploys Erlang\OTP as AWS Lambda Layer.
  • Defines a lambda's life-cycle workflow using AWS CDK.
  • Provides command line tools to orchestrate local development and production deployments.

Getting started

The latest version of the library is available at its master branch. All development, including new features and bug fixes, take place on the master branch using forking and pull requests as described in contribution guidelines.

The stable library release is available via hex packages, add the library as dependency to rebar.config

{deps, [
  serverless
]}.

Latest development version is available at GitHub, add the library as dependency to rebar.config

{deps, [
   {serverless, ".*",
      {git, "https://github.com/fogfish/serverless", {branch, master}}
   }
]}.

The easiest way to start with Erlang serverless function development is a template provided by serverless.mk. Please look on hello world example as a play ground to get things up and running.

Workflow

The library defines a life-cycle workflow to distribute Erlang application from sources to the cloud - AWS Lambda service. The workflow builds a distribution package of Erlang application using rebar3 with help of Makefile orchestration. The file serverless.mk implements the workflow:

  1. Configure AWS account.
  2. Create a new function.
  3. Build function
  4. Run function locally
  5. Package function
  6. Deploy function
  7. Clean up

Configure AWS account

Usage of AWS Lambda Layers simplifies an experience of lambda development and deployment. A custom Erlang runtime is provisioned with layers feature. The library uses docker image fogfish/erlang-serverless to distribute a runtime compatible with AWS Lambda service, the image is managed by erlang-in-docker.

You have to deploy a layer to you account before you'll be able to run any function. The following command builds a zip archive with Erlang runtime and deploys it your AWS account. Please notice, this operation has to be executed only once per AWS Account.

cd examples/helloworld

make layer

Create a new function

The easiest way to start with Erlang serverless function development is a template provided by serverless.mk. Create a new folder for your function and download the workflow orchestration file.

mkdir myfun && cd myfun

curl -O -L https://raw.githubusercontent.com/fogfish/serverless/master/serverless.mk

then, create a Makefile. Please note, EVENT a default mock event used by local execution.

cat > Makefile <<EOF
APP       = name_of_my_function
EVENT    ?= test/event.json

include serverless.mk
EOF

Use build-in template to generate empty function

make function

The command downloads a docker images with serverless runtime, creates a source code of identity function, empty test suites, rebar config files and initializes deployment configurations. As the result, the following folder structure is created

+
+- cloud                           // cloud deployment configurations
|  +- aws.ts                       // aws cdk deployment template
| ...
+- src                             // source code of lambda function
|  +- name-of-my-function.app.src
|  +- name-of-my-function.erl
+- test                            // tests of lambda function
|  +- event.json                   // specification of default event mock
|  |
| ...
+- rebar.config

You project is ready for development.

Build function

Use default Makefile target to compile and test the application. Serverless library promotes a Erlang Common Tests for automated testing.

make

You can also invoke compile and test targets sequentially.

make compile
make test

The library provides a Lambda Runtime API mock serverless:mock, use to test your code.

#{<<"helloworld">> => #{}} = serverless:mock(
   helloworld,               %% Function entry point
   #{}                       %% Mock input, mock function returns Lambda output
).

Run function locally

Runs your Amazon Lambda function locally. It passes content of test/event.json as Amazon Lambda event object.

make run

Use EVENT variable to pass other than default event

make run EVENT=test/kinesis.json

Often, AWS Lambda Event contains in-line JSON as string (e.g. Gateway API, Kinesis, etc). Maintainability of such content for mock purposes is tedious. You can use template feature to maintain event metadata and payload in different files.

// test/event.json
{
  "path": "/test/hello",
  "headers": { ... },
  "body": $json
}

// test/payload.json
{
  "foo": "bar",
  "boo": "baa"
}

Then use JSON variable to bind content of $json variable to a file

make run JSON=test/payload.json

Package function

Use dist target to assemble an escript executable containing the project's and its dependencies' BEAM files.

make dist

As the result, _build/default/bin/name-of-my-function executable.

Deploy function

The workflow implements a target dist-up to orchestrate deployment with help of AWS CDK.

To deploy a function, you need a stack configuration. The serverless library manages environment configurations at cloud folder. The stack contains reference to an execution role, lambda layer and other. A minimal configuration is supplied as part of function template. Please refers to official AWS CDK documentation if you need to make advanced config.

After the stack configuration is completed, deploy it

make dist-up

Congratulations, your function is production ready!

Clean up

A few targets are supported:

  • dist-rm remove lambda deployment(s) at specified environment.
  • clean build artifacts.
  • distclean clean up everything except source code.

How To Contribute

The library is MIT licensed and accepts contributions via GitHub pull requests:

  1. Fork it
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Added some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create new Pull Request

The development requires Erlang/OTP version 20.0 or later and essential build tools.

commit message

The commit message helps us to write a good release note, speed-up review process. The message should address two question what changed and why. The project follows the template defined by chapter Contributing to a Project of Git book.

Short (50 chars or less) summary of changes

More detailed explanatory text, if necessary. Wrap it to about 72 characters or so. In some contexts, the first line is treated as the subject of an email and the rest of the text as the body. The blank line separating the summary from the body is critical (unless you omit the body entirely); tools like rebase can get confused if you run the two together.

Further paragraphs come after blank lines.

Bullet points are okay, too

Typically a hyphen or asterisk is used for the bullet, preceded by a single space, with blank lines in between, but conventions vary here

bugs

If you experience any issues with the library, please let us know via GitHub issues. We appreciate detailed and accurate reports that help us to identity and replicate the issue.

  • Specify the configuration of your environment. Include which operating system you use and the versions of runtime environments.

  • Attach logs, screenshots and exceptions, in possible.

  • Reveal the steps you took to reproduce the problem, include code snippet or links to your project.

License

See LICENSE