Skip to content

Mimir v1.1

Choose a tag to compare

View all tags
@tanuj24 tanuj24 released this 06 Jun 13:18
v1.1
3b539b5

Mimir v1.1 makes the compute services run real workloads: AWS Glue jobs execute unmodified Glue code on the official Glue runtime, AWS Lambda gains a full function console, and the whole stack is easier to keep an eye on.

AWS Glue — real runtime

  • Jobs and notebooks run on the official AWS Glue runtime images (Glue 5.0/4.0/3.0/2.0), so unmodified Glue code runs locally with the real awsglue library, a version-matched Spark, and the same preinstalled libraries (boto3/pandas/numpy/pyarrow) as AWS.
  • GlueContext, DynamicFrame, the Glue transforms, Job, and getResolvedOptions all work — for both Spark (glueetl) and Python-shell jobs.
  • create_dynamic_frame.from_catalog reads from the local Glue Data Catalog; s3:// / s3a:// reads and writes are wired to local S3.
  • Notebook run logs stream live, and kernels auto-stop after 120 min idle, resuming transparently on the next cell.

AWS Lambda — full function console

  • New per-function detail view: Code, Test, Configuration, Aliases & versions, and Triggers.
  • Edit and redeploy code (inline editor or .zip); configure memory, timeout, ephemeral /tmp storage, handler, runtime, environment variables, X-Ray tracing, reserved concurrency, Function URLs, tags, and async-invocation settings.
  • Publish versions, manage aliases, invoke a specific version/alias, and wire triggers (event source mappings for SQS / DynamoDB / Kinesis).
  • Create flow adds architecture (x86_64 / arm64), ephemeral storage, and more runtimes (Node.js 18/20/22, Python 3.9–3.13, Ruby 3.3, Java 17/21, provided.al2023).

Observability & lifecycle

  • A constant bottom resource monitor bar shows host CPU, RAM, and running container count.
  • EC2 instance containers are cleaned up on terminate, and orphans from terminated instances are reaped automatically.
  • Build and Docker fixes for a smoother docker compose up.

Full Changelog: v1.0...v1.1

Assets 2
Loading