Skip to content

Commercial AI (before ChatCPT, Copilote,...)

GregLinthicum edited this page Sep 25, 2024 · 1 revision

Interactive Data Visualization with Orange

When should I choose AWS Elastic Inference (EI) for inference vs Amazon EC2 Inf1 instances?

There are two cases where developers would choose EI over Inf1 instances:

  • if you need different CPU and memory sizes than what Inf1 offers, then you can use EI to attach acceleration to the EC2 instance with the right mix of CPU and memory for your application
  • if your performance requirements are significantly lower than what the smallest Inf1 instance provides, then using EI could be a more cost effective choice. For example, if you only need 5 TOPS, enough for processing up to 6 concurrent video streams, then using the smallest slice of EI with a C5.large instance could be up to 50% cheaper than using the smallest size of an Inf1 instance.
  • SAP HANA
  • DPA (Digital Process Automation)
  • RPA (Robotic Intelligent Automation)
  • 2UDA for PostgreSQL 2ndQuadrant Unified Data Analytics (2UDA) is a data analytics application suite that unifies databases, machine learning, data mining, and visualization. 2UDA for PostgreSQL 9.5.24, 9.6.20, 10.15, 11.10, 12.5 and 13.1 was released on November 12, 2020.
  • DLAMI - AWS Inferencia chip. Using TensorFlow-Neuron and the AWS Neuron Compiler.

Clone this wiki locally