# sample-genai-on-eks-starter-kit

> A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for:  🚀 AI Gateway (LiteLLM) 🤖 LLM Serving (vLLM, SGLang, Ollama

- **URL**: https://www.freshcrate.ai/projects/sample-genai-on-eks-starter-kit
- **Author**: aws-samples
- **Category**: Databases
- **Latest version**: `v1.1.1` (2026-04-28)
- **License**: MIT-0
- **Source**: https://github.com/aws-samples/sample-genai-on-eks-starter-kit
- **Language**: JavaScript
- **GitHub**: 53 stars, 32 forks
- **Registry**: github
- **Tags**: `agentic-ai`, `ai-engineering`, `ai-platform`, `javascript`, `kubernetes`, `llm-inference`, `llmops`

## Description

A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for:  🚀 AI Gateway (LiteLLM) 🤖 LLM Serving (vLLM, SGLang, Ollama) 📊 Vector Databases, 🔍 Embedding Models (TEI) 📈 Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes

## Recent releases

| Version | Date | Urgency | Changes |
| --- | --- | --- | --- |
| `v1.1.1` | 2026-04-28 | High | ## What's Changed  ### Fixes - Attach `session_id` and `tags` to Langfuse traces in the Loan Buddy agent via `RunnableConfig.metadata` so Langfuse SDK v4 populates the Session and Tags columns — unblocks Module 4 evaluator filters such as `Tags contains loan-processing`. The companion image `public.ecr.aws/agentic-ai-platforms-on-k8s/loan-buddy-example:1.0.4` (multi-arch `linux/amd64` + `linux/arm64`) ships the patched agent. (#141) - Add missing `nltk==3.9.4` to `components/guardrail/guardrails |
| `v1.1.0` | 2026-04-14 | High | ## What's New  ### NVIDIA Dynamo Platform - Add NVIDIA Dynamo platform components for optimized LLM inference on EKS (#102)   - GPU Operator, Monitoring (Prometheus + Grafana), Dynamo Platform, Dynamo vLLM Serving   - AIPerf Benchmark for concurrency sweep   - AIConfigurator for auto TP/PP recommendation and SLA-driven deployment   - Supports aggregated and disaggregated inference modes with KV cache routing  ### OpenClaw AI Agent Orchestrator - Add OpenClaw AI Agent component and examples (#87- |
| `v1.0.2` | 2026-02-22 | Low | ## What's Changed * chore: update Bedrock models with Claude 4.5 and Nova 2 by @longwind48 in https://github.com/aws-samples/sample-genai-on-eks-starter-kit/pull/61 * Update variables.tf in eks-standard-mode module by @utkarpun in https://github.com/aws-samples/sample-genai-on-eks-starter-kit/pull/56 * Fixes by @aonz in https://github.com/aws-samples/sample-genai-on-eks-starter-kit/pull/72 * Bump lodash from 4.17.21 to 4.17.23 by @dependabot[bot] in https://github.com/aws-samples/sample-gena |
| `v1.0.1` | 2025-11-13 | Low | ## What's Changed * Bump mcp from 1.9.4 to 1.10.0 in /examples/strands-agents/calculator-agent by @dependabot[bot] in https://github.com/aws-samples/sample-genai-on-eks-starter-kit/pull/18 * Bump tmp and @inquirer/editor by @dependabot[bot] in https://github.com/aws-samples/sample-genai-on-eks-starter-kit/pull/19 * Add EKS standard mode v2 by @aonz in https://github.com/aws-samples/sample-genai-on-eks-starter-kit/pull/14 * Bug bash fix by @utkarpun in https://github.com/aws-samples/sample-ge |
| `v1.0.0` | 2025-10-21 | Low | ## What's Changed * Add AWS Neuron on vLLM by @aonz in https://github.com/aws-samples/sample-genai-on-eks-starter-kit/pull/1 * Fix pod resources by @aonz in https://github.com/aws-samples/sample-genai-on-eks-starter-kit/pull/2 * Add no domain name option by @aonz in https://github.com/aws-samples/sample-genai-on-eks-starter-kit/pull/3 * Merge main and workshops branches by @utkarpun in https://github.com/aws-samples/sample-genai-on-eks-starter-kit/pull/15  ## New Contributors * @aonz made |

## Citation

- HTML: https://www.freshcrate.ai/projects/sample-genai-on-eks-starter-kit
- Markdown: https://www.freshcrate.ai/projects/sample-genai-on-eks-starter-kit.md
- Dependencies JSON: https://www.freshcrate.ai/api/projects/sample-genai-on-eks-starter-kit/deps

_Generated by freshcrate.ai. Indexes github releases for AI-agent ecosystem packages._