freshcrate
Skin:/
Home > MCP Servers > composio

composio

Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.

Why this rank:Strong adoptionRecent releaseHealthy release cadence

Description

Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.

README

Composio Logo

Composio SDK

Skills that evolve for your Agents

๐ŸŒ Website โ€ข ๐Ÿ“š Documentation

GitHub StarsPyPI Downloads NPM Downloads Discord

This repository contains the official Software Development Kits (SDKs) for Composio, providing seamless integration capabilities for Python and Typescript Agentic Frameworks and Libraries.

Getting Started

TypeScript SDK Installation

# Using npm
npm install @composio/core

# Using yarn
yarn add @composio/core

# Using pnpm
pnpm add @composio/core

Quick start:

import { Composio } from '@composio/core';
// Initialize the SDK
const composio = new Composio({
  // apiKey: 'your-api-key',
});

Simple Agent with OpenAI Agents

npm install @composio/openai-agents @openai/agents
import { Composio } from '@composio/core';
import { OpenAIAgentsProvider } from '@composio/openai-agents';
import { Agent, run } from '@openai/agents';

const composio = new Composio({
  provider: new OpenAIAgentsProvider(),
});

const userId = 'user@acme.org';

const tools = await composio.tools.get(userId, {
  toolkits: ['HACKERNEWS'],
});

const agent = new Agent({
  name: 'Hackernews assistant',
  tools: tools,
});

const result = await run(agent, 'What is the latest hackernews post about?');

console.log(JSON.stringify(result.finalOutput, null, 2));
// will return the response from the agent with data from HACKERNEWS API.

Python SDK Installation

# Using pip
pip install composio

# Using poetry
poetry add composio

Quick start:

from composio import Composio

composio = Composio(
  # api_key="your-api-key",
)

Simple Agent with OpenAI Agents

pip install composio_openai_agents openai-agents
import asyncio
from agents import Agent, Runner
from composio import Composio
from composio_openai_agents import OpenAIAgentsProvider

# Initialize Composio client with OpenAI Agents Provider
composio = Composio(provider=OpenAIAgentsProvider())

user_id = "user@acme.org"
tools = composio.tools.get(user_id=user_id, toolkits=["HACKERNEWS"])

# Create an agent with the tools
agent = Agent(
    name="Hackernews Agent",
    instructions="You are a helpful assistant.",
    tools=tools,
)

# Run the agent
async def main():
    result = await Runner.run(
        starting_agent=agent,
        input="What's the latest Hackernews post about?",
    )
    print(result.final_output)

asyncio.run(main())
# will return the response from the agent with data from HACKERNEWS API.

For more detailed usage instructions and examples, please refer to each SDK's specific documentation.

Open API Specification

To update the OpenAPI specifications used for generating SDK documentation:

# Pull the latest API specifications from the backend
pnpm api:pull

This command pulls the OpenAPI specification from https://backend.composio.dev/api/v3/openapi.json and updates the local API documentation files.

This is pulled automatically with build step.

Available SDKs

TypeScript SDK (/ts)

The TypeScript SDK provides a modern, type-safe way to interact with Composio's services. It's designed for both Node.js and browser environments, offering full TypeScript support with comprehensive type definitions.

For detailed information about the TypeScript SDK, please refer to the TypeScript SDK Documentation.

Python SDK (/python)

The Python SDK offers a Pythonic interface to Composio's services, making it easy to integrate Composio into your Python applications. It supports Python 3.10+ and follows modern Python development practices.

For detailed information about the Python SDK, please refer to the Python SDK Documentation.

Provider Support

The following table shows which AI frameworks and platforms are supported in each SDK:

Provider TypeScript Python
OpenAI โœ… โœ…
OpenAI Agents โœ… โœ…
Anthropic โœ… โœ…
LangChain โœ… โœ…
LangGraph โœ…* โœ…
LlamaIndex โœ… โœ…
Vercel AI SDK โœ… โŒ
Google Gemini โœ… โœ…
Google ADK โŒ โœ…
Mastra โœ… โŒ
Cloudflare Workers AI โœ… โŒ
CrewAI โŒ โœ…
AutoGen โŒ โœ…

* LangGraph in TypeScript is supported via the @composio/langchain package.

Don't see your provider? Learn how to build a custom provider to integrate with any AI framework.

Packages

Core Packages

Package Version
TypeScript
@composio/core npm version
Python
composio PyPI version

Provider Packages

Package Version
TypeScript
@composio/openai npm version
@composio/openai-agents npm version
@composio/anthropic npm version
@composio/langchain npm version
@composio/llamaindex npm version
@composio/vercel npm version
@composio/google npm version
@composio/mastra npm version
@composio/cloudflare npm version
Python
composio-openai PyPI version
composio-openai-agents PyPI version
composio-anthropic PyPI version
composio-langchain PyPI version
composio-langgraph PyPI version
composio-llamaindex PyPI version
composio-crewai PyPI version
composio-autogen PyPI version
composio-gemini PyPI version
composio-google PyPI version
composio-google-adk PyPI version

Utility Packages

Package Version
@composio/json-schema-to-zod npm version
@composio/ts-builders npm version

if you are looking for the older sdk, you can find them here

Rube

Rube is a Model Context Protocol (MCP) server built with Composio. It connects your AI tools to 500+ apps like Gmail, Slack, GitHub, and Notion. Simply install it in your AI client, authenticate once with your apps, and start asking your AI to perform real actions like "Send an email" or "Create a task."

It integrates with major AI clients like Cursor, Claude Desktop, VS Code, Claude Code and any custom MCPโ€‘compatible client. You can switch between these clients and your integrations follow you.

Contributing

We welcome contributions to both SDKs! Please read our contribution guidelines before submitting pull requests.

License

This project is licensed under the MIT License - see the LICENSE file for details.

Support

If you encounter any issues or have questions about the SDKs:

Release History

VersionChangesUrgencyDate
@composio/claude-agent-sdk@0.9.2### Patch Changes - Updated dependencies [42ebff3] - @composio/core@0.10.0 High5/13/2026
py@0.13.0[0.13.0] - 2026-05-07 Highlights - Python SDK package train bumped to 0.13.0. - Added Tool Router v3.1 support: preload, SDK-local custom tool preload, attach/use flow refinements, and session.update(). - Added connected account updates: REVOKED status, connected account string/list coercion, and the allow_multiple guard. - Added workbench sandbox compute tier support. - Security fixes for CustomTool credential isolation and file download path traversal. Notes - Provider packages were bumpedHigh5/7/2026
@composio/cli@0.2.28## What's Changed * docs: simplify connectedAccounts.delete() description by @zen-agent in https://github.com/ComposioHQ/composio/pull/3316 * docs: workbench sandbox compute tier and link allow_multiple by @abir-taheer in https://github.com/ComposioHQ/composio/pull/3305 * feat(cli): add agent signup and claim support by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3317 **Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/claude-agent-sdk@0.8.1...@compHigh5/1/2026
py@0.12.0[0.12.0] - 2026-04-28 Changed - BREAKING โ€” Automatic file upload/download is now opt-in. The SDK no longer auto-stages local paths or URLs for tools with file_uploadable inputs, and no longer auto-downloads file_downloadable results. Existing code that relied on this behaviour must opt back in via the new flag below. High4/28/2026
@composio/google@0.6.11### Patch Changes - Updated dependencies [27ed0c9] - @composio/core@0.6.11 High4/23/2026
@composio/cli@0.2.25-beta.215## What's Changed * docs: update toolkits, API spec, and meta tools data by @github-actions[bot] in https://github.com/ComposioHQ/composio/pull/3230 * docs: update toolkits, API spec, and meta tools data by @github-actions[bot] in https://github.com/ComposioHQ/composio/pull/3233 * docs: add observability narrative for logs + usage APIs by @shamsharoon in https://github.com/ComposioHQ/composio/pull/3235 * fix(cli): encode path segments in dashboard fallback URL by @sarahsimionescu in https://githHigh4/18/2026
@composio/cli@0.2.25-beta.214## What's Changed * fix(core): restore session.toolkits() pagination by @jkomyno in https://github.com/ComposioHQ/composio/pull/3193 * docs: expand MCP connected account error with auth config scoping details by @decimal-pr-bot[bot] in https://github.com/ComposioHQ/composio/pull/3224 * docs: update TypeScript SDK reference from source by @github-actions[bot] in https://github.com/ComposioHQ/composio/pull/3226 * docs: update toolkits, API spec, and meta tools data by @github-actions[bot] in httpsHigh4/16/2026
@composio/cli@0.2.25-beta.213## What's Changed * Fix `install-skill` flag spelling in CLI help and parser by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3223 **Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.25-beta.212...@composio/cli@0.2.25-beta.213High4/16/2026
@composio/cli@0.2.25-beta.212## What's Changed * Add CLI runtime headers to Composio client by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3222 **Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.25-beta.211...@composio/cli@0.2.25-beta.212High4/16/2026
@composio/cli@0.2.25-beta.211## What's Changed * docs: add guidance on when to use latest vs pinned toolkit versions by @zen-agent in https://github.com/ComposioHQ/composio/pull/3207 * docs: update toolkits, API spec, and meta tools data by @github-actions[bot] in https://github.com/ComposioHQ/composio/pull/3209 * docs: fix requireExplicitSelection description in multi-account docs by @abir-taheer in https://github.com/ComposioHQ/composio/pull/3218 * chore(cli): bump @composio/cli to 0.2.24 to realign with GitHub release byHigh4/15/2026
@composio/cli@0.2.23Stable @composio/cli@0.2.23 release. Binaries mirrored from @composio/cli@0.2.24 (both built from the same commit `ece9f7bb`) because the original release workflow misclassified the version-bump merge as a beta due to a shallow-checkout bug; fix in https://github.com/ComposioHQ/composio/pull/3212.Medium4/14/2026
@composio/cli@0.2.24## What's Changed * chore: CLI 0.2.23 patch release by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3210 * Release: update version by @haxzie in https://github.com/ComposioHQ/composio/pull/3211 **Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.23-beta.207...@composio/cli@0.2.24High4/14/2026
@composio/cli@0.2.24## What's Changed * chore: CLI 0.2.23 patch release by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3210 * Release: update version by @haxzie in https://github.com/ComposioHQ/composio/pull/3211 **Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.23-beta.207...@composio/cli@0.2.24Medium4/14/2026
@composio/cli@0.2.24## What's Changed * chore: CLI 0.2.23 patch release by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3210 * Release: update version by @haxzie in https://github.com/ComposioHQ/composio/pull/3211 **Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.23-beta.207...@composio/cli@0.2.24Medium4/14/2026
@composio/cli@0.2.24-beta.209## What's Changed * chore: CLI 0.2.23 patch release by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3210 * Release: update version by @haxzie in https://github.com/ComposioHQ/composio/pull/3211 **Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.23-beta.207...@composio/cli@0.2.24-beta.209Medium4/14/2026
@composio/cli@0.2.23-beta.208**Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.23-beta.207...@composio/cli@0.2.23-beta.208Medium4/14/2026
@composio/cli@0.2.23-beta.207## What's Changed * Add help verbosity modes to CLI help output by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3205 **Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.23-beta.206...@composio/cli@0.2.23-beta.207Medium4/14/2026
@composio/cli@0.2.23-beta.206## What's Changed * docs: update Python SDK reference from source by @github-actions[bot] in https://github.com/ComposioHQ/composio/pull/3158 * docs: update TypeScript SDK reference from source by @github-actions[bot] in https://github.com/ComposioHQ/composio/pull/3159 * docs: update toolkits, API spec, and meta tools data by @github-actions[bot] in https://github.com/ComposioHQ/composio/pull/3194 * feat(cli): add `composio connections list` command by @CryogenicPlanet in https://github.com/CompMedium4/14/2026
@composio/cli@0.2.23-beta.205## What's Changed * feat(cli-keyring): add @composio/cli-keyring package by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3201 * feat(cli): migrate API key storage from plaintext to OS keyring by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3202 **Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.23-beta.202...@composio/cli@0.2.23-beta.205Medium4/14/2026
@composio/cli@0.2.23-beta.203**Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.21-beta.201...@composio/cli@0.2.23-beta.203Medium4/14/2026
@composio/cli@0.2.23-beta.204**Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.21-beta.201...@composio/cli@0.2.23-beta.204Medium4/14/2026
@composio/cli@0.2.23-beta.202## What's Changed * docs: dual API version reference (v3.1 + v3.0) by @Sushmithamallesh in https://github.com/ComposioHQ/composio/pull/3179 * docs: changelog for API v3.1 tool version defaults by @zen-agent in https://github.com/ComposioHQ/composio/pull/3142 * Add AI issue triage workflow by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3203 * Add CLI dev mode config toggle by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3181 **Full Changelog**: https://gitMedium4/14/2026
@composio/cli@0.2.21-beta.201**Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.23-beta.200...@composio/cli@0.2.21-beta.201Medium4/13/2026
@composio/cli@0.2.23-beta.200**Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.23-beta.199...@composio/cli@0.2.23-beta.200Medium4/13/2026
@composio/cli@0.2.23-beta.199## What's Changed * docs: bearer token connections & credential patching by @dhawal1 in https://github.com/ComposioHQ/composio/pull/3151 * docs: multi-account mode & connection aliases by @abir-taheer in https://github.com/ComposioHQ/composio/pull/3160 * docs: update toolkits, API spec, and meta tools data by @github-actions[bot] in https://github.com/ComposioHQ/composio/pull/3144 * docs: clarify bearer token self-managed OAuth responsibility by @zen-agent in https://github.com/ComposioHQ/composMedium4/11/2026
@composio/cli@0.2.22-beta.198## What's Changed * fix: add alias to ToolRouterAuthorizeFn type by @zen-agent in https://github.com/ComposioHQ/composio/pull/3167 * Release: update version by @haxzie in https://github.com/ComposioHQ/composio/pull/3168 **Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.21...@composio/cli@0.2.22-beta.198Medium4/10/2026
@composio/google@0.6.10### Patch Changes - Updated dependencies [670ecc9] - @composio/core@0.6.10 High4/10/2026
@composio/cloudflare@0.6.10### Patch Changes - Updated dependencies [670ecc9] - @composio/core@0.6.10 Medium4/10/2026
@composio/openai-agents@0.6.10### Patch Changes - Updated dependencies [670ecc9] - @composio/core@0.6.10 Medium4/10/2026
@composio/langchain@0.6.10### Patch Changes - Updated dependencies [670ecc9] - @composio/core@0.6.10 Medium4/10/2026
@composio/openai@0.6.10### Patch Changes - Updated dependencies [670ecc9] - @composio/core@0.6.10 Medium4/10/2026
@composio/vercel@0.6.10### Patch Changes - Updated dependencies [670ecc9] - @composio/core@0.6.10 Medium4/10/2026
@composio/anthropic@0.6.10### Patch Changes - Updated dependencies [670ecc9] - @composio/core@0.6.10 Medium4/10/2026
@composio/claude-agent-sdk@0.6.10### Patch Changes - Updated dependencies [670ecc9] - @composio/core@0.6.10 Medium4/10/2026
@composio/mastra@0.6.10### Patch Changes - Updated dependencies [670ecc9] - @composio/core@0.6.10 Medium4/10/2026
@composio/llamaindex@0.6.10### Patch Changes - Updated dependencies [670ecc9] - @composio/core@0.6.10 Medium4/10/2026
@composio/core@0.6.10### Patch Changes - 670ecc9: Add missing `alias` option to `ToolRouterAuthorizeFn` type. The `ToolRouterSession.authorize()` implementation already accepted `alias`, but the exported type didn't include it, causing type errors when passing `{ alias: 'work-gmail' }` to `session.authorize()`. Medium4/10/2026
@composio/cli@0.2.21-beta.197## What's Changed * fix(core): add connection param to connectedAccounts.update() by @dhawal1 in https://github.com/ComposioHQ/composio/pull/3161 * chore: @composio/core patch release by @dhawal1 in https://github.com/ComposioHQ/composio/pull/3164 * chore(py): bump sdk packages to 0.11.5 by @dhawal1 in https://github.com/ComposioHQ/composio/pull/3165 * Release: update version by @haxzie in https://github.com/ComposioHQ/composio/pull/3166 **Full Changelog**: https://github.com/ComposioHQ/composMedium4/10/2026
@composio/langchain@0.6.9### Patch Changes - Updated dependencies [5b5723a] - @composio/core@0.6.9 Medium4/10/2026
@composio/claude-agent-sdk@0.6.9### Patch Changes - Updated dependencies [5b5723a] - @composio/core@0.6.9 Medium4/10/2026
@composio/openai@0.6.9### Patch Changes - Updated dependencies [5b5723a] - @composio/core@0.6.9 Medium4/10/2026
@composio/openai-agents@0.6.9### Patch Changes - Updated dependencies [5b5723a] - @composio/core@0.6.9 Medium4/10/2026
@composio/core@0.6.9### Patch Changes - 5b5723a: release Medium4/10/2026
@composio/llamaindex@0.6.9### Patch Changes - Updated dependencies [5b5723a] - @composio/core@0.6.9 Medium4/10/2026
@composio/cloudflare@0.6.9### Patch Changes - Updated dependencies [5b5723a] - @composio/core@0.6.9 Medium4/10/2026
@composio/google@0.6.9### Patch Changes - Updated dependencies [5b5723a] - @composio/core@0.6.9 Medium4/10/2026
@composio/mastra@0.6.9### Patch Changes - Updated dependencies [5b5723a] - @composio/core@0.6.9 Medium4/10/2026
@composio/anthropic@0.6.9### Patch Changes - Updated dependencies [5b5723a] - @composio/core@0.6.9 Medium4/10/2026
@composio/vercel@0.6.9### Patch Changes - Updated dependencies [5b5723a] - @composio/core@0.6.9 Medium4/10/2026
@composio/cli@0.2.21-beta.196## What's Changed * Fix nested tools subcommand mismatch handling by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3157 **Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.21-beta.195...@composio/cli@0.2.21-beta.196Medium4/10/2026
@composio/cli@0.2.21-beta.195## What's Changed * Add root skill-install flag for Claude, Codex, and OpenClaw by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3137 **Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.21-beta.194...@composio/cli@0.2.21-beta.195Medium4/10/2026
@composio/cli@0.2.21-beta.194## What's Changed * feat: enable support for multi-account by @abir-taheer in https://github.com/ComposioHQ/composio/pull/3141 * feat(cli): add composio config experimental command by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3156 **Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.20...@composio/cli@0.2.21-beta.194Medium4/10/2026
@composio/cli@0.2.20## What's Changed * chore: CLI 0.2.20 patch release changeset by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3120 * Release: update version by @haxzie in https://github.com/ComposioHQ/composio/pull/3138 **Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.20-beta.191...@composio/cli@0.2.20Medium4/9/2026
@composio/cli@0.2.20-beta.192## What's Changed * chore: CLI 0.2.20 patch release changeset by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3120 * Release: update version by @haxzie in https://github.com/ComposioHQ/composio/pull/3138 **Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.20-beta.191...@composio/cli@0.2.20-beta.192Medium4/8/2026
@composio/cli@0.2.20-beta.191## What's Changed * docs: update toolkits, API spec, and meta tools data by @github-actions[bot] in https://github.com/ComposioHQ/composio/pull/3135 * Add direct user API key login to the CLI by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3132 **Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.20-beta.190...@composio/cli@0.2.20-beta.191Medium4/8/2026
@composio/cli@0.2.20-beta.190## What's Changed * Add channel-aware Composio CLI skill builds by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3127 * [codex] Deduplicate CLI skill release channel helpers by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3131 * Add multi-account selection and experimental CLI feature flags by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3129 * fix: decouple skill build scripts from @composio/core by @CryogenicPlanet in https://github.com/CMedium4/7/2026
@composio/cli@0.2.20-beta.186## What's Changed * Support listening to top-level composio events by @CryogenicPlanet in https://github.com/ComposioHQ/composio/pull/3125 **Full Changelog**: https://github.com/ComposioHQ/composio/compare/@composio/cli@0.2.20-beta.185...@composio/cli@0.2.20-beta.186Medium4/7/2026
@composio/vercel@0.6.8### Patch Changes - Updated dependencies [2b19ae9] - @composio/core@0.6.8 High4/2/2026

Dependencies & License Audit

Loading dependencies...

Similar Packages

mcp-verified-repo-memoryProvide reliable, repository-scoped memory for AI coding agents with code citations, just-in-time verification, and stale-proof data management.main@2026-06-02
openclaw-codex-agentImplement a contract-first dev workflow that plans, runs, verifies, and fixes code tasks for reproducible, auditable, and verifiable development.main@2026-06-04
Autonomous-AgentsAutonomous Agents (LLMs) research papers. Updated Daily.main@2026-06-03
adk-jsAn open-source, code-first Typescript toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.devtools-v1.2.0
toolhive-studioToolHive is an application that allows you to install, manage and run MCP servers and connect them to AI agentsv0.36.0

More in MCP Servers

AstrBotAgentic IM Chatbot infrastructure that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. โœจ
agentscopeBuild and run agents you can see, understand and trust.
claude-plugins-officialOfficial, Anthropic-managed directory of high quality Claude Code Plugins.
langchain4jLangChain4j is an open-source Java library that simplifies the integration of LLMs into Java applications through a unified API, providing access to popular LLMs and vector databases. It makes impleme