The Tool Hunt

Library / AI Agents / aisix

api7 logo

aisix

AgentFREE

Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.

api7/aisix · Apache-2.0 · Rust · updated 2 days ago

Website ↗Open on GitHub ↗

Get the code

$git clone https://github.com/api7/aisix.git

207

GitHub stars

—

New stars this week

46

Forks

A · A · A

License · Quality · Upkeep

77/100

Radar score

What it helps you do

Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.

ai-agentsai-gatewayanthropicbedrockgatewaygeminiguardrailsinference-gatewayllmllm-gatewayllm-proxyllm-router

Should you use it?

License · A

Permissive license. Free for personal and business use.

Quality · A

Clear README, topics, license and an active community.

Maintenance · A

Updated in the last 30 days.

Job area: Coding & DevOps. Always read the project README before you install, and test on a copy of your data first.

How to start

  1. 1Open the project on GitHub and read the README.
  2. 2Run: git clone https://github.com/api7/aisix.git
  3. 3Follow the setup steps in the README.
  4. 4Test with a small task before real work.