Skip to content

The Toolchain

The ultimate directory of tools, databases, orchestration layers, and infrastructure required to build modern AI applications.

Framework

Vercel AI SDK

The AI Toolkit for React, Svelte, and Vue. Build AI-powered applications with streaming text and UI.

Open Source / Free
Orchestration

LangChain

Building applications with LLMs through composability. Connect models to your own data sources.

Open Source
Vector DB

Pinecone

The vector database for building AI applications. Fast, scalable, and easy to use.

Freemium
Infrastructure

Ollama

Get up and running with large language models locally. Run Llama 3, Phi 3, and more.

Open Source
Vector DB

Supabase Vector

Postgres with pgvector. Store embeddings and perform vector similarity search.

Freemium
Cloud

Hugging Face Inference

Deploy models as production-ready APIs with a few clicks.

Pay-as-you-go
Orchestration

LlamaIndex

Data framework for your LLM application. Connect custom data sources to LLMs.

Open Source
Cloud

Replicate

Run AI models with an API. Run open-source models with one line of code.

Pay-as-you-go
Infrastructure

vLLM

High-throughput and memory-efficient LLM serving engine.

Open Source
Vector DB

Weaviate

AI-native open source vector database. Built to scale seamlessly.

Open Source / Cloud
Cloud

Together AI

Fastest cloud platform for building and running generative AI.

Pay-as-you-go
Vector DB

Milvus

Open-source vector database built to power embedding similarity search and AI applications.

Open Source
Framework

DSPy

Framework for programming—not prompting—foundation models.

Open Source
Framework

Gradio

Build and share delightful machine learning apps, all in Python.

Open Source
Infrastructure

Modal

Run custom Python code and AI models in the cloud in seconds.

Freemium
Vector DB

Qdrant

Vector similarity search engine and vector database.

Open Source / Cloud
Cloud

Baseten

Fast, scalable, and secure infrastructure for ML models.

Pay-as-you-go
Vector DB

Chroma

The AI-native open-source embedding database.

Open Source
Infrastructure

LM Studio

Discover, download, and run local LLMs on your machine.

Free
Orchestration

LiteLLM

Call all LLM APIs using the OpenAI format. Bedrock, Azure, OpenAI, Cohere, Anthropic.

Open Source
Framework

Streamlit

A faster way to build and share data apps. Turn Python scripts into interactive web apps.

Open Source / Cloud
Infrastructure

Weights & Biases

The developer-first MLOps platform. Build better models faster with experiment tracking.

Freemium
Cloud

Anyscale

The Ray-based platform to build, deploy, and manage scalable AI and Python applications.

Pay-as-you-go
Orchestration

Haystack

An open source framework for building NLP pipelines with LLMs, Transformer models, and vector databases.

Open Source
Vector DB

Neo4j

Graph database that integrates with vector search to build advanced RAG applications.

Open Source / Freemium
Cloud

RunPod

Rent cloud GPUs for AI workloads. Scale serverless GPU inference globally.

Pay-as-you-go
Framework

Semantic Kernel

Microsoft's open-source SDK for integrating LLMs into C#, Python, and Java applications.

Open Source
Infrastructure

ExLlamaV2

Fast inference library for running local LLMs on modern consumer GPUs.

Open Source
Guides

OpenAI Cookbook

Example code and guides for accomplishing common tasks with the OpenAI API.

Free
Orchestration

Flowise

Drag & drop UI to build your customized LLM flow using LangchainJS.

Open Source