Провайдеры

52 провайдера инференса и их предложения

Этот материал пока доступен на английском языке.

01.AI

Активен

Chinese AI company founded by Kai-Fu Lee, developing the Yi family of large language models. Offers Yi-Lightning and other models through their API platform with strong performance in Chinese, math, and coding tasks.

https://api.lingyiwanwu.com/v1
bearer
us-east-1global
Совместимость: openai

AI21 Labs

Активен

Israeli AI company specializing in enterprise LLMs with their unique hybrid SSM-Transformer Jamba architecture. Offers models with 256K context windows optimized for grounding, instruction-following, and long-context enterprise tasks.

https://api.ai21.com/studio/v1
bearer
us-east-1global
Совместимость: custom

Alibaba Model Studio

Активен

Alibaba Cloud AI platform providing access to Qwen family models and other large language models through DashScope API, offering OpenAI-compatible endpoints with multi-region availability.

https://dashscope-intl.aliyuncs.com/compatible-mode/v1
api-key
ap-east-1us-east-1eu-west-1
Совместимость: openai

Amazon Bedrock

Активен

Fully managed AWS service offering foundation models from leading AI companies including Anthropic, Meta, and Mistral through a unified API. Supports OpenAI-compatible endpoints via Mantle inference engine with cross-region inference capabilities.

https://bedrock-runtime.us-east-1.amazonaws.com
bearer
us-east-1us-west-2eu-west-1ap-southeast-1
Совместимость: openai

Anthropic

Активен

AI safety company providing API access to the Claude family of models, known for helpfulness, harmlessness, and honesty with strong reasoning and analysis capabilities.

https://api.anthropic.com/v1
api-key
us-east-1eu-west-1
Совместимость: anthropic

Anyscale

Активен

Serverless inference platform built on Ray, offering high-throughput access to popular open-weight models. OpenAI-compatible API with competitive pricing and enterprise-grade scalability.

https://api.endpoints.anyscale.com/v1
bearer
us-east-1us-west-2
Совместимость: openai

Azure AI

Активен

Microsoft's cloud AI platform providing access to OpenAI models, open-source models, and enterprise AI services through Azure AI Studio. Offers global deployment with enterprise-grade security and compliance.

https://models.inference.ai.azure.com
api-key
us-east-1us-west-2eu-west-1ap-southeast-1
Совместимость: openai

Baseten

Активен

ML infrastructure platform for deploying and serving machine learning models at scale, offering managed GPU inference with auto-scaling and OpenAI-compatible API endpoints for popular LLMs.

https://bridge.baseten.co/v1
api-key
us-east-1us-west-2
Совместимость: openai

Cerebras

Активен

Ultra-fast inference provider powered by the Cerebras Wafer Scale Engine, known for extremely high tokens/sec throughput. Offers OpenAI-compatible API with free tier access.

https://api.cerebras.ai/v1
api-key
us-east-1
Совместимость: openai

Cloudflare Workers AI

Активен

Serverless AI inference platform running on Cloudflare's global edge network. Offers 10,000 neurons/day free allocation with OpenAI-compatible API and wide model selection including vision models.

https://api.cloudflare.com/client/v4/accounts
api-key
us-east-1eu-west-1global
Совместимость: openai

Cohere

Активен

Enterprise AI platform specializing in language models for business applications including RAG, search, and text generation. Offers Command and Embed model families with strong multilingual support.

https://api.cohere.com/v2
bearer
us-east-1eu-west-1global
Совместимость: cohere

Deep Infra

Активен

Serverless inference platform offering fast and cost-effective access to popular open-weight models. OpenAI-compatible API with pay-per-token pricing and no minimum commitments.

https://api.deepinfra.com/v1/openai
bearer
us-east-1eu-west-1
Совместимость: openai

DeepSeek

Активен

Chinese AI research company providing direct API access to their DeepSeek family of models with competitive pricing and strong performance on coding and reasoning tasks.

https://api.deepseek.com/v1
bearer
us-east-1global
Совместимость: openai

Featherless

Активен

Serverless LLM inference platform hosting 20,000+ open-source models from Hugging Face with flat-rate subscription pricing and unlimited token usage. OpenAI-compatible API with no per-token billing — access any model up to a given size based on subscription tier. Largest Hugging Face inference provider by model count.

https://api.featherless.ai/v1
bearer
global
Совместимость: openai

Fireworks

Активен

High-speed AI inference platform optimized for low-latency serving of open-source models, offering OpenAI-compatible API endpoints with custom model deployment and fine-tuning capabilities.

https://api.fireworks.ai/inference/v1
api-key
us-east-1us-west-2
Совместимость: openai

Google AI Studio

Активен

Google's developer platform for accessing Gemini and Gemma models via OpenAI-compatible API. Free tier available with generous rate limits. Data may be used for training outside EU/EEA/UK/CH regions.

https://generativelanguage.googleapis.com/v1beta/openai
api-key
us-east-1eu-west-1global
Совместимость: openai

Google Cloud Vertex AI

Активен

Google Cloud's enterprise AI platform providing access to Gemini models with enterprise-grade security, compliance, and global infrastructure. Supports streaming, function calling, and multimodal inputs.

https://generativelanguage.googleapis.com/v1
oauth2
us-east-1us-west-2eu-west-1global
Совместимость: google

Groq

Активен

Ultra-fast LPU (Language Processing Unit) inference provider offering extremely low latency. Supports streaming, function calling, and audio transcription via Whisper models. Per-model rate limits apply.

https://api.groq.com/openai/v1
bearer
us-east-1eu-west-1
Совместимость: openai

Hugging Face Inference

Активен

Inference API and dedicated endpoints for open-source models hosted on the Hugging Face Hub. Offers serverless inference for popular models and dedicated GPU endpoints for production workloads.

https://router.huggingface.co/hf-inference/v1
bearer
us-east-1eu-west-1
Совместимость: openai

Hyperbolic

Активен

Decentralized AI compute platform offering affordable GPU inference for open-source models, providing OpenAI-compatible API endpoints with competitive pricing and global availability.

https://api.hyperbolic.xyz/v1
api-key
us-west-2
Совместимость: openai

IBM watsonx.ai

Активен

IBM's enterprise AI platform providing access to Granite foundation models and third-party models via a REST API. Supports text generation, embeddings, and fine-tuning with regional deployments across IBM Cloud.

https://us-south.ml.cloud.ibm.com/ml/v1
bearer
us-south-1eu-de-1eu-gb-1
Совместимость: custom

InclusionAI

Активен

Ant Group's AI research lab focused on open-source large language models. Offers inference via ZenMux platform with OpenAI-compatible API. Develops the Ling (non-thinking) and Ring (reasoning) model families at trillion-parameter scale.

https://zenmux.ai/api/v1
bearer
cn-east-1global
Совместимость: openai

Inference.net

Активен

Distributed AI inference network providing affordable access to open-source language models through a decentralized GPU marketplace, offering OpenAI-compatible API endpoints with competitive per-token pricing.

https://api.inference.net/v1
api-key
us-east-1eu-west-1
Совместимость: openai

Lambda

Активен

GPU cloud and inference provider offering on-demand access to NVIDIA GPUs for AI training and inference. Provides both cloud instances and managed inference API for open-source LLMs with competitive pricing.

https://api.lambda.chat/v1
bearer
us-east-1us-west-2
Совместимость: openai

Meta AI

Активен

Meta's AI research division providing the open-weight Llama family of models. Models are available through various inference providers and can be self-hosted.

https://www.meta.ai/api
none
global
Совместимость: custom

MiniMax

Активен

Chinese AI company providing large language models with strong multilingual and multimodal capabilities. Known for competitive pricing and high-quality text generation.

https://api.minimax.chat/v1
api-key
us-east-1global
Совместимость: openai

Mistral AI

Активен

European AI company providing high-performance language models with strong multilingual capabilities. Offers both open-weight and proprietary models through an OpenAI-compatible API.

https://api.mistral.ai/v1
bearer
eu-west-1us-east-1global
Совместимость: openai

Modal

Активен

Serverless cloud platform for running AI workloads with on-demand GPU access, offering custom model deployment and OpenAI-compatible inference endpoints with automatic scaling and pay-per-second pricing.

https://api.modal.com/v1
bearer
us-east-1us-west-2
Совместимость: openai

Moonshot AI

Активен

Chinese AI company behind the Kimi series of models, known for ultra-long context windows and strong reasoning capabilities. Offers OpenAI-compatible API access.

https://api.moonshot.ai/v1
api-key
us-east-1global
Совместимость: openai

Nebius

Активен

Cloud AI platform providing scalable GPU infrastructure and managed inference services for large language models, with data centers in Europe and competitive pricing for open-source model hosting.

https://api.studio.nebius.ai/v1
api-key
eu-west-1
Совместимость: openai

NLP Cloud

Активен

Production-ready AI inference API offering managed deployment of open-source and proprietary language models with dedicated GPU instances, providing high availability and data privacy compliance.

https://api.nlpcloud.io/v1
bearer
us-east-1eu-west-1
Совместимость: custom

Novita

Активен

AI model inference platform providing affordable access to open-source language models with OpenAI-compatible API endpoints, offering pay-per-token pricing and global availability.

https://api.novita.ai/v3/openai
api-key
us-east-1
Совместимость: openai

NVIDIA NIM

Активен

NVIDIA's inference microservice platform providing optimized deployment of LLMs on GPU infrastructure. Offers free endpoints for select models and partner endpoints through Deep Infra, Together AI, Bitdeer, GMI Cloud, and CoreWeave.

https://integrate.api.nvidia.com/v1
api-key
us-east-1us-west-2global
Совместимость: openai

OpenAI

Активен

Leading AI research company providing API access to GPT-4, GPT-3.5, DALL-E, and other foundation models through a developer-friendly REST API with global availability.

https://api.openai.com/v1
bearer
us-east-1eu-west-1
Совместимость: openai

OpenRouter

Активен

Unified API gateway providing access to hundreds of models from multiple providers through a single OpenAI-compatible endpoint. Free models available with shared quota, up to 1000 requests/day.

https://openrouter.ai/api/v1
api-key
us-east-1
Совместимость: openai

Perplexity

Активен

AI-powered answer engine offering API access to proprietary and open-source models with built-in web search grounding. Specializes in providing accurate, cited responses with real-time information access.

https://api.perplexity.ai
bearer
us-east-1us-west-2
Совместимость: openai

Reka AI

Активен

AI research company building multimodal language models that process text, images, video, and audio in a single model. Offers Flash (21B) and Edge (7B) models optimized for reasoning, coding, and physical AI applications.

https://api.reka.ai/v1
api-key
us-east-1global
Совместимость: custom

Replicate

Активен

Cloud platform for running open-source AI models with a simple API. Hosts over 1000 community models with serverless GPU inference, pay-per-second pricing, and no infrastructure management required.

https://api.replicate.com/v1
bearer
us-east-1us-west-2
Совместимость: custom

Sakana AI

Активен

Tokyo-based AI research lab building nature-inspired and evolutionary approaches to foundation models. Provides the Fugu family of multi-agent orchestration models through a single OpenAI-compatible API that coordinates a pool of specialist LLMs behind one endpoint, available via pay-as-you-go and subscription plans.

https://api.sakana.ai/v1
api-key
ap-northeast-1global
Совместимость: openai

SambaNova

Активен

AI hardware and software platform offering high-performance inference services powered by custom DataScale systems, providing OpenAI-compatible API endpoints for open-source models with industry-leading throughput.

https://api.sambanova.ai/v1
api-key
us-west-2
Совместимость: openai

Sarvam AI

Активен

Indian AI company building sovereign language models and a full-stack GenAI platform optimized for Indian languages. Provides an OpenAI-compatible API for the Sarvam model family (Sarvam-M, Sarvam-1, Sarvam-30B, Sarvam-105B) along with speech and translation services, hosted on India-based infrastructure.

https://api.sarvam.ai/v1
api-key
ap-south-1
Совместимость: openai

Sber

Активен

Russian banking and technology conglomerate providing access to GigaChat family of language models through a dedicated API. Offers models ranging from compact Lightning to flagship Ultra with strong multilingual and reasoning capabilities.

https://gigachat.devices.sberbank.ru/api/v1
oauth2
ru-central-1
Совместимость: custom

Scaleway

Активен

European cloud provider offering managed AI inference endpoints with GPU instances across European data centers, providing OpenAI-compatible API access to popular open-source models.

https://api.scaleway.ai/v1
api-key
eu-west-1
Совместимость: openai

SiliconFlow

Активен

High-performance AI inference platform offering ultra-low latency and cost-effective access to open-source models. Supports models with up to 1M token context windows and OpenAI-compatible API endpoints.

https://api.siliconflow.cn/v1
bearer
ap-east-1us-west-2global
Совместимость: openai

Snowflake Cortex AI

Активен

Snowflake's managed AI service providing access to Arctic family models and other LLMs through Cortex AI. Integrated with Snowflake's data platform for enterprise SQL generation, document understanding, and AI-powered analytics.

https://api.snowflake.com/v1
oauth2
us-east-1us-west-2eu-west-1
Совместимость: custom

Tinker

Активен

Thinking Machines Lab's cloud service for fine-tuning and inference. Its OpenAI-compatible inference API is currently in beta and intended for testing, evaluation, and internal workflows; production-grade inference is not yet generally available.

https://tinker.thinkingmachines.dev/services/tinker-prod/oai/api/v1
api-key
global
Совместимость: openai

Together AI

Активен

Cloud platform for running and fine-tuning open-source AI models, offering competitive pricing and OpenAI-compatible API endpoints for popular open-weight models.

https://api.together.xyz/v1
bearer
us-east-1us-west-2
Совместимость: openai

Upstage

Активен

South Korean AI company providing enterprise-grade language models optimized for Korean, English, and Japanese. Offers the Solar model family through a direct API with competitive pricing and high throughput.

https://api.upstage.ai/v1/solar
api-key
global
Совместимость: openai

xAI

Активен

AI company founded by Elon Musk providing the Grok family of models. Known for real-time information access and strong reasoning capabilities with OpenAI-compatible API.

https://api.x.ai/v1
bearer
us-east-1global
Совместимость: openai

Xiaomi MiMo

Активен

Xiaomi's AI inference platform providing access to the MiMo family of models via an OpenAI-compatible API endpoint. Offers flagship agentic and multimodal models with competitive pricing.

https://mimo.xiaomi.com/api/v1
api-key
global
Совместимость: openai