Supported Models

ModelDescriptionContext LengthPricing
Meta: LLaMA v3 8B Instruct

Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 8B instruct-tuned version was optimized for high quality dialogue usecases.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.

8.2K
$0.1000 / 1M input tokens
$0.1000/ 1M output tokens
$0.0000 /K input images
OpenAI: GPT-3.5 Turbo 16k

The latest GPT-3.5 Turbo model with improved instruction following, JSON mode, reproducible outputs, parallel function calling, and more. Training data: up to Sep 2021.

This version has a higher accuracy at responding in requested formats and a fix for a bug which caused a text encoding issue for non-English language function calls.

16.4K
$0.5000 / 1M input tokens
$1.5000/ 1M output tokens
$0.0000 /K input images
OpenAI: GPT-4 Turbo

The latest GPT-4 Turbo model with vision capabilities. Vision requests can now use JSON mode and function calling. Training data: up to Dec 2023.

This model is updated by OpenAI to point to the latest version of GPT-4 Turbo, currently gpt-4-turbo-2024-04-09 (as of April 2024).

128K
$10.0000 / 1M input tokens
$30.0000/ 1M output tokens
$0.0000 /K input images
Google: Gemini Pro 1.5 (preview)

Google's latest multimodal model, supporting image and video in text or chat prompts.

Optimized for language tasks including:

  • Code generation
  • Text generation
  • Text editing
  • Problem solving
  • Recommendations
  • Information extraction
  • Data extraction or generation
  • AI agents

Usage of Gemini is subject to Google's Gemini Terms of Use.

Note: Preview models are offered for testing purposes and should not be used in production apps. This model is heavily rate limited.

#multimodal

2.8M
$2.5000 / 1M input tokens
$7.5000/ 1M output tokens
$2.6500 /K input images
Anthropic: Claude 3 Sonnet

Claude 3 Sonnet is an ideal balance of intelligence and speed for enterprise workloads. Maximum utility at a lower price, dependable, balanced for scaled deployments.

See the launch announcement and benchmark results here

#multimodal

200K
$3.0000 / 1M input tokens
$15.0000/ 1M output tokens
$4.8000 /K input images
Anthropic: Claude 3 Haiku

Claude 3 Haiku is Anthropic's fastest and most compact model for near-instant responsiveness. Quick and accurate targeted performance.

See the launch announcement and benchmark results here

#multimodal

200K
$0.2500 / 1M input tokens
$1.2500/ 1M output tokens
$0.4000 /K input images
Anthropic: Claude 3 Opus

Claude 3 Opus is Anthropic's most powerful model for highly complex tasks. It boasts top-level performance, intelligence, fluency, and understanding.

See the launch announcement and benchmark results here

#multimodal

200K
$15.0000 / 1M input tokens
$75.0000/ 1M output tokens
$24.0000 /K input images
Meta: LLaMA v3 70B Instruct

Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 70B instruct-tuned version was optimized for high quality dialogue usecases.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.

8.2K
$0.9000 / 1M input tokens
$0.9000/ 1M output tokens
$0.0000 /K input images
Cohere: Command R+

Command R+ is a new, 104B-parameter LLM from Cohere. It's useful for roleplay, general consumer usecases, and Retrieval Augmented Generation (RAG).

It offers multilingual support for ten key languages to facilitate global business operations. See benchmarks and the launch post here.

Use of this model is subject to Cohere's Acceptable Use Policy.

128K
$3.0000 / 1M input tokens
$15.0000/ 1M output tokens
$0.0000 /K input images
Databricks: DBRX 132B Instruct

DBRX is a new open source large language model developed by Databricks. At 132B, it outperforms existing open source LLMs like Llama 2 70B and Mixtral-8x7B on standard industry benchmarks for language understanding, programming, math, and logic.

It uses a fine-grained mixture-of-experts (MoE) architecture. 36B parameters are active on any input. It was pre-trained on 12T tokens of text and code data. Compared to other open MoE models like Mixtral-8x7B and Grok-1, DBRX is fine-grained, meaning it uses a larger number of smaller experts.

See the launch announcement and benchmark results here.

#moe

32.8K
$0.6000 / 1M input tokens
$0.6000/ 1M output tokens
$0.0000 /K input images
Cohere: Command R

Command-R is a 35B parameter model that performs conversational language tasks at a higher quality, more reliably, and with a longer context than previous models. It can be used for complex workflows like code generation, retrieval augmented generation (RAG), tool use, and agents.

Read the launch post here.

Use of this model is subject to Cohere's Acceptable Use Policy.

128K
$0.5000 / 1M input tokens
$1.5000/ 1M output tokens
$0.0000 /K input images
Noromaid Mixtral 8x7B Instruct

This model was trained for 8h(v1) + 8h(v2) + 12h(v3) on customized modified datasets, focusing on RP, uncensoring, and a modified version of the Alpaca prompting (that was already used in LimaRP), which should be at the same conversational level as ChatLM or Llama2-Chat without adding any additional special tokens.

8K
$8.0000 / 1M input tokens
$8.0000/ 1M output tokens
$0.0000 /K input images
Goliath 120B

A large LLM created by combining two fine-tuned Llama 70B models into one 120B model. Combines Xwin and Euryale.

Credits to

#merge

6.1K
$9.3750 / 1M input tokens
$9.3750/ 1M output tokens
$0.0000 /K input images
Nous: Hermes 2 Vision 7B (alpha)

This vision-language model builds on innovations from the popular OpenHermes-2.5 model, by Teknium. It adds vision support, and is trained on a custom dataset enriched with function calling

This project is led by qnguyen3 and teknium.

#multimodal

4.1K
$5.0000 / 1M input tokens
$5.0000/ 1M output tokens
$0.0000 /K input images
Meta: Llama v2 13B Chat

A 13 billion parameter language model from Meta, fine tuned for chat completions

4.1K
$0.1206 / 1M input tokens
$0.1206/ 1M output tokens
$0.0000 /K input images
Noromaid 20B

A collab between IkariDev and Undi. This merge is suitable for RP, ERP, and general knowledge.

#merge #uncensored

8.2K
$2.2500 / 1M input tokens
$2.2500/ 1M output tokens
$0.0000 /K input images
Synthia 70B

SynthIA (Synthetic Intelligent Agent) is a LLama-2 70B model trained on Orca style datasets. It has been fine-tuned for instruction following as well as having long-form conversations.

8.2K
$3.7500 / 1M input tokens
$3.7500/ 1M output tokens
$0.0000 /K input images
MythoMist 7B

From the creator of MythoMax, merges a suite of models to reduce word anticipation, ministrations, and other undesirable words in ChatGPT roleplaying data.

It combines Neural Chat 7B, Airoboros 7b, Toppy M 7B, Zepher 7b beta, Nous Capybara 34B, OpenHeremes 2.5, and many others.

#merge

32.8K
$0.3750 / 1M input tokens
$0.3750/ 1M output tokens
$0.0000 /K input images
Mancer: Weaver (alpha)

An attempt to recreate Claude-style verbosity, but don't expect the same level of coherence or memory. Meant for use in roleplay/narrative situations.

8K
$3.3750 / 1M input tokens
$3.3750/ 1M output tokens
$0.0000 /K input images
MythoMax 13B

One of the highest performing and most popular fine-tunes of Llama 2 13B, with rich descriptions and roleplay. #merge

4.1K
$0.1800 / 1M input tokens
$0.1800/ 1M output tokens
$0.0000 /K input images
MythoMax 13B (extended)

One of the highest performing and most popular fine-tunes of Llama 2 13B, with rich descriptions and roleplay. #merge

Note: this is an extended-context version of this model. It may have higher prices and different outputs.

8.2K
$0.3000 / 1M input tokens
$0.3000/ 1M output tokens
$0.0000 /K input images
Nous: Capybara 7B

The Capybara series is a collection of datasets and models made by fine-tuning on data created by Nous, mostly in-house.

V1.9 uses unalignment techniques for more consistent and dynamic control. It also leverages a significantly better foundation model, Mistral 7B.

4.1K
$0.1800 / 1M input tokens
$0.1800/ 1M output tokens
$0.0000 /K input images
Cinematika 7B (alpha)

This model is under development. Check the OpenRouter Discord for updates.

8K
$0.1800 / 1M input tokens
$0.1800/ 1M output tokens
$0.0000 /K input images
Meta: CodeLlama 70B Instruct

Code Llama is a family of large language models for code. This one is based on Llama 2 70B and provides zero-shot instruction-following ability for programming tasks.

2K
$0.8100 / 1M input tokens
$0.8100/ 1M output tokens
$0.0000 /K input images
OpenHermes 2 Mistral 7B

Trained on 900k instructions, surpasses all previous versions of Hermes 13B and below, and matches 70B on some benchmarks. Hermes 2 has strong multiturn chat skills and system prompt capabilities.

4.1K
$0.1800 / 1M input tokens
$0.1800/ 1M output tokens
$0.0000 /K input images
OpenHermes 2.5 Mistral 7B

A continuation of OpenHermes 2 model, trained on additional code datasets. Potentially the most interesting finding from training on a good ratio (est. of around 7-14% of the total dataset) of code instruction was that it has boosted several non-code benchmarks, including TruthfulQA, AGIEval, and GPT4All suite. It did however reduce BigBench benchmark score, but the net gain overall is significant.

4.1K
$0.1800 / 1M input tokens
$0.1800/ 1M output tokens
$0.0000 /K input images
Yi 34B Chat

The Yi series models are large language models trained from scratch by developers at 01.AI. This version is instruct-tuned to work better for chat.

4.1K
$0.7200 / 1M input tokens
$0.7200/ 1M output tokens
$0.0000 /K input images
Yi 34B (base)

The Yi series models are large language models trained from scratch by developers at 01.AI.

4.1K
$0.7200 / 1M input tokens
$0.7200/ 1M output tokens
$0.0000 /K input images
Yi 6B (base)

The Yi series models are large language models trained from scratch by developers at 01.AI.

4.1K
$0.1260 / 1M input tokens
$0.1260/ 1M output tokens
$0.0000 /K input images
Mixtral 8x7B (base)

A pretrained generative Sparse Mixture of Experts, by Mistral AI. Incorporates 8 experts (feed-forward networks) for a total of 47B parameters. Base model (not fine-tuned for instructions) - see Mixtral 8x7B Instruct for an instruct-tuned model.

#moe

32.8K
$0.5400 / 1M input tokens
$0.5400/ 1M output tokens
$0.0000 /K input images
OpenAI: GPT-3.5 Turbo (older v0301)

GPT-3.5 Turbo is OpenAI's fastest model. It can understand and generate natural language or code, and is optimized for chat and traditional completion tasks.

Updated by OpenAI to point to the latest version of GPT-3.5. Training data up to Sep 2021.

4.1K
$1.0000 / 1M input tokens
$2.0000/ 1M output tokens
$0.0000 /K input images
OpenAI: GPT-3.5 Turbo 16k

This model offers four times the context length of gpt-3.5-turbo, allowing it to support approximately 20 pages of text in a single request at a higher cost. Training data: up to Sep 2021.

16.4K
$3.0000 / 1M input tokens
$4.0000/ 1M output tokens
$0.0000 /K input images
Nous: Hermes 2 Yi 34B

Nous Hermes 2 Yi 34B was trained on 1,000,000 entries of primarily GPT-4 generated data, as well as other high quality data from open datasets across the AI landscape.

Nous-Hermes 2 on Yi 34B outperforms all Nous-Hermes & Open-Hermes models of the past, achieving new heights in all benchmarks for a Nous Research LLM as well as surpassing many popular finetunes.

4.1K
$0.7200 / 1M input tokens
$0.7200/ 1M output tokens
$0.0000 /K input images
Nous: Hermes 2 Mistral 7B DPO

This is the flagship 7B Hermes model, a Direct Preference Optimization (DPO) of Teknium/OpenHermes-2.5-Mistral-7B. It shows improvement across the board on all benchmarks tested - AGIEval, BigBench Reasoning, GPT4All, and TruthfulQA.

The model prior to DPO was trained on 1,000,000 instructions/chats of GPT-4 quality or better, primarily synthetic data as well as other high quality datasets.

8.2K
$0.1800 / 1M input tokens
$0.1800/ 1M output tokens
$0.0000 /K input images
Mistral OpenOrca 7B

A fine-tune of Mistral using the OpenOrca dataset. First 7B model to beat all other models <30B.

8.2K
$0.1425 / 1M input tokens
$0.1425/ 1M output tokens
$0.0000 /K input images
OpenAI: GPT-3.5 Turbo

GPT-3.5 Turbo is OpenAI's fastest model. It can understand and generate natural language or code, and is optimized for chat and traditional completion tasks.

Updated by OpenAI to point to the latest version of GPT-3.5. Training data up to Sep 2021.

16.4K
$0.5000 / 1M input tokens
$1.5000/ 1M output tokens
$0.0000 /K input images
OpenAI: GPT-3.5 Turbo 16k (older v1106)

The latest GPT-3.5 Turbo model with improved instruction following, JSON mode, reproducible outputs, parallel function calling, and more. Training data: up to Sep 2021.

16.4K
$1.0000 / 1M input tokens
$2.0000/ 1M output tokens
$0.0000 /K input images
OpenAI: GPT-3.5 Turbo (older v0613)

GPT-3.5 Turbo is OpenAI's fastest model. It can understand and generate natural language or code, and is optimized for chat and traditional completion tasks.

Updated by OpenAI to point to the latest version of GPT-3.5. Training data up to Sep 2021.

4.1K
$1.0000 / 1M input tokens
$2.0000/ 1M output tokens
$0.0000 /K input images
OpenAI: GPT-4 Turbo (older v1106)

The latest GPT-4 model with improved instruction following, JSON mode, reproducible outputs, parallel function calling, and more. Training data: up to Apr 2023.

Note: heavily rate limited by OpenAI while in preview.

128K
$10.0000 / 1M input tokens
$30.0000/ 1M output tokens
$0.0000 /K input images
Hugging Face: Zephyr 7B

Zephyr is a series of language models that are trained to act as helpful assistants. Zephyr-7B-β is the second model in the series, and is a fine-tuned version of mistralai/Mistral-7B-v0.1 that was trained on a mix of publicly available, synthetic datasets using Direct Preference Optimization (DPO).

4.1K
$0.1425 / 1M input tokens
$0.1425/ 1M output tokens
$0.0000 /K input images
Google: PaLM 2 Code Chat

PaLM 2 fine-tuned for chatbot conversations that help with code-related questions.

20.1K
$0.2500 / 1M input tokens
$0.5000/ 1M output tokens
$0.0000 /K input images
Google: PaLM 2 Chat 32k

PaLM 2 is a language model by Google with improved multilingual, reasoning and coding capabilities.

91.8K
$0.2500 / 1M input tokens
$0.5000/ 1M output tokens
$0.0000 /K input images
Google: PaLM 2 Code Chat 32k

PaLM 2 fine-tuned for chatbot conversations that help with code-related questions.

91.8K
$0.2500 / 1M input tokens
$0.5000/ 1M output tokens
$0.0000 /K input images
Perplexity: PPLX 70B Online

The larger, internet-connected chat model by Perplexity Labs, based on Llama 2 70B. The online models are focused on delivering helpful, up-to-date, and factual responses. #online

4.1K
$1.0000 / 1M input tokens
$1.0000/ 1M output tokens
$0.0000 /K input images
$0.0050 / request
Perplexity: PPLX 7B Chat

The smaller chat model by Perplexity Labs, with 7 billion parameters. Based on Mistral 7B.

8.2K
$0.2000 / 1M input tokens
$0.2000/ 1M output tokens
$0.0000 /K input images
OpenAI: GPT-4

OpenAI's flagship model, GPT-4 is a large-scale multimodal language model capable of solving difficult problems with greater accuracy than previous models due to its broader general knowledge and advanced reasoning capabilities. Training data: up to Sep 2021.

8.2K
$30.0000 / 1M input tokens
$60.0000/ 1M output tokens
$0.0000 /K input images
OpenAI: GPT-4 (older v0314)

GPT-4-0314 is the first version of GPT-4 released, with a context length of 8,192 tokens, and was supported until June 14. Training data: up to Sep 2021.

8.2K
$30.0000 / 1M input tokens
$60.0000/ 1M output tokens
$0.0000 /K input images
OpenAI: GPT-4 32k

GPT-4-32k is an extended version of GPT-4, with the same capabilities but quadrupled context length, allowing for processing up to 40 pages of text in a single pass. This is particularly beneficial for handling longer content like interacting with PDFs without an external vector database. Training data: up to Sep 2021.

32.8K
$60.0000 / 1M input tokens
$120.0000/ 1M output tokens
$0.0000 /K input images
OpenAI: GPT-4 32k (older v0314)

GPT-4-32k is an extended version of GPT-4, with the same capabilities but quadrupled context length, allowing for processing up to 40 pages of text in a single pass. This is particularly beneficial for handling longer content like interacting with PDFs without an external vector database. Training data: up to Sep 2021.

32.8K
$60.0000 / 1M input tokens
$120.0000/ 1M output tokens
$0.0000 /K input images
OpenAI: GPT-3.5 Turbo Instruct

This model is a variant of GPT-3.5 Turbo tuned for instructional prompts and omitting chat-related optimizations. Training data: up to Sep 2021.

4.1K
$1.5000 / 1M input tokens
$2.0000/ 1M output tokens
$0.0000 /K input images
Google: PaLM 2 Chat

PaLM 2 is a language model by Google with improved multilingual, reasoning and coding capabilities.

25.8K
$0.2500 / 1M input tokens
$0.5000/ 1M output tokens
$0.0000 /K input images
Perplexity: PPLX 7B Online

The smaller, internet-connected chat model by Perplexity Labs, based on Mistral 7B. The online models are focused on delivering helpful, up-to-date, and factual responses. #online

4.1K
$0.2000 / 1M input tokens
$0.2000/ 1M output tokens
$0.0000 /K input images
$0.0050 / request
Perplexity: Sonar 8x7B Online

Sonar is Perplexity's latest model family. It surpasses their earlier models in cost-efficiency, speed, and performance.

This is the online version of Sonar 8x7B. It is focused on delivering helpful, up-to-date, and factual responses. #online

12K
$0.6000 / 1M input tokens
$0.6000/ 1M output tokens
$0.0000 /K input images
$0.0050 / request
Perplexity: PPLX 70B Chat

The larger chat model by Perplexity Labs, with 70 billion parameters. Based on Llama 2 70B.

4.1K
$1.0000 / 1M input tokens
$1.0000/ 1M output tokens
$0.0000 /K input images
Perplexity: Sonar 7B

Sonar is Perplexity's latest model family. It surpasses their earlier models in cost-efficiency, speed, and performance.

The version of this model with Internet access is Sonar 7B Online.

16.4K
$0.2000 / 1M input tokens
$0.2000/ 1M output tokens
$0.0000 /K input images
Anthropic: Claude 3 Haiku (self-moderated)

This is a lower-latency version of Claude 3 Haiku, made available in collaboration with Anthropic, that is self-moderated: response moderation happens on the model's side instead of OpenRouter's. It's in beta, and may change in the future.

Claude 3 Haiku is Anthropic's fastest and most compact model for near-instant responsiveness. Quick and accurate targeted performance.

See the launch announcement and benchmark results here

#multimodal

200K
$0.2500 / 1M input tokens
$1.2500/ 1M output tokens
$0.4000 /K input images
Perplexity: Sonar 8x7B

Sonar is Perplexity's latest model family. It surpasses their earlier models in cost-efficiency, speed, and performance.

The version of this model with Internet access is Sonar 8x7B Online.

16.4K
$0.6000 / 1M input tokens
$0.6000/ 1M output tokens
$0.0000 /K input images
Perplexity: Sonar 7B Online

Sonar is Perplexity's latest model family. It surpasses their earlier models in cost-efficiency, speed, and performance.

This is the online version of Sonar 7B. It is focused on delivering helpful, up-to-date, and factual responses. #online

12K
$0.2000 / 1M input tokens
$0.2000/ 1M output tokens
$0.0000 /K input images
$0.0050 / request
Dolphin 2.6 Mixtral 8x7B 🐬

This is a 16k context fine-tune of Mixtral-8x7b. It excels in coding tasks due to extensive training with coding data and is known for its obedience, although it lacks DPO tuning.

The model is uncensored and is stripped of alignment and bias. It requires an external alignment layer for ethical use. Users are cautioned to use this highly compliant model responsibly, as detailed in a blog post about uncensored models at erichartford.com/uncensored-models.

#moe #uncensored

32K
$0.5000 / 1M input tokens
$0.5000/ 1M output tokens
$0.0000 /K input images
Mixtral 8x7B Instruct

A pretrained generative Sparse Mixture of Experts, by Mistral AI, for chat and instruction use. Incorporates 8 experts (feed-forward networks) for a total of 47 billion parameters.

Instruct model fine-tuned by Mistral. #moe

32.8K
$0.2500 / 1M input tokens
$0.4167/ 1M output tokens
$0.0000 /K input images
Airoboros 70B

A Llama 2 70B fine-tune using synthetic data (the Airoboros dataset).

Currently based on jondurbin/airoboros-l2-70b-2.2.1, but might get updated in the future.

4.1K
$0.7000 / 1M input tokens
$0.9000/ 1M output tokens
$0.0000 /K input images
OpenChat 3.5

OpenChat is a library of open-source language models, fine-tuned with "C-RLFT (Conditioned Reinforcement Learning Fine-Tuning)" - a strategy inspired by offline reinforcement learning. It has been trained on mixed-quality data without preference labels.

8.2K
$0.1300 / 1M input tokens
$0.1300/ 1M output tokens
$0.0000 /K input images
lzlv 70B

A Mythomax/MLewd_13B-style merge of selected 70B models. A multi-model merge of several LLaMA2 70B finetunes for roleplaying and creative work. The goal was to create a model that combines creativity with intelligence for an enhanced experience.

#merge #uncensored

4.1K
$0.7000 / 1M input tokens
$0.9000/ 1M output tokens
$0.0000 /K input images
Meta: Llama v2 70B Chat

The flagship, 70 billion parameter language model from Meta, fine tuned for chat completions. Llama 2 is an auto-regressive language model that uses an optimized transformer architecture. The tuned versions use supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align to human preferences for helpfulness and safety.

4.1K
$0.6000 / 1M input tokens
$1.9000/ 1M output tokens
$0.0000 /K input images
Google: Gemini Pro Vision 1.0

Google's flagship multimodal model, supporting image and video in text or chat prompts for a text or code response.

See the benchmarks and prompting guidelines from Deepmind.

Usage of Gemini is subject to Google's Gemini Terms of Use.

#multimodal

45.9K
$0.1250 / 1M input tokens
$0.3750/ 1M output tokens
$2.5000 /K input images
Nous: Capybara 34B

This model is trained on the Yi-34B model for 3 epochs on the Capybara dataset. It's the first 34B Nous model and first 200K context length Nous model.

Note: This endpoint currently supports 32k context.

32.8K
$0.9000 / 1M input tokens
$0.9000/ 1M output tokens
$0.0000 /K input images
Chronos Hermes 13B v2

A 75/25 merge of Chronos 13b v2 and Nous Hermes Llama2 13b. This offers the imaginative writing style of Chronos while retaining coherency. Outputs are long and use exceptional prose. #merge

4.1K
$0.1800 / 1M input tokens
$0.1800/ 1M output tokens
$0.0000 /K input images
Google: Gemma 7B

Gemma by Google is an advanced, open-source language model family, leveraging the latest in decoder-only, text-to-text technology. It offers English language capabilities across text generation tasks like question answering, summarization, and reasoning. The Gemma 7B variant is comparable in performance to leading open source models.

Usage of Gemma is subject to Google's Gemma Terms of Use.

8.2K
$0.1000 / 1M input tokens
$0.1000/ 1M output tokens
$0.0000 /K input images
Anthropic: Claude v2

Claude 2.1 delivers advancements in key capabilities for enterprises—including an industry-leading 200K token context window, significant reductions in rates of model hallucination, system prompts and a new beta feature: tool use.

200K
$8.0000 / 1M input tokens
$24.0000/ 1M output tokens
$0.0000 /K input images
Anthropic: Claude v2.1

Claude 2.1 delivers advancements in key capabilities for enterprises—including an industry-leading 200K token context window, significant reductions in rates of model hallucination, system prompts and a new beta feature: tool use.

200K
$8.0000 / 1M input tokens
$24.0000/ 1M output tokens
$0.0000 /K input images
Anthropic: Claude v2.0

Anthropic's flagship model. Superior performance on tasks that require complex reasoning. Supports hundreds of pages of text.

100K
$8.0000 / 1M input tokens
$24.0000/ 1M output tokens
$0.0000 /K input images
Anthropic: Claude Instant v1

Anthropic's model for low-latency, high throughput text generation. Supports hundreds of pages of text.

100K
$0.8000 / 1M input tokens
$2.4000/ 1M output tokens
$0.0000 /K input images
Anthropic: Claude Instant v1.2

Anthropic's model for low-latency, high throughput text generation. Supports hundreds of pages of text.

100K
$0.8000 / 1M input tokens
$2.4000/ 1M output tokens
$0.0000 /K input images
Anthropic: Claude v1

Anthropic's model for low-latency, high throughput text generation. Supports hundreds of pages of text.

100K
$8.0000 / 1M input tokens
$24.0000/ 1M output tokens
$0.0000 /K input images
Anthropic: Claude (older v1)

Anthropic's model for low-latency, high throughput text generation. Supports hundreds of pages of text.

100K
$8.0000 / 1M input tokens
$24.0000/ 1M output tokens
$0.0000 /K input images
Mistral 7B Instruct

A 7.3B parameter model that outperforms Llama 2 13B on all benchmarks, with optimizations for speed and context length.

This is v0.1 of Mistral 7B Instruct. For v0.2, use this model.

32.8K
$0.1000 / 1M input tokens
$0.2500/ 1M output tokens
$0.0000 /K input images
Anthropic: Claude Instant (older v1.1)

Anthropic's model for low-latency, high throughput text generation. Supports hundreds of pages of text.

100K
$0.8000 / 1M input tokens
$2.4000/ 1M output tokens
$0.0000 /K input images
Anthropic: Claude v2 (self-moderated)

This is a lower-latency version of Claude v2, made available in collaboration with Anthropic, that is self-moderated: response moderation happens on the model's side instead of OpenRouter's. It's in beta, and may change in the future.

Claude 2.1 delivers advancements in key capabilities for enterprises—including an industry-leading 200K token context window, significant reductions in rates of model hallucination, system prompts and a new beta feature: tool use.

200K
$8.0000 / 1M input tokens
$24.0000/ 1M output tokens
$0.0000 /K input images
Hugging Face: Zephyr 7B (free)

Zephyr is a series of language models that are trained to act as helpful assistants. Zephyr-7B-β is the second model in the series, and is a fine-tuned version of mistralai/Mistral-7B-v0.1 that was trained on a mix of publicly available, synthetic datasets using Direct Preference Optimization (DPO).

Note: this is a free, rate-limited version of this model. Outputs may be cached. Read about rate limits here.

4.1K
$0.0000 / 1M input tokens
$0.0000/ 1M output tokens
$0.0000 /K input images
OpenChat 3.5 (free)

OpenChat is a library of open-source language models, fine-tuned with "C-RLFT (Conditioned Reinforcement Learning Fine-Tuning)" - a strategy inspired by offline reinforcement learning. It has been trained on mixed-quality data without preference labels.

Note: this is a free, rate-limited version of this model. Outputs may be cached. Read about rate limits here.

8.2K
$0.0000 / 1M input tokens
$0.0000/ 1M output tokens
$0.0000 /K input images
Anthropic: Claude v2.0 (self-moderated)

This is a lower-latency version of Claude v2.0, made available in collaboration with Anthropic, that is self-moderated: response moderation happens on the model's side instead of OpenRouter's. It's in beta, and may change in the future.

Anthropic's flagship model. Superior performance on tasks that require complex reasoning. Supports hundreds of pages of text.

100K
$8.0000 / 1M input tokens
$24.0000/ 1M output tokens
$0.0000 /K input images
Anthropic: Claude Instant v1 (self-moderated)

This is a lower-latency version of Claude Instant v1, made available in collaboration with Anthropic, that is self-moderated: response moderation happens on the model's side instead of OpenRouter's. It's in beta, and may change in the future.

Anthropic's model for low-latency, high throughput text generation. Supports hundreds of pages of text.

100K
$0.8000 / 1M input tokens
$2.4000/ 1M output tokens
$0.0000 /K input images
Mixtral 8x7B Instruct (nitro)

A pretrained generative Sparse Mixture of Experts, by Mistral AI, for chat and instruction use. Incorporates 8 experts (feed-forward networks) for a total of 47 billion parameters.

Instruct model fine-tuned by Mistral. #moe

Note: this is a higher-throughput version of this model, and may have higher prices and slightly different outputs.

32.8K
$0.5000 / 1M input tokens
$0.5000/ 1M output tokens
$0.0000 /K input images
Meta: Llama v2 70B Chat (nitro)

The flagship, 70 billion parameter language model from Meta, fine tuned for chat completions. Llama 2 is an auto-regressive language model that uses an optimized transformer architecture. The tuned versions use supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align to human preferences for helpfulness and safety.

Note: this is a higher-throughput version of this model, and may have higher prices and slightly different outputs.

4.1K
$0.9000 / 1M input tokens
$0.9000/ 1M output tokens
$0.0000 /K input images
MythoMax 13B (nitro)

One of the highest performing and most popular fine-tunes of Llama 2 13B, with rich descriptions and roleplay. #merge

Note: this is a higher-throughput version of this model, and may have higher prices and slightly different outputs.

4.1K
$0.2000 / 1M input tokens
$0.2000/ 1M output tokens
$0.0000 /K input images
Mistral 7B Instruct (nitro)

A 7.3B parameter model that outperforms Llama 2 13B on all benchmarks, with optimizations for speed and context length.

This is v0.2 of Mistral 7B Instruct. For v0.1, use this model.

Note: this is a higher-throughput version of this model, and may have higher prices and slightly different outputs.

32.8K
$0.2000 / 1M input tokens
$0.2000/ 1M output tokens
$0.0000 /K input images
Mistral Medium

This is Mistral AI's closed-source, medium-sided model. It's powered by a closed-source prototype and excels at reasoning, code, JSON, chat, and more. In benchmarks, it compares with many of the flagship models of other companies.

32K
$2.7000 / 1M input tokens
$8.1000/ 1M output tokens
$0.0000 /K input images
Google: Gemini Pro 1.0

Google's flagship text generation model. Designed to handle natural language tasks, multiturn text and code chat, and code generation.

See the benchmarks and prompting guidelines from Deepmind.

Usage of Gemini is subject to Google's Gemini Terms of Use.

91.7K
$0.1250 / 1M input tokens
$0.3750/ 1M output tokens
$2.5000 /K input images
Mistral Tiny

This model is currently powered by Mistral-7B-v0.2, and incorporates a "better" fine-tuning than Mistral 7B, inspired by community work. It's best used for large batch processing tasks where cost is a significant factor but reasoning capabilities are not crucial.

32K
$0.2500 / 1M input tokens
$0.2500/ 1M output tokens
$0.0000 /K input images
Mistral Small

This model is currently powered by Mixtral-8X7B-v0.1, a sparse mixture of experts model with 12B active parameters. It has better reasoning, exhibits more capabilities, can produce and reason about code, and is multiligual, supporting English, French, German, Italian, and Spanish. #moe

32K
$2.0000 / 1M input tokens
$6.0000/ 1M output tokens
$0.0000 /K input images
Mistral Large

This is Mistral AI's closed-source, flagship model. It's powered by a closed-source prototype and excels at reasoning, code, JSON, chat, and more. Read the launch announcement here.

It is fluent in English, French, Spanish, German, and Italian, with high grammatical accuracy, and its 32K tokens context window allows precise information recall from large documents.

32K
$8.0000 / 1M input tokens
$24.0000/ 1M output tokens
$0.0000 /K input images
Cohere: Command

Command is an instruction-following conversational model that performs language tasks with high quality, more reliably and with a longer context than our base generative models.

Use of this model is subject to Cohere's Acceptable Use Policy.

4.1K
$1.0000 / 1M input tokens
$2.0000/ 1M output tokens
$0.0000 /K input images
OpenAI: GPT-4 Vision

Ability to understand images, in addition to all other GPT-4 Turbo capabilties. Training data: up to Apr 2023.

Note: heavily rate limited by OpenAI while in preview.

#multimodal

128K
$10.0000 / 1M input tokens
$30.0000/ 1M output tokens
$14.4500 /K input images
Neural Chat 7B v3.1

A fine-tuned model based on mistralai/Mistral-7B-v0.1 on the open source dataset Open-Orca/SlimOrca, aligned with DPO algorithm. For more details, refer to the blog: The Practice of Supervised Fine-tuning and Direct Preference Optimization on Habana Gaudi2.

4.1K
$5.0000 / 1M input tokens
$5.0000/ 1M output tokens
$0.0000 /K input images
Nous: Hermes 13B

A state-of-the-art language model fine-tuned on over 300k instructions by Nous Research, with Teknium and Emozilla leading the fine tuning process.

4.1K
$0.2700 / 1M input tokens
$0.2700/ 1M output tokens
$0.0000 /K input images
Databricks: DBRX 132B Instruct (nitro)

DBRX is a new open source large language model developed by Databricks. At 132B, it outperforms existing open source LLMs like Llama 2 70B and Mixtral-8x7B on standard industry benchmarks for language understanding, programming, math, and logic.

It uses a fine-grained mixture-of-experts (MoE) architecture. 36B parameters are active on any input. It was pre-trained on 12T tokens of text and code data. Compared to other open MoE models like Mixtral-8x7B and Grok-1, DBRX is fine-grained, meaning it uses a larger number of smaller experts.

See the launch announcement and benchmark results here.

#moe

Note: this is a higher-throughput version of this model, and may have higher prices and slightly different outputs.

32.8K
$0.9000 / 1M input tokens
$0.9000/ 1M output tokens
$0.0000 /K input images
Anthropic: Claude v2.1 (self-moderated)

This is a lower-latency version of Claude v2.1, made available in collaboration with Anthropic, that is self-moderated: response moderation happens on the model's side instead of OpenRouter's. It's in beta, and may change in the future.

Claude 2.1 delivers advancements in key capabilities for enterprises—including an industry-leading 200K token context window, significant reductions in rates of model hallucination, system prompts and a new beta feature: tool use.

200K
$8.0000 / 1M input tokens
$24.0000/ 1M output tokens
$0.0000 /K input images
Mistral: Mixtral 8x22B (base)

Mixtral 8x22B is a large-scale language model from Mistral AI. It consists of 8 experts, each 22 billion parameters, with each token using 2 experts at a time.

It was released via X.

#moe

65.5K
$0.9000 / 1M input tokens
$0.9000/ 1M output tokens
$0.0000 /K input images
WizardLM-2 8x22B

WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models.

It is an instruct finetune of Mixtral 8x22B.

To read more about the model release, click here.

#moe

65.5K
$0.6500 / 1M input tokens
$0.6500/ 1M output tokens
$0.0000 /K input images
Nous: Capybara 7B (free)

The Capybara series is a collection of datasets and models made by fine-tuning on data created by Nous, mostly in-house.

V1.9 uses unalignment techniques for more consistent and dynamic control. It also leverages a significantly better foundation model, Mistral 7B.

Note: this is a free, rate-limited version of this model. Outputs may be cached. Read about rate limits here.

4.1K
$0.0000 / 1M input tokens
$0.0000/ 1M output tokens
$0.0000 /K input images
Google: Gemma 7B (free)

Gemma by Google is an advanced, open-source language model family, leveraging the latest in decoder-only, text-to-text technology. It offers English language capabilities across text generation tasks like question answering, summarization, and reasoning. The Gemma 7B variant is comparable in performance to leading open source models.

Usage of Gemma is subject to Google's Gemma Terms of Use.

Note: this is a free, rate-limited version of this model. Outputs may be cached. Read about rate limits here.

8.2K
$0.0000 / 1M input tokens
$0.0000/ 1M output tokens
$0.0000 /K input images
Zephyr 141B-A35B

Zephyr 141B-A35B is A Mixture of Experts (MoE) model with 141B total parameters and 35B active parameters. Fine-tuned on a mix of publicly available, synthetic datasets.

It is an instruct finetune of Mixtral 8x22B.

#moe

65.5K
$0.6500 / 1M input tokens
$0.6500/ 1M output tokens
$0.0000 /K input images
Fireworks Mixtral 8x22B Instruct OH (preview)

The first instruct-tuned version of the latest mixture of experts from Mistral: Mixtral 8x22B.

This model was finetuned on ~10K entries from OpenHermes dataset.

#moe

8.2K
$0.9000 / 1M input tokens
$0.9000/ 1M output tokens
$0.0000 /K input images
MythoMist 7B (free)

From the creator of MythoMax, merges a suite of models to reduce word anticipation, ministrations, and other undesirable words in ChatGPT roleplaying data.

It combines Neural Chat 7B, Airoboros 7b, Toppy M 7B, Zepher 7b beta, Nous Capybara 34B, OpenHeremes 2.5, and many others.

#merge

Note: this is a free, rate-limited version of this model. Outputs may be cached. Read about rate limits here.

32.8K
$0.0000 / 1M input tokens
$0.0000/ 1M output tokens
$0.0000 /K input images
Google: Gemma 7B (nitro)

Gemma by Google is an advanced, open-source language model family, leveraging the latest in decoder-only, text-to-text technology. It offers English language capabilities across text generation tasks like question answering, summarization, and reasoning. The Gemma 7B variant is comparable in performance to leading open source models.

Usage of Gemma is subject to Google's Gemma Terms of Use.

Note: this is a higher-throughput version of this model, and may have higher prices and slightly different outputs.

8.2K
$0.2000 / 1M input tokens
$0.2000/ 1M output tokens
$0.0000 /K input images
WizardLM-2 7B

WizardLM-2 7B is the smaller variant of Microsoft AI's latest Wizard model. It is the fastest and achieves comparable performance with existing 10x larger opensource leading models

It is a finetune of Mistral 7B Instruct, using the same technique as WizardLM-2 8x22B.

To read more about the model release, click here.

#moe

32K
$0.1000 / 1M input tokens
$0.1000/ 1M output tokens
$0.0000 /K input images
Mistral: Mixtral 8x22B Instruct

Mistral's official instruct fine-tuned version of Mixtral 8x22B. It uses 39B active parameters out of 141B, offering unparalleled cost efficiency for its size. Its strengths include:

  • strong math, coding, and reasoning
  • large context length (64k)
  • fluency in English, French, Italian, German, and Spanish

See benchmarks on the launch announcement here. #moe

65.5K
$0.6500 / 1M input tokens
$0.6500/ 1M output tokens
$0.0000 /K input images
Toppy M 7B (nitro)

A wild 7B parameter model that merges several models using the new task_arithmetic merge method from mergekit. List of merged models:

  • NousResearch/Nous-Capybara-7B-V1.9
  • HuggingFaceH4/zephyr-7b-beta
  • lemonilia/AshhLimaRP-Mistral-7B
  • Vulkane/120-Days-of-Sodom-LoRA-Mistral-7b
  • Undi95/Mistral-pippa-sharegpt-7b-qlora

#merge #uncensored

Note: this is a higher-throughput version of this model, and may have higher prices and slightly different outputs.

4.1K
$0.1500 / 1M input tokens
$0.1500/ 1M output tokens
$0.0000 /K input images
WizardLM-2 8x22B (nitro)

WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models.

It is an instruct finetune of Mixtral 8x22B.

To read more about the model release, click here.

#moe

Note: this is a higher-throughput version of this model, and may have higher prices and slightly different outputs.

65.5K
$1.0000 / 1M input tokens
$1.0000/ 1M output tokens
$0.0000 /K input images
Anthropic: Claude Instant (older v1)

Anthropic's model for low-latency, high throughput text generation. Supports hundreds of pages of text.

100K
$0.8000 / 1M input tokens
$2.4000/ 1M output tokens
$0.0000 /K input images
Auto (best for prompt)

Depending on their size, subject, and complexity, your prompts will be sent to Mistral Large or GPT-4 Turbo. To see which model was used, visit Activity.

128K
$-1000000.0000 / 1M input tokens
$-1000000.0000/ 1M output tokens
$-1000.0000 /K input images
Mistral 7B Instruct (free)

A 7.3B parameter model that outperforms Llama 2 13B on all benchmarks, with optimizations for speed and context length.

This is v0.1 of Mistral 7B Instruct. For v0.2, use this model.

Note: this is a free, rate-limited version of this model. Outputs may be cached. Read about rate limits here.

32.8K
$0.0000 / 1M input tokens
$0.0000/ 1M output tokens
$0.0000 /K input images
Cinematika 7B (alpha) (free)

This model is under development. Check the OpenRouter Discord for updates.

Note: this is a free, rate-limited version of this model. Outputs may be cached. Read about rate limits here.

8K
$0.0000 / 1M input tokens
$0.0000/ 1M output tokens
$0.0000 /K input images
Nous: Hermes 2 Mixtral 8x7B DPO

Nous Hermes 2 Mixtral 8x7B DPO is the new flagship Nous Research model trained over the Mixtral 8x7B MoE LLM.

The model was trained on over 1,000,000 entries of primarily GPT-4 generated data, as well as other high quality data from open datasets across the AI landscape, achieving state of the art performance on a variety of tasks.

#moe

32K
$0.3000 / 1M input tokens
$0.5000/ 1M output tokens
$0.0000 /K input images
Midnight Rose 70B

A merge with a complex family tree, this model was crafted for roleplaying and storytelling. Midnight Rose is a successor to Rogue Rose and Aurora Nights and improves upon them both. It wants to produce lengthy output by default and is the best creative writing merge produced so far by sophosympatheia.

Descending from earlier versions of Midnight Rose and Wizard Tulu Dolphin 70B, it inherits the best qualities of each.

4.1K
$9.0000 / 1M input tokens
$9.0000/ 1M output tokens
$0.0000 /K input images
Llava 13B

LLaVA is a large multimodal model that combines a vision encoder and Vicuna for general-purpose visual and language understanding, achieving impressive chat capabilities mimicking GPT-4 and setting a new state-of-the-art accuracy on Science QA

#multimodal

2K
$5.0000 / 1M input tokens
$5.0000/ 1M output tokens
$0.0000 /K input images
Phind: CodeLlama 34B v2

A fine-tune of CodeLlama-34B on an internal dataset that helps it exceed GPT-4 on some benchmarks, including HumanEval.

4.1K
$0.7200 / 1M input tokens
$0.7200/ 1M output tokens
$0.0000 /K input images
OpenAI: GPT-4 Turbo Preview

The latest GPT-4 model with improved instruction following, JSON mode, reproducible outputs, parallel function calling, and more. Training data: up to Dec 2023.

Note: heavily rate limited by OpenAI while in preview.

128K
$10.0000 / 1M input tokens
$30.0000/ 1M output tokens
$0.0000 /K input images
Meta: CodeLlama 34B Instruct

Code Llama is built upon Llama 2 and excels at filling in code, handling extensive input contexts, and folling programming instructions without prior training for various programming tasks.

8.2K
$0.7200 / 1M input tokens
$0.7200/ 1M output tokens
$0.0000 /K input images
Nous: Hermes 2 Mixtral 8x7B SFT

Nous Hermes 2 Mixtral 8x7B SFT is the supervised finetune only version of the Nous Research model trained over the Mixtral 8x7B MoE LLM.

The model was trained on over 1,000,000 entries of primarily GPT-4 generated data, as well as other high quality data from open datasets across the AI landscape, achieving state of the art performance on a variety of tasks.

#moe

32K
$0.5400 / 1M input tokens
$0.5400/ 1M output tokens
$0.0000 /K input images