Mistral: Mixtral 8x22B Instruct

mistralai/mixtral-8x22b-instruct

Mistral's official instruct fine-tuned version of [Mixtral 8x22B](/models/mistralai/mixtral-8x22b). It uses 39B active parameters out of 141B, offering unparalleled cost efficiency for its size. Its strengths include: - strong math, coding,...

Modalities
TextFile
In / out price
₩3,510 / ₩10,530
1M
Context
65.54K
Released
Apr 17, 2024

FAQ

Frequently asked questions

How do I call this model?

Send a request to `/api/v1/chat/completions` with `model` set to this model ID. Changing the base_url of the OpenAI SDK is enough.

How is the price calculated?

The upstream cost in USD is multiplied by the exchange rate and the margin to produce a won price. The cost of each request is recorded in the response headers and in your activity log.

Does this run on a local GPU?

If a local GPU serves this model, it goes first. When there is no local slot or it fails, the request falls through to an external provider.

Are my conversations stored?

API request bodies are never stored. Only conversations from the Chat screen are saved, and you can turn that off in settings.

Learn more