Meta: Llama 3.1 70B Instruct
meta-llama/llama-3.1-70b-instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...
Modalities
Text
In / out price
₩702 / ₩702
1M
Context
131.07K
Released
Jul 23, 2024
FAQ
Frequently asked questions
How do I call this model?
Send a request to `/api/v1/chat/completions` with `model` set to this model ID. Changing the base_url of the OpenAI SDK is enough.
How is the price calculated?
The upstream cost in USD is multiplied by the exchange rate and the margin to produce a won price. The cost of each request is recorded in the response headers and in your activity log.
Does this run on a local GPU?
If a local GPU serves this model, it goes first. When there is no local slot or it fails, the request falls through to an external provider.
Are my conversations stored?
API request bodies are never stored. Only conversations from the Chat screen are saved, and you can turn that off in settings.