mistral-large:123b-instruct-2411-q8

mistral-large:123b-instruct-2411-q8_0

461.7K Downloads Updated 1 year ago

Mistral Large 2 is Mistral's new flagship model that is significantly more capable in code generation, mathematics, and reasoning with 128k context window and support for dozens of languages.

tools 123b

ollama run mistral-large:123b-instruct-2411-q8_0

curl http://localhost:11434/api/chat \
  -d '{
    "model": "mistral-large:123b-instruct-2411-q8_0",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='mistral-large:123b-instruct-2411-q8_0',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'mistral-large:123b-instruct-2411-q8_0',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 1 year ago

1 year ago

fc9b9f119292 · 130GB ·

model

archllama

parameters123B

quantizationQ8_0

130GB

license

# Mistral AI Research License If You want to use a Mistral Model, a Derivative or an Output for any

11kB

params

{ "stop": [ "[INST]", "[/INST]", "</s>" ] }

47B

template

{{- if .Messages }} {{- range $index, $_ := .Messages }} {{- if eq .Role "user" }} {{- if and (le (l

896B

Readme

Mistral-Large-Instruct-2411 is an advanced dense Large Language Model (LLM) of 123B parameters with state-of-the-art reasoning, knowledge and coding capabilities.

Key features

Multi-lingual by design: Dozens of languages supported, including English, French, German, Spanish, Italian, Chinese, Japanese, Korean, Portuguese, Dutch and Polish.
Proficient in coding: Trained on 80+ coding languages such as Python, Java, C, C++, JavacScript, and Bash. Also trained on more specific languages such as Swift and Fortran.
Agentic-centric: Best-in-class agentic capabilities with native function calling and JSON outputting.
Advanced Reasoning: State-of-the-art mathematical and reasoning capabilities.
Mistral Research License: Allows usage and modification for research and non-commercial usages.
Large Context: A large 128k context window.

References

Blog post

Hugging Face