ifioravanti/
lwm:7b-1m-text-chat-q5_k_m

781 1 year ago

Large World Model is an open-source model trained from LLaMA-2 on a subset of Books3 filtered data

7b

1 year ago

9a9a14cb0bde · 4.8GB ·

llama
·
6.74B
·
Q5_K_M
{{ if and .First .System }}{{ .System }} {{ end }} USER: {{ .Prompt }} ASSISTANT:
"""You are a helpful assistant."""

Readme

A family of 7B parameter models capable of processing long text documents (LWM-Text, LWM-Text-Chat) of over 1M tokens.

image

CLI

ollama run ifioravanti/lwm

API

Example:

curl -X POST http://localhost:11434/api/generate -d '{ 
  "model": "ifioravanti/lwm",
  "prompt": "Here is a story about llamas eating grass"
 }'

Memory requirements

7b models generally require at least 8GB of RAM but due to 1M context size this requires a ton of memory depending on the context passed

References

Github HuggingFace