481 Downloads Updated 1 year ago
A series of models from Groq that represent a significant advancement in open-source AI capabilities for tool use/function calling.
Models
View all →Name
18 models
llama3-groq-tool-8b:latest
4.7GB · 8K context window · Text · 1 year ago
llama3-groq-tool-8b:q2_k
3.2GB · 8K context window · Text · 1 year ago
llama3-groq-tool-8b:q3_k_s
3.7GB · 8K context window · Text · 1 year ago
llama3-groq-tool-8b:q3_k_m
4.0GB · 8K context window · Text · 1 year ago
llama3-groq-tool-8b:q3_k_l
4.3GB · 8K context window · Text · 1 year ago
llama3-groq-tool-8b:q4_0
4.7GB · 8K context window · Text · 1 year ago
llama3-groq-tool-8b:q4_1
5.1GB · 8K context window · Text · 1 year ago
llama3-groq-tool-8b:q4_k_s
4.7GB · 8K context window · Text · 1 year ago
llama3-groq-tool-8b:q4_k_m
4.9GB · 8K context window · Text · 1 year ago
llama3-groq-tool-8b:q5_0
5.6GB · 8K context window · Text · 1 year ago
llama3-groq-tool-8b:q5_1
6.1GB · 8K context window · Text · 1 year ago
llama3-groq-tool-8b:q5_k_s
5.6GB · 8K context window · Text · 1 year ago
llama3-groq-tool-8b:q5_k_m
5.7GB · 8K context window · Text · 1 year ago
llama3-groq-tool-8b:q6_k
6.6GB · 8K context window · Text · 1 year ago
llama3-groq-tool-8b:q8_0
8.5GB · 8K context window · Text · 1 year ago
llama3-groq-tool-8b:iq3_xxs
3.3GB · 8K context window · Text · 1 year ago
llama3-groq-tool-8b:iq4_xs
4.4GB · 8K context window · Text · 1 year ago
llama3-groq-tool-8b:iq4_nl
4.7GB · 8K context window · Text · 1 year ago
Readme
These models, developed in collaboration with Glaive, represent a significant advancement in open-source AI capabilities for tool use/function calling.
Benchmark Results
These models have achieved remarkable results, setting new benchmarks for Large Language Models with tool use capabilities:
Llama-3-Groq-70B-Tool-Use: 90.76% overall accuracy (#1 on BFCL at the time of publishing - July 2024) Llama-3-Groq-8B-Tool-Use: 89.06% overall accuracy (#3 on BFCL at the time of publishing - July 2024)