Model Quantization Articles

Page 1 of 1 (3 articles)

11/7/2025 • EN

Moonshot AI's Kimi K2 Thinking is a 1 trillion parameter open-weight model optimized for multi-step reasoning and long-running tool calls.

AI Agents Benchmarks large language models Model Quantization Tool Use

12/14/2023 • EN

A technical guide on how to run the Mistral 7B Instruct large language model locally on a Macbook using llama.cpp and HuggingFace.

Llamacpp Local LLM Maco Mistral 7b Model Quantization

8/2/2022 • EN

Learn to optimize Sentence Transformers models for faster inference using Hugging Face Optimum, ONNX Runtime, and dynamic quantization.

Hugging Face Optimum Model Quantization Onnx Runtime performance optimization Sentence Transformers

Select Language