gguf-quantization

SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp, vLLM, Diffusers and PyTorch.

CLI/GUI tool for efficient and easy safetensors and gguf model conversion

GGUF Quantization support for native ComfyUI models

Evolution process to find the best quant tensor weights to build the most optimal GGUF options for an AI model.

Run very large MoE models (100B–1T+) on the hardware you already own, by streaming experts across VRAM/RAM/SSD. Source-available, free for personal use.

Fatrocu converts your e-archive invoices, cash register receipts, and receipts into Excel format within minutes using a 100% locally running AI, drastically reducing manual data entry.

Análise Avançada de Dados com Causalidade e Aprendizado por Reforço

Which language models will actually run well on your machine. Measured, not looked up. Free, offline, for Windows, macOS and Linux.

Power up your projects with Glyvex: All-in-one open-source AI suite for automation and innovation.

Auto GGUF Converter for HuggingFace Hub Models with Multiple Quantizations (GGUF Format)

NEXUS Web LLM is a browser-based local inference app for compatible GGUF and LittleBit models, featuring custom WebGPU acceleration, metadata-driven configuration, 100 model profiles, automatic memory planning, speed tuning, and runtime diagnostics.

Gemma-4-It fine-tuned on PubMedQA using SFT & RLVR

Convert and quantize llm models

Run Qwen-Image 2.1 locally on a 16 GB Apple Silicon Mac. Free, offline AI image editor and generator with mask inpainting, 4-step Turbo LoRA, 4-bit GGUF models, upscaling and a private mode. Built on stable-diffusion.cpp.

Convert Safetensor weights to GGUF format using google colab and HuggingFace. Use the power of AI locally :)

Run large language models locally on Windows. A native Rust desktop app and local LLM API server for GGUF models fully offline, no Python, no Docker, no cloud account. It measures your GPU and the model file, then loads a configuration that fits. Tuned on an 8 GB laptop card.

A 501M-parameter language model trained from scratch on 20B tokens: custom BPE tokenizer, original Llama-style architecture, training and SFT pipeline, and unattended cloud orchestration. 54 hours on one H100 for about $165.

AI model weight query and manipulation with Entail compilation and grafting into models without training, and universal model conversion

Convert Hugging Face models to GGUF with xet support.

High-performance LLM compression engine using SVD matrix decomposition, INT8 quantization, and output caching training acceleration.