Bored Consultant

Ambitious but rubbish

Reading articles in llama.cpp

2026

2026-07-1845 tok/s on a Laptop: Getting Qwen3.6-27B's NVFP4 Quants Running on llama.cpp

llama.cpp vllm nvidia quant qwen3.6 nvfp4 gather.town remote video conference video call home office video docker postfix dovecot selfhosted mail mailserver ansible apacheds ldap github cloud microsoft azure prometheus grafana monitoring devops vm grafana loki logs vcard excel python openpyxl DAVx Android SOGo CalDAV bookstack alpine PHP nginx log Xdebug profiling debugging anamorphic photography SIRUI squeezefix exif tags resize RAW spam rspamd asus Pop!_OS bluetooth gpn21 talk ccc entropia stable diffusion 3.5 AI image generation Python Nvidia Hugging Face quantization tutorial Diffusers quanto ssl self signed certificate rsa traefik certificate domain webserver hosting groupware raspberry pi headless image ai llm large language model llama deepseek benchmark performance monero mining crypto bridge networking openssh ssh-keygen

Copyright © 2026 Benjamin Behringer