Local AI: Private Models on Your Own Hardware

Local AI means a language model that runs on a computer you own, not on a provider’s cloud. Your prompts and files stay on your machine, and local tasks have no per-token bill.

This page collects every NosisTech article on local AI. Each one documents a real build with the hardware, the commands, the measured speed, and the problems that came up.

The Two Laptops Behind These Tests

LaptopProcessorGPUSystem memory
Acer Predator Helios Neo 16S (PHN16S-71)Intel Core Ultra 9 275HXNVIDIA RTX 5070 Ti, 12GB GDDR732GB DDR5 at 6400 MT/s
ASUS TUF Dash F15Intel Core i7-11370HNVIDIA RTX 3050 Ti, 4GB GDDR6Upgraded from the 8GB base model

The 12GB laptop runs models up to 35 billion parameters, with part of each large model in system memory. The 4GB laptop runs a 2 billion parameter model, and a router sends hard prompts to a cloud model.

Start Here

ArticleWhat it covers
Running Local AI on a Gaming Laptop: Install and SetupThe first install of Ollama and Open WebUI, from problems to fast settings.
VRAM vs RAM in Local AI ModelsWhy a model that does not fit in GPU memory runs slower.
Running Local AI on a $798 LaptopWhat a 4GB GPU can do across 71 real-world tasks.

Local AI on a Gaming Laptop

Nine articles on the 12GB laptop, in reading order. They move from memory basics to benchmarks, tool choice, and agent setup.

#ArticleWhat it covers
1VRAM vs RAM in Local AI ModelsQwen3 30B needs about 19GB, so roughly 9GB spills into slower system RAM.
2Running Local AI on a Gaming Laptop: Install and SetupOllama and Open WebUI, three install problems, and tuned settings for Gemma4 26B and Qwen3 30B A3B.
3I Pushed My Local AI’s Memory to the LimitContext window tests from 4,096 to 32,768 tokens.
4Qwen3.6 35B-A3B on a 12GB Laptop GPUA 23GB model at 16 tokens per second, and why 2,048 tokens of context is too small.
5Qwen3, Sonnet, Opus, and Gemini Pro ComparedWhere a local model holds up, and how I divide the work.
6LM Studio vs Ollama on a 12GB Laptop GPUOne model and prompt: 28.00 tokens per second in LM Studio, 17.65 in Ollama.
7LM Studio vs Ollama for an Always-On AI ServerWhy speed was the wrong measure for a server that must survive a reboot.
8Maxing Out Gemma 4 on a Laptop GPUGemma 4 12B from 39 to 114 tokens per second with Multi-Token Prediction and llama.cpp.
9Why Hermes Agent Rejects a 64k ContextThe context is split between parallel slots in llama-server, and one slot fixes it.

The $798 Laptop Test

Three articles test one question: can a 2021 gaming laptop with a 4GB GPU run useful private AI?

#ArticleWhat it covers
1Running Local AI on a $798 Laptop: The NosisTech TestQwen3.5 2B in about 3GB of VRAM, tested with 71 real-world tasks.
24GB GPU Made Laptop an AI WorkstationA router keeps everyday prompts local and sends hard ones to the cloud, tested with 40 scenarios.
3Your Own Private AI on a $798 Laptop: 91% Pass35 router tests, with 89% of queries answered on the laptop at no cost.

Home AI Lab and Remote Access

These articles turn the laptop into a small server that you can reach from a phone, and then lock it down.

#ArticleWhat it covers
1I Made My Local AI Accessible From AnywhereCloudflare Tunnel gives the laptop a permanent address on the free plan.
2Self-Hosted AI Lab Accessible From AnywhereA full Windows guide with NSSM, auto-start at boot, and a reboot test.
3Securing a Self-Hosted AI Lab with Cloudflare Zero TrustAutomated probes arrived within hours, and Zero Trust Access now checks every visitor.

A Private Voice Assistant

#ArticleWhat it covers
1A Private AI Voice Assistant on a LaptopWhisper for speech, gemma3:12b for answers, and Kokoro for the voice.
2AI Assistant Tuning: What Broke and Finally WorkedThe system prompt only held after it moved into an Ollama Modelfile.

Cloud Models, VPS Servers, and Cost

Local models handle much of the work. These articles cover the rest: a VPS server, cloud models behind one proxy, and the cost of each call.

ArticleWhat it covers
I Built My Own AI Server on a VPSOllama on a Hostinger VPS, with LiteLLM so Claude and Gemini sit beside local models.
Connecting DeepSeek V4-Pro to a Hostinger VPSThe LiteLLM and Open WebUI setup, and the price per million tokens.
Three Hidden Patterns That Inflate Your AI API BillExpensive default models, silent retries, and large models on small tasks.

Automations With n8n

#ArticleWhat it covers
1A Local AI Discount Monitor With n8n, Ollama, and TelegramA daily check of the Google Cloud certifications blog.
2From Laptop to Cloud: The Discount Monitor Moves to a VPSWhy a laptop that sleeps cannot run a daily job.
3A Google Search Console Automation With n8nA daily sitemap check with a Telegram confirmation.

More From NosisTech

PageWhat it covers
AI SecurityBunker, website hardening, and AI safety builds.
AI GovernanceFree policy templates and governance builds.
50+ Agent Patterns & BuildsThe full library of documented agent builds.
All articlesEvery NosisTech article, newest first.