How Much Storage Do Offline AI Models Really Need? A Practical Guide
You want to run AI on your phone without the internet — no cloud, no subscription, no data leaving your device. You download an offline AI app, pick a model, and then you see the number: 4.7 GB. Or 1.2 GB. Or 9 GB. Suddenly the question is not whether your phone can run AI, but whether it has room for it.
The short answer: most people need between 1 and 5 GB for a good offline AI setup. But that range hides a lot of variation, and picking the wrong model can either waste storage or leave you with an assistant that struggles. This guide explains where the gigabytes go, how to estimate what you need, and how to keep your phone's storage under control.
Where the gigabytes actually go
An offline AI model is a file — usually a single large file — that lives on your phone. When you download a model, you are downloading the model's "weights": the numbers it learned during training, which encode everything it knows about language, facts and reasoning. The size of that file depends almost entirely on two things.
Parameter count. This is the number of weights in the model, usually expressed in billions: 1B, 3B, 7B, 8B and so on. More parameters generally means a more capable model, and a bigger file. A 1B model is roughly a seventh the size of a 7B model at the same precision.
Precision (quantization). Each parameter is a number, and how precisely that number is stored changes the file size dramatically. A model stored at 16-bit precision uses about 2 bytes per parameter; at 8-bit, about 1 byte; at 4-bit, about half a byte. Most on-device models are distributed in a quantized 4-bit format, which is the main reason a capable model fits on a phone at all.
Put together, the maths is simple: parameters × bytes per parameter ≈ file size. That is why the same 7B model can be a 14 GB download at full precision and under 5 GB at 4-bit quantization.
Typical model sizes at a glance
These are approximate figures for common model sizes at 4-bit quantization, the format most phone apps use:
| Model size | Approximate download | Good for |
|---|---|---|
| ~1B parameters | Under 1 GB | Quick replies, simple Q&A, drafting on low-end phones |
| ~3B parameters | Around 2 GB | Everyday chat, summarizing, translating, writing help |
| ~7–8B parameters | Around 4–5 GB | Stronger reasoning, longer documents, more reliable answers |
| ~13B parameters | Around 8 GB | The largest models that realistically fit on a phone, and only on devices with plenty of free space |
These are ballpark numbers, not exact specifications — the precise size depends on the model family and the exact quantization used. But they are close enough to plan with. If a model listing says 4.7 GB for a 7–8B model, that is normal. If it says 12 GB for a 3B model, something is off, and you should check whether you are downloading a higher-precision version than you need.
The hidden costs beyond the download
The model file is the biggest cost, but it is not the only one. Budget a little extra for:
The app itself. The app that runs the models is usually a few hundred megabytes — small compared with the models, but not nothing.
Working space. While a model is running, the app needs temporary space for the conversation — the context window. Longer conversations and longer documents use more of this working memory. It is temporary, not permanent storage, but a phone with almost no free space can still struggle, because the operating system itself needs breathing room to function.
Multiple models add up fast. Two 3B models cost about 4 GB. A 3B and a 7B together cost about 6–7 GB. This is the most common way people run out of space: they download several models to try them, forget to delete the ones they did not like, and the storage quietly disappears.
A practical rule: keep at least 1–2 GB of free space beyond the total size of your installed models. If your phone reports less than that free, delete something before downloading another model.
How to choose the right size for your phone
Storage is only half the question. The other half is what your phone can actually run well, because a bigger model also needs more RAM and a faster chip. The right choice depends on your device and what you want to do.
Phones with 64 GB of storage. Stick with a 1B or 3B model. A 3B model at around 2 GB leaves plenty of room for your photos, apps and the operating system. A 1B model is even safer and still handles quick questions, drafting and simple summaries. Skip the 7B models — the download alone would take a big chunk of your free space.
Phones with 128 GB of storage. A 3B model is the comfortable default, and a 7B model is realistic if you have a decent amount of free space. One 7B model plus the app costs roughly 5 GB, which is fine on a 128 GB phone that is not already full. If you are constantly deleting photos to make room, stay with the 3B.
Phones with 256 GB or more. Storage is not your limiting factor. Pick the model based on capability and speed instead: a 7–8B model for the best answers your phone can handle, or a 3B model if you value fast replies and low battery use. Even here, avoid hoarding models you never open.
What you actually do matters more than the number. For everyday tasks — answering questions, drafting messages and emails, summarizing articles, translating a menu — a 3B model is genuinely good, and most people will not notice what a larger model adds. A 7–8B model earns its extra gigabytes when you work with longer documents, ask multi-step questions, or want more careful, structured answers. If your main use is quick questions and drafts, a smaller model saves storage and runs faster.
Managing storage once models are installed
Offline AI storage is easy to manage if you treat models like apps: keep the ones you use, delete the ones you do not.
Delete models you stopped using. Open the app's model list and remove anything you have not opened in weeks. Re-downloading a model later takes a few minutes on Wi-Fi; keeping it "just in case" costs gigabytes every day.
One general model is enough for most people. A single good general-purpose model covers chatting, drafting, summarizing and translating. A second model only makes sense if it does a different job — for example, a smaller model for fast replies, or a specialist model for image generation or voice. Three or four general chat models that do the same thing are just the same capability stored three or four times.
Clear the cache, not the models. If the app offers a cache-clearing option, use it before deleting models. Cached conversation data and temporary files can add up, and clearing them costs you nothing you cannot recreate.
Free space elsewhere first. Before blaming the AI app, check the usual suspects: videos you have already backed up, downloaded podcasts and music, old message attachments, and apps you have not opened in months. Moving photos and videos to cloud storage or a computer is usually the quickest way to recover several gigabytes.
What about RAM?
Storage and RAM are different things, and people often confuse them. Storage is where the model file lives when it is not running. RAM is the working memory the phone uses while the model is actually generating a reply.
A rough guide: a model needs roughly its file size in RAM to run, plus space for the conversation context. That is why a phone with 4 GB of RAM struggles with a 7B model even if it has the storage space, while a phone with 8 GB or more handles it comfortably. Storage determines whether you can keep the model; RAM determines whether you can run it well. If your phone has limited RAM, a smaller model is the right call on both counts — it takes less storage and less working memory.
A quick checklist before you download
- Check your free storage in Settings first, and make sure you have the model size plus 1–2 GB to spare.
- Start with one model, not three. Use it for a week before deciding whether you need a second.
- Prefer 4-bit quantized versions for phones — they are the standard for on-device use and the best balance of size and quality.
- Delete models you do not use. Re-downloading is cheap; hoarding is expensive.
- Remember that bigger is not automatically better. The best model is the one that fits your phone, answers your questions well, and is there when you need it — including when there is no signal at all.
The bottom line
For most people, a single 3B model at around 2 GB is the sweet spot: capable enough for everyday tasks, small enough to fit on almost any modern phone, and fast enough to feel instant. A 7–8B model at 4–5 GB is worth it if you have the space and want stronger answers for longer or harder tasks. Anything beyond that belongs on a desktop, not a phone.
LLM Hub, for example, offers 15+ downloadable models for Android and iOS, so you can start small, try a larger model when you have the room, and delete anything you do not use — all without an account, and all running entirely on your device. The storage is yours to manage, the models are yours to choose, and nothing about your usage ever leaves your phone.

