Take the SIM card out of your phone and most of what you expect from a smartphone stops working. Calls, texts, mobile data, and anything that needs a network connection goes dark. It is natural to assume AI goes dark too — after all, every AI assistant most people have used lives in the cloud and needs a connection to answer a single question.
That assumption is wrong, but only for one kind of AI. If the model runs on your phone rather than on a server, a SIM card is irrelevant. Your phone does not need a mobile plan, a carrier, or even a signal to run AI — it just needs the model already stored on the device. This guide explains how that works, what you need to set up while you still have Wi-Fi, and what a SIM-less phone can and cannot do with on-device AI.
Why a SIM card has nothing to do with running AI
A SIM card does exactly one job: it identifies your phone to a mobile network so you can use calls, texts, and mobile data. It is a key to the carrier's network, not a part of the phone's brain. The processor, memory, and storage that run apps — and AI models — work the same with or without it.
Cloud AI assistants need a connection because the actual thinking happens on a server somewhere else. Your phone sends the question, the server runs the model, and the answer comes back. No connection, no answer. On-device AI flips that around: the model itself lives on your phone, so the thinking happens locally. The phone's processor runs the model, and the answer is generated right there on the device. No server, no connection, no SIM card needed.
That is the entire distinction. If the AI lives in the cloud, it needs the internet. If it lives on your phone, it needs nothing at all once it is installed.
What you need to set up first (while you have Wi-Fi)
Offline AI is not magic — there is one step that does need the internet, and it has to happen before you go SIM-less. You need to download the model itself, and that is the only download that matters.
Download the app. Get your on-device AI app from the App Store or Google Play while you have Wi-Fi. LLM Hub, for example, is available on both Android and iOS, and it needs no account to use, so there is nothing to sign in to and no server to register with.
Download a model. Inside the app, pick a model and download it over Wi-Fi. A capable small model in the 3B to 8B range typically takes 2 to 4 GB of storage. Smaller models are faster and lighter; larger ones give better answers but need more space and a newer phone. If you are setting up an older spare phone, start with a 3B model — it runs well on most phones from the last few years.
Check your storage. Models are the biggest thing on the device after your photos. Before downloading, check that you have enough free space, and delete anything you do not need. You can delete a model later and download a different one, so you are never locked in.
Test it offline. Once the model is downloaded, switch the phone to airplane mode and try a chat. If it answers, you are done — that phone will now run AI anywhere, with or without a SIM card, with or without Wi-Fi.
What works on a Wi-Fi-only or SIM-less phone
Once the model is on the device, everything the model itself can do works exactly the same as it would on a phone with full service. The list is longer than most people expect:
Chatting and drafting. Ask questions, draft emails and messages, summarise notes, brainstorm ideas, and get help with everyday writing. The model does all of this locally, and your words never leave the phone.
Translation. An offline translator can translate text and conversations without an internet connection, which is exactly what you want when travelling with a Wi-Fi-only device and no roaming.
Voice transcription. Apps that use an on-device Whisper model can transcribe voice recordings and meetings on the phone itself. Record now, get the transcript now — no upload, no waiting for a server.
Image generation. On-device image models can generate and edit images without a connection. This is slower than cloud image generation, and the results depend on the model, but it works entirely offline.
Coding help. Small on-device coding assistants can explain code, suggest fixes, and help you draft scripts — handy on a spare phone kept at a workbench or in a workshop with no signal.
Voice chat. Voice assistants that run locally can hold a spoken conversation with no connection at all, which makes a SIM-less phone a surprisingly good language-practice or hands-free helper.
What does not work is anything that genuinely needs the internet: web searches, live information like weather or news, sending messages, backing up to the cloud, or syncing between devices. Those are network features, not AI features, and they stay unavailable until you are back on Wi-Fi. That is a fair trade for most people — the AI itself is the part you use most, and it never stops working.
Turning an old phone into a dedicated offline AI device
This is where a SIM-less phone becomes genuinely useful rather than just a curiosity. Almost everyone has an old phone in a drawer, and most of those phones are still perfectly capable of running a small AI model. Without a SIM card or a plan, that phone becomes a private, dedicated AI device — a second brain that costs nothing to run.
Here is a practical way to set one up:
- Factory reset it. Wipe the old phone so you start clean, with maximum free storage and no old accounts lingering.
- Connect to Wi-Fi once. Install your on-device AI app and download the model or models you want. This is the only time the phone needs a network.
- Set it up for its job. If it is a kitchen phone, load a model that is good at recipes and conversions. If it is a workshop phone, one that handles instructions and troubleshooting. If it is for the kids' homework, one that explains things clearly.
- Take it offline. Turn on airplane mode, or just leave it without a SIM. It will keep working as an AI assistant indefinitely, and because it never connects, there is no way for anything on it to leak anywhere.
A dedicated device like this is useful in places a normal phone is not: a kitchen with greasy hands, a garage, a kids' room where you do not want an internet-connected device, or a travel bag where you want a backup AI that works even if your main phone dies. And because it has no account and no connection, it is private by construction — the strongest privacy guarantee is a device that physically cannot send data anywhere.
Tablets, Wi-Fi-only devices, and phones with expired plans
The same logic applies to every device that never had a SIM card in the first place. A Wi-Fi-only iPad or Android tablet runs on-device AI just as well as a phone, and the bigger screen is genuinely nice for longer chats and reading generated text. The setup is identical: download the app and model over Wi-Fi, then use it anywhere.
A phone with an expired or cancelled plan is in the same position. The moment a plan lapses, the phone does not become useless — it becomes a Wi-Fi-only device, and everything in this guide applies to it. That is worth remembering before you trade in or recycle an old phone: a device with no plan still has years of useful life as an offline AI companion.
The one thing to watch on older devices is performance. A phone from five or six years ago will run a 3B model, but slowly, and it may struggle with an 8B model. Storage is the other constraint — if the phone only has 32 GB and most of it is full, there may not be room for a model. A quick cleanup before you start usually solves that.
The privacy upside of a phone that cannot phone home
There is a privacy benefit to a SIM-less AI device that goes beyond the usual on-device privacy story. An on-device AI app already keeps your prompts on your phone — no account, no tracking, no sync. But a phone with a SIM card and mobile data still has a network connection, and in principle some other app on the device could send data out.
A phone with no SIM and airplane mode on has no route out at all. It is not just that the AI app does not send your data — it is that nothing on the device can. For sensitive uses — journaling, brainstorming an unreleased idea, working with confidential documents, or helping kids with homework — that is the strongest privacy setup you can get short of leaving the phone at home. Your chats stay on the device because there is nowhere else for them to go.
The bottom line
A SIM card is a key to a mobile network, and on-device AI does not use a mobile network. Download the model once over Wi-Fi, and your phone will chat, translate, transcribe, generate images, and help you write code with no SIM card, no plan, and no signal — on a plane, in a dead zone, or on an old phone that has not had service in years.
If you have a spare phone sitting in a drawer, it is worth ten minutes of setup to find out. Connect it to Wi-Fi, install LLM Hub, download a small model like Gemma or Llama, and then pull the SIM and switch on airplane mode. Ask it something. When it answers, you will have a private AI device that costs nothing to run and works anywhere — which is more than you can say for any cloud assistant.

