Small language model for marketing: which jobs a 4B model can do, measured against a model nearly 170 times its size
A small language model handles narrow, repeated marketing jobs well and broad reasoning badly. Thoughtworks' new Radar advice, checked against our scores.
By overads Inc., the team building gloofy
A small language model is a language model with a few billion parameters rather than hundreds of billions, small enough to run on one laptop or a cheap server. For marketing, it suits narrow jobs repeated at volume, such as tagging creative, classifying leads or pulling fields out of briefs, and it does poorly at multi-step reasoning, arithmetic and research. On one such job, tagging real ads, our 4B model scores within measurement error of a 675B model.
What changed this month: small models moved to Trial
Thoughtworks publishes a Technology Radar twice a year, rating techniques by how far it would recommend them: Hold, Assess, Trial or Adopt. In the November 2026 edition, its entry on small language models, last updated on 4 November, moved from Assess to Trial, meaning teams should now try them on real work rather than only evaluate them.
The entry makes four points worth knowing:
- The industry is moving away from treating bigger as better, towards better training data, distillation and quantisation.
- Rising costs of running large models are pushing teams to choose a model per task rather than one model for everything.
- Teams have found small models effective for narrow, high-frequency tasks: summarisation, structured data extraction, intent classification for routing requests, and basic coding.
- Unless an agent needs multi-step reasoning or reliable tool calling, Thoughtworks suggests considering a small model as the cheaper and faster option.
The history on the same page shows how the view moved. In April 2026 it named Phi-4-mini, Ministral 3 3B, Qwen3-0.6B and Gemma-3-270M as examples, and still rated the technique Assess. The November text names no models. The change is in the confidence, not the list.
How small is a small language model?
There is no fixed line. Thoughtworks' 2024 entry described small models as usually 3.5 to 10 billion parameters, and other guides stretch the range to 14 billion. A more useful test is practical: a small model runs on hardware you already own. Our released 4B model, gloofy-1-nano, ships as a 4-bit GGUF file of about 2.5 GB and runs offline on a laptop with 8 GB of RAM, as its model specifications state.
Size also matters less than people expect once the task is narrow. When we chose a size for our own model, we trained the same data at 1.7B, 4B and 8B. The 8B version scored 0.741 against 0.780 for the 4B, and a later 14B version, trained on cleaner labels, added only 0.008 over a 4B on the same labels. The constraint was the data, not the parameter count.
Small language model vs LLM on a marketing task
The best evidence we can offer is our own public benchmark. Exam v3.3 scores 150 real published ads on five labels (hook, angle, persona, offer and funnel stage) by exact match, and every model gets the same specification. That is structured data extraction, the second task type on Thoughtworks' list.
| Model | Parameters | Exam v3.3 |
|---|---|---|
| Mistral Large 3 | 675B | 0.825 |
| gloofy-14B (Opus labels) | 14B | 0.816 |
| gloofy-4B (Opus labels) | 4B | 0.808 |
| gloofy-4B r25, released | 4B | 0.796 |
| Kimi K2.5 | mixture of experts | 0.791 |
| Gemma 3 27B | 27B | 0.731 |
| Llama 3 70B | 70B | 0.725 |
| GPT-OSS 120B | 120B | 0.701 |
At 150 items, the top three are within about one standard error of each other, so the honest reading is a tie with Mistral Large 3, not a win. The 4B models score above 70B and 120B general models on this task. Three caveats limit what the table shows. The gloofy models carry the label scheme in their weights while every other model reads it in the prompt. The top two gloofy models were trained on Claude Opus labels, and Claude Opus also re-adjudicated the answer key. And current Claude, GPT and Gemini models were not measured on v3.3, so it says nothing about where small models sit against them. On the last exam that included them, they scored above our model. The full board is on our public marketing benchmark.
Where small language models fail
The same measurements show where small models are not enough, and they match Thoughtworks' exclusions closely.
- Arithmetic. On campaign setup questions that needed calculations, the untrained Qwen3-4B base scored 0.09 and our fine-tune 0.02. Neither can be trusted with a budget split. Give the sums to a calculator or a larger model.
- Diagnosis and open reasoning. On campaign diagnosis, judged blind, the small base model beat our own adapter 9 to 1, and neither is a substitute for a frontier model on strategy. Multi-step reasoning is exactly what the Radar excludes.
- Facts it is trained on rather than told. Our fine-tune applied Meta's 9:16 safe zones in 5 of 10 cases; the base model, told the margins in its prompt, managed 9 of 10. Small models follow stated rules well. Training rules into them cost instruction-following, as covered in when to fine-tune an LLM.
- Noise on small tests. Three training runs that differed only by random seed spread up to 0.34 on ten-item slices. A small model that looks better on twenty examples may only be luckier.
Which marketing jobs suit a small model
Mapping Thoughtworks' four task types onto marketing work gives a short list.
| Marketing job | Task type | Small model? |
|---|---|---|
| Tagging hooks, angles and offers in ad creative | Structured extraction | Yes, measured above |
| Scoring and routing inbound leads | Classification | Yes, with stated rules; our lead bands score 0.83 |
| Summarising reviews, transcripts and briefs | Summarisation | Yes, for first drafts people check |
| Checking copy against character limits and safe zones | Rule following | Yes, with the rules in the prompt |
| Writing short-form video hooks | Generation, narrow | Yes after fine-tuning; ours beat its base 36 to 9 |
| Budget maths, campaign diagnosis, strategy | Reasoning and arithmetic | No, use a larger model |
The pattern is the one in the Radar: small models handle the high-volume, well-defined part of the work, and a larger model handles the judgement calls. Whether a small model should also be specialised for marketing is a separate question. Most teams will end up running both.
Where gloofy fits, and where it does not
gloofy-1-nano is a small language model for exactly the first rows of that table: tagging creative, qualifying leads and writing video hooks, on your own machine, under Apache 2.0. The released files and the 14B adapter are listed under the gloofy models. It is not a general assistant, it does not do sums, and on campaign diagnosis we ship the untrained base model because it beat our adapter.
If you are deciding whether to run a small model locally at all, our guide to a local LLM for marketing covers hardware and licences. More on open and small models collects in the marketing LLMs and open models hub.
What to do this week
- List the marketing tasks you send to a frontier model and mark which are extraction, classification or summarisation.
- Build a test set of 50 real examples for the highest-volume one, and score a small model on it with your rules written into the prompt.
- Keep arithmetic, diagnosis and strategy on a larger model, and route only the narrow tasks to the small one.
- Score the exact file you will run, quantised, not the full-precision version.
FAQ
What is a small language model?
A small language model is a language model with a few billion parameters, typically under about 14 billion, compact enough to run on a laptop or a single modest server. It costs less and answers faster than a large model, and it works best on narrow, repeated tasks with clear rules rather than open-ended reasoning or research.
Is a small language model good enough for marketing?
For narrow jobs, often yes. On our public exam of 150 real ads, a 4B model tagging hooks, angles and offers scored within measurement error of a 675B model. For strategy, campaign diagnosis and budget arithmetic, small models fall short, and in our tests a 4B base model scored 0.09 on campaign arithmetic.
What is the difference between an SLM and an LLM?
Mostly scale. Both use the same transformer architecture, but a large model has tens or hundreds of billions of parameters and broad knowledge, while a small model has a few billion and runs on local hardware. Large models reason more broadly; small models are cheaper, faster and private, and can match them on narrow tasks.
Does Thoughtworks recommend small language models?
Its Technology Radar moved small language models from Assess to Trial in November 2026. It says teams have found them effective for summarisation, structured extraction, intent classification and basic coding, and suggests considering them unless a task needs multi-step reasoning or reliable tool calling.