Marketing LLMs and open models6 min read

Small language model for marketing: which jobs a 4B model can do, measured against a model nearly 170 times its size

A small language model handles narrow, repeated marketing jobs well and broad reasoning badly. Thoughtworks' new Radar advice, checked against our scores.

By overads Inc., the team building gloofy

A small language model is a language model with a few billion parameters rather than hundreds of billions, small enough to run on one laptop or a cheap server. For marketing, it suits narrow jobs repeated at volume, such as tagging creative, classifying leads or pulling fields out of briefs, and it does poorly at multi-step reasoning, arithmetic and research. On one such job, tagging real ads, our 4B model scores within measurement error of a 675B model.

What changed this month: small models moved to Trial

Thoughtworks publishes a Technology Radar twice a year, rating techniques by how far it would recommend them: Hold, Assess, Trial or Adopt. In the November 2026 edition, its entry on small language models, last updated on 4 November, moved from Assess to Trial, meaning teams should now try them on real work rather than only evaluate them.

The entry makes four points worth knowing:

  • The industry is moving away from treating bigger as better, towards better training data, distillation and quantisation.
  • Rising costs of running large models are pushing teams to choose a model per task rather than one model for everything.
  • Teams have found small models effective for narrow, high-frequency tasks: summarisation, structured data extraction, intent classification for routing requests, and basic coding.
  • Unless an agent needs multi-step reasoning or reliable tool calling, Thoughtworks suggests considering a small model as the cheaper and faster option.

The history on the same page shows how the view moved. In April 2026 it named Phi-4-mini, Ministral 3 3B, Qwen3-0.6B and Gemma-3-270M as examples, and still rated the technique Assess. The November text names no models. The change is in the confidence, not the list.

How small is a small language model?

There is no fixed line. Thoughtworks' 2024 entry described small models as usually 3.5 to 10 billion parameters, and other guides stretch the range to 14 billion. A more useful test is practical: a small model runs on hardware you already own. Our released 4B model, gloofy-1-nano, ships as a 4-bit GGUF file of about 2.5 GB and runs offline on a laptop with 8 GB of RAM, as its model specifications state.

Size also matters less than people expect once the task is narrow. When we chose a size for our own model, we trained the same data at 1.7B, 4B and 8B. The 8B version scored 0.741 against 0.780 for the 4B, and a later 14B version, trained on cleaner labels, added only 0.008 over a 4B on the same labels. The constraint was the data, not the parameter count.

Small language model vs LLM on a marketing task

The best evidence we can offer is our own public benchmark. Exam v3.3 scores 150 real published ads on five labels (hook, angle, persona, offer and funnel stage) by exact match, and every model gets the same specification. That is structured data extraction, the second task type on Thoughtworks' list.

ModelParametersExam v3.3
Mistral Large 3675B0.825
gloofy-14B (Opus labels)14B0.816
gloofy-4B (Opus labels)4B0.808
gloofy-4B r25, released4B0.796
Kimi K2.5mixture of experts0.791
Gemma 3 27B27B0.731
Llama 3 70B70B0.725
GPT-OSS 120B120B0.701

At 150 items, the top three are within about one standard error of each other, so the honest reading is a tie with Mistral Large 3, not a win. The 4B models score above 70B and 120B general models on this task. Three caveats limit what the table shows. The gloofy models carry the label scheme in their weights while every other model reads it in the prompt. The top two gloofy models were trained on Claude Opus labels, and Claude Opus also re-adjudicated the answer key. And current Claude, GPT and Gemini models were not measured on v3.3, so it says nothing about where small models sit against them. On the last exam that included them, they scored above our model. The full board is on our public marketing benchmark.

Where small language models fail

The same measurements show where small models are not enough, and they match Thoughtworks' exclusions closely.

  1. Arithmetic. On campaign setup questions that needed calculations, the untrained Qwen3-4B base scored 0.09 and our fine-tune 0.02. Neither can be trusted with a budget split. Give the sums to a calculator or a larger model.
  2. Diagnosis and open reasoning. On campaign diagnosis, judged blind, the small base model beat our own adapter 9 to 1, and neither is a substitute for a frontier model on strategy. Multi-step reasoning is exactly what the Radar excludes.
  3. Facts it is trained on rather than told. Our fine-tune applied Meta's 9:16 safe zones in 5 of 10 cases; the base model, told the margins in its prompt, managed 9 of 10. Small models follow stated rules well. Training rules into them cost instruction-following, as covered in when to fine-tune an LLM.
  4. Noise on small tests. Three training runs that differed only by random seed spread up to 0.34 on ten-item slices. A small model that looks better on twenty examples may only be luckier.

Which marketing jobs suit a small model

Mapping Thoughtworks' four task types onto marketing work gives a short list.

Marketing jobTask typeSmall model?
Tagging hooks, angles and offers in ad creativeStructured extractionYes, measured above
Scoring and routing inbound leadsClassificationYes, with stated rules; our lead bands score 0.83
Summarising reviews, transcripts and briefsSummarisationYes, for first drafts people check
Checking copy against character limits and safe zonesRule followingYes, with the rules in the prompt
Writing short-form video hooksGeneration, narrowYes after fine-tuning; ours beat its base 36 to 9
Budget maths, campaign diagnosis, strategyReasoning and arithmeticNo, use a larger model

The pattern is the one in the Radar: small models handle the high-volume, well-defined part of the work, and a larger model handles the judgement calls. Whether a small model should also be specialised for marketing is a separate question. Most teams will end up running both.

Where gloofy fits, and where it does not

gloofy-1-nano is a small language model for exactly the first rows of that table: tagging creative, qualifying leads and writing video hooks, on your own machine, under Apache 2.0. The released files and the 14B adapter are listed under the gloofy models. It is not a general assistant, it does not do sums, and on campaign diagnosis we ship the untrained base model because it beat our adapter.

If you are deciding whether to run a small model locally at all, our guide to a local LLM for marketing covers hardware and licences. More on open and small models collects in the marketing LLMs and open models hub.

What to do this week

  • List the marketing tasks you send to a frontier model and mark which are extraction, classification or summarisation.
  • Build a test set of 50 real examples for the highest-volume one, and score a small model on it with your rules written into the prompt.
  • Keep arithmetic, diagnosis and strategy on a larger model, and route only the narrow tasks to the small one.
  • Score the exact file you will run, quantised, not the full-precision version.

FAQ

What is a small language model?

A small language model is a language model with a few billion parameters, typically under about 14 billion, compact enough to run on a laptop or a single modest server. It costs less and answers faster than a large model, and it works best on narrow, repeated tasks with clear rules rather than open-ended reasoning or research.

Is a small language model good enough for marketing?

For narrow jobs, often yes. On our public exam of 150 real ads, a 4B model tagging hooks, angles and offers scored within measurement error of a 675B model. For strategy, campaign diagnosis and budget arithmetic, small models fall short, and in our tests a 4B base model scored 0.09 on campaign arithmetic.

What is the difference between an SLM and an LLM?

Mostly scale. Both use the same transformer architecture, but a large model has tens or hundreds of billions of parameters and broad knowledge, while a small model has a few billion and runs on local hardware. Large models reason more broadly; small models are cheaper, faster and private, and can match them on narrow tasks.

Does Thoughtworks recommend small language models?

Its Technology Radar moved small language models from Assess to Trial in November 2026. It says teams have found them effective for summarisation, structured extraction, intent classification and basic coding, and suggests considering them unless a task needs multi-step reasoning or reliable tool calling.

Sources

  1. Thoughtworks, "Small language models", Technology Radar, last updated 4 Nov 2026
  2. overads Inc., "marketing-bench leaderboard", gloofy_bench
  3. overads Inc., "gloofy-1-nano model card", Hugging Face