Skip to content
ReviewRamble

The weekly brief

AI, reviewed, in your inbox.

  • New reviews of tools, models, MCP servers and repos, with the verdict up front
  • Re-checked prices and ratings when something changes
  • New analysis pieces as they are published

Models, agents, MCP servers and the tools actually worth your time.

One email a week. Unsubscribe with the link in any brief. How we use your email

Models and how they work

What language and other AI models are, how they are built and sized, and the words used to describe them.

Attention mechanism
An attention mechanism lets a neural network decide, for each token it processes, how much weight to give every other token in the input. Self-attention is the core operation inside a transformer.
Autoregressive model
An autoregressive model generates a sequence one piece at a time, predicting each next token from all the tokens before it and feeding that output back in. Most large language models work this way.
Base model
A base model is a language model straight out of pretraining, before instruction tuning or human-feedback training. It continues whatever text it is given rather than following instructions or holding a conversation.
Context window
A context window is the maximum amount of text, counted in tokens, that a language model can consider at once, covering the system prompt, conversation, documents, tool results and the response it writes.
Diffusion language model
A diffusion language model (dLLM) generates text by starting from a fully masked or noisy sequence and refining many token positions in parallel over several steps, instead of writing one token at a time.
Foundation model
A foundation model is a large model trained on broad data at scale that can be adapted to many different downstream tasks, through prompting or fine-tuning, instead of being built for one task.
Frontier model
A frontier model is one of the most capable general-purpose AI models available at a given time, usually from a well-funded lab. The term is relative and also appears in AI safety policy.
GGUF
GGUF is a binary file format for storing a model's weights, tokenizer and metadata in one file, built for fast loading and local inference with GGML-based tools such as llama.cpp, often in quantized form.
Hallucination (AI)
A hallucination is output from an AI model that sounds fluent and confident but is false, unsupported by its sources or made up, such as an invented citation, quote, statistic or API function.
Instruct model
An instruct model is a base language model that has been further trained on instructions paired with good answers, and often on human feedback, so it follows requests instead of just continuing text.
Knowledge cutoff
A knowledge cutoff is the date after which a model has little or no information, because its training data was collected up to around then. Events after it are unknown unless supplied in the prompt.
Knowledge distillation
Knowledge distillation is a training method in which a smaller student model learns to imitate a larger teacher model's outputs, producing a distilled model that keeps much of the teacher's skill at lower cost.
Large language model
A large language model (LLM) is a neural network with billions of parameters, trained on large amounts of text to predict the next token, which lets it write, answer questions, summarise and follow instructions.
Mixture of experts
Mixture of experts (MoE) is a model design in which each layer holds several expert sub-networks and a router sends each token to only a few of them, so only part of the model runs per token.
Model license
A model license is the legal terms under which a model's weights, and sometimes its code and data, may be used, changed and shared. Terms range from permissive open licences to non-commercial or custom restricted ones.
Model parameters
Model parameters are the numbers a neural network learns in training, mostly weights. The parameter count, written as 7B for seven billion, is the usual shorthand for a model's size.
Model weights
Model weights are the learned numbers inside a neural network, set during training, that decide how it turns input into output. A checkpoint is a saved file or set of files containing those weights.
Multimodal model
A multimodal model is an AI model that can take in, and sometimes produce, more than one kind of data, such as text, images, audio or video, within a single model rather than through separate systems.
ONNX
ONNX (Open Neural Network Exchange) is an open file format for machine learning models. It describes a model as a graph of standard operators so it can be trained in one framework and run in another.
Open source AI
Open source AI is an AI system released under terms that let anyone use, study, modify and share it, with access to the parts needed to change it: training data information, full code and model parameters.
Open-weight model
An open-weight model is a model whose trained weights are published for anyone to download and run, often without the training code or full training data, so it is not necessarily open source.
Pretraining
Pretraining is the first and largest stage of training a model, where it learns general patterns from a very large unlabelled dataset, usually by predicting the next token, before any task-specific tuning.
Quantization
Quantization is a technique that stores a model's weights, and sometimes activations, with fewer bits, such as 8 or 4 instead of 16, so the model needs less memory and often runs faster, at some cost in accuracy.
Reasoning model
A reasoning model is a language model trained to work through a problem in a stream of intermediate thinking tokens before giving its final answer, which tends to help on maths, coding and multi-step tasks.
Safetensors
Safetensors is a file format from Hugging Face for storing model weights. Unlike Python pickle files, loading it cannot run hidden code, and it supports fast, memory-mapped loading of individual tensors.
Small language model
A small language model (SLM) is a language model with relatively few parameters, usually a few billion or fewer, built to run on a laptop, phone or single GPU at lower cost than a large model.
State space model
A state space model (SSM) is a sequence model that carries a fixed-size hidden state forward as it reads each token, so its cost grows linearly with input length. Mamba is the best-known example.
Test-time compute
Test-time compute is the amount of computation a model spends while answering a request, rather than during training. Letting a model think longer or try several answers can improve results on hard problems.
Token (LLM)
A token (LLM) is the basic unit of text a language model reads and writes, often a word, part of a word, a punctuation mark or a byte. Prices, speed and context limits are all counted in tokens.
Tokenizer
A tokenizer is the component that splits text into tokens and turns them into numeric IDs a language model can process, then turns the model's output IDs back into text.
Transformer (architecture)
The transformer is a neural network architecture, introduced in 2017, that processes sequences using attention instead of recurrence. It is the basis of nearly all current large language models and many image and audio models.
Vision-language model
A vision-language model (VLM) is a model that takes images and text as input and produces text, so it can describe pictures, answer questions about them, read documents and extract data from screenshots.
Weight-space programming
Weight-space programming is a proposed capability in which a language model reads a neural network's weights to work out what it computes, then writes or edits those weights directly, without gradient training, much as a programmer edits code.
World model
A world model is an AI model that learns how an environment works well enough to predict what happens next, often from video or sensor data, so an agent can plan or train inside the simulation.