Tools
These calculators run in the browser. The input is not sent anywhere.
- Vector dot product
The tool multiplies two equal-length vectors position by position and adds the products.
- Softmax
The tool turns a list of scores into probabilities that sum to 1.
- Tokenizer
The tool encodes text with the GPT-2 tokenizer and shows the token strings and ids.
- Temperature
The tool divides logits by a temperature and shows the softmax.
- Matrix multiply
The tool multiplies a small matrix by a vector and shows each row’s dot product.
Not written yet
- Attention heatmap
The tool shows a causal attention weight matrix for a typed list of scores.
Not written yet
- BPE trainer
The tool runs byte-pair encoding on a fixed toy corpus and lists each merge.
Not written yet
- Positional encoding
The tool adds a token vector and a position vector elementwise.
Not written yet
- Nearest embedding
The tool lists the nearest tokens to a chosen token in a committed slice of embeddings.
Not written yet
- Forward-pass stepper
The tool steps through a tiny forward pass with hidden size 4 and a 4-word vocabulary.
Not written yet
- Sampling compare
The tool shows greedy, temperature, top-k, and top-p on one list of logits.
Not written yet