LLM & Generative AI Tools
Interactive laboratories for tokenization, embeddings, attention matrices, softmax, temperature, and mini language models.
Available LLM & Generative AI Tools
20 utilitiesLLM Token Calculator & Estimator
Estimate token counts, words, characters, and API inference costs across OpenAI, Anthropic, Gemini, and Llama models.
Educational Tokenizer Simulator
Interactive educational tokenizer showing character splits, subword boundaries, token IDs, and vocabulary mappings in real-time.
Token Visualizer & Inspector
Visualize exact token boundaries, byte offsets, and frequency analysis with rich color coding for any text input.
2D Vector Embedding Visualizer
Visualize semantic embeddings in 2D vector space. Compare Cosine Similarity, Euclidean Distance, and semantic clustering.
Self-Attention Heatmap Visualizer
Interactive Scaled Dot-Product Attention matrix. Select any token to view real-time attention weights across the entire sentence.
Query-Key-Value (QKV) Numerical Playground
Interactive step-by-step matrix laboratory: inspect Q × Kᵀ dot products, division by √d_k, Softmax normalization, and weighted V sums.
Transformer Layer Architecture Visualizer
Interactive pipeline of a complete Transformer block: Embeddings, RoPE, RMSNorm, Multi-Head Attention, Residual Add, and SwiGLU FFN.
Next-Token Probability Predictor
Educational autoregressive next-token predictor showing vocabulary probability distributions and candidate ranking.
Softmax Activation Visualizer & Calculator
Convert real-valued logits into normalized probabilities. Inspect exponentiation, denominator summation, and temperature scaling.
LLM Temperature Playground
See how the Temperature hyperparameter flattens or sharpens the sampling probability distribution in real-time.
Top-K Sampling Playground
Simulate Top-K truncation filtering. Adjust K to prune unlikely tokens and view re-normalized probability distributions.
Top-P (Nucleus) Sampling Playground
Interactive nucleus sampling. Set cumulative probability threshold P (e.g. 0.90) to see dynamic candidate set selection.
LLM Generation Simulator
Watch an LLM generate text step by step: Tokenize → Forward Pass → Softmax → Sampling → Append → Repeat.
LLM Context Window Budget Visualizer
Visualize context window usage: System Prompt, User Prompt, Retrieved RAG chunks, Conversation History, and Output capacity.
LLM API Cost & Pricing Calculator
Calculate estimated monthly API costs based on daily requests, input/output token lengths across GPT-4o, Claude 3.5, and Llama 3.
LLM Parameter & VRAM Calculator
Calculate GPU VRAM requirements for model weights, KV-cache, and activations across FP16, INT8, and INT4 (4-bit) quantization.
Cross-Entropy Loss Laboratory
Explore Cross-Entropy Loss for next-token prediction. Adjust predicted target probability to see how loss scales logarithmically.
Backpropagation & Gradient Flow Lab
Interactive calculus chain rule simulator: adjust weights and inputs to trace forward outputs, loss, and reverse gradients.
LLM Training Loop Simulator
Simulate training an LLM across multiple epochs: batches, forward passes, cross-entropy loss, and AdamW weight updates with live loss curves.
Build a Mini Language Model in Browser
Train an educational language model on your own text corpus. Inspect vocabulary, forward predictions, training loss, and generate continuations.