Gen AI

Transformers, LLMs, RAG, Agents, and the generative AI stack

Llm Foundations

Gen AI
Embeddings
Turning words into coordinates, so that things with similar meanings end up close together and a computer can measure how related they are.
Gen AI
Tokenization
How a language model chops your text into bite-sized pieces called tokens, then swaps each one for a number it can actually do math on.

Rag

Gen AI
Retrieval-Augmented Generation (RAG)
Giving a language model an open book: before it answers, it looks up relevant facts and reads them into its prompt, so replies stay grounded and current.

Transformers