Packet To Sniff

Results for "context window"

  1. Article · LLM foundations

    What is a context window in an LLM?

    The context window is the maximum number of tokens a language model can consider at once. Learn what fills it, what happens when it overflows, and how to budget it.

  2. Article · LLM foundations

    Why long context windows still miss things

    A million-token context window does not mean a model uses every token well. Learn about the lost-in-the-middle effect, attention cost, and how to test it yourself.

  3. Article · Retrieval-augmented generation

    How to chunk documents for RAG

    Chunking decides what your RAG system can retrieve. Compare fixed-size, recursive, heading-aware and semantic chunking, and learn how to pick size and overlap.

  4. Article · LLM foundations

    What is a token in an LLM?

    A token is the unit of text a language model reads and writes. Learn how tokenizers split text, why token counts differ by language, and why it matters for cost.

  5. Article · Retrieval-augmented generation

    How to evaluate a RAG system: retrieval and answer quality

    Measure a RAG system in two layers: did retrieval find the right passages, and is the answer faithful to them? Learn recall@k, MRR, faithfulness and a practical test set.

  6. Article · Retrieval-augmented generation

    What is retrieval-augmented generation (RAG)?

    RAG makes a language model answer from your own documents by retrieving relevant passages first. Learn the pipeline step by step, and when RAG is the right choice.

  7. Article · LLM foundations

    What are embeddings? Meaning as numbers, explained

    Embeddings turn text into lists of numbers so that similar meanings land close together. Learn how they work, how similarity is measured, and where they fail.

  8. Article · LLM foundations

    What is an LLM (Large Language Model)? A Complete Beginner-to-Builder Guide

    A beginner-to-builder guide to large language models: next-token prediction, the transformer and attention, how models are trained, and how to start a career.

  9. Article · Networking

    TCP vs UDP: differences, handshakes and when each is used

    TCP gives reliable, ordered delivery after a handshake; UDP sends independent datagrams. Compare headers, use cases, ports and how both look in Wireshark.