Knowledge & Data · Software component
Overlapping Window Chunker
Software componentKnowledge & DataKnowledge & Dataarc:OverlappingWindowChunker
A document chunker that emits chunks sharing overlapping content with their neighbours so that context spanning boundaries remains retrievable.
Responsibility. Splits documents into overlapping chunks that preserve cross-boundary continuity.
Also known as: Overlapping chunks, Sliding-window chunking
Variant of Document Chunker abstract
When to choose. Choose when important context spans chunk or section boundaries and continuity must be preserved, accepting multiplied storage.
Relationships
is configured by structural
receives data from dynamic
sends data to dynamic
alternative to variability
Quantitative guidance
As stated by the sources; verify before use.
- 512-token chunks with 50-token (1-2 sentence) overlap balanced precision and context across diverse document types (Ch6.3A).
- Typical chunk size 500-1000 tokens with 10-20% overlap; example 800/120 (Ref7.07).
Classification
- Technologies
- LangChain RecursiveCharacterTextSplitter
- Quality attributes
- Functional suitability: correctness and validity (ISO/IEC 25010 | NIST AI RMF: valid)
- Risks mitigated
- Context fragmentation across chunk boundaries
Sources
- Ch5.8: T. Nguyen, "Semantic Memory," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 5.8. ISBN: 9798244538229.
- Ch6.3A: T. Nguyen, "ETL Pipeline Fundamentals," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.3A. ISBN: 9798244538229.
- Ref7.07: E. Li, V. Bellotti, R. Kraus, and R. Kao, "Build a retrieval-augmented generation (RAG) agent with NVIDIA Nemotron," NVIDIA Technical Blog, Sep. 23, 2025. [Online]. Available: https://developer.nvidia.com/blog/build-a-rag-agent-with-nvidia-nemotron/