FixedSizeChunkingStrategy

Models & Types · AiDotNet.RetrievalAugmentedGeneration.ChunkingStrategies

A simple fixed-size text chunking strategy that splits text at character boundaries.

Inheritance: ChunkingStrategyBase → FixedSizeChunkingStrategy

For Beginners

This splits text into equal-sized pieces like slicing bread.

Think of it like cutting a loaf of bread into equal slices:

  • Each chunk is the same size (ChunkSize characters)
  • Slices overlap a bit (ChunkOverlap characters)
  • Cuts happen at any point, even mid-word

How it works:

  • ChunkSize = 500 means each piece is about 500 characters
  • ChunkOverlap = 50 means pieces overlap by 50 characters
  • No special handling for sentences or words

Good for:

  • Simple text processing
  • When you don’t care about word boundaries
  • Consistent chunk sizes
  • Fast processing

Not ideal for:

  • Preserving sentence meaning (might cut mid-sentence)
  • Code or structured data
  • When semantic coherence is critical

For example, with ChunkSize=20, ChunkOverlap=5: Input: “The quick brown fox jumps over the lazy dog” Chunk 1: “The quick brown fox “ (0-20) Chunk 2: “n fox jumps over the” (15-35) - overlaps with Chunk 1 Chunk 3: “ the lazy dog” (30-43) - overlaps with Chunk 2

How It Works

This implementation splits text into fixed-size chunks with optional overlap. It’s the simplest chunking strategy and works well for general text when semantic boundaries (sentences, paragraphs) are not critical. The chunking is purely character-based and does not consider word or sentence boundaries.

Constructors

Constructor Summary
FixedSizeChunkingStrategy(int chunkSize, int chunkOverlap) Initializes a new instance of the FixedSizeChunkingStrategy class.