Recursive Chunking
RecursiveChunking splits documents at natural break points like newlines and sentence endings.
Recursive chunking is a method of splitting documents into smaller chunks by finding natural break points, like newlines and sentence endings, within the chunk size limit. This is useful when you want to process large documents in smaller, manageable pieces.
| Parameter | Type | Default | Description |
|---|---|---|---|
chunk_size | int | 5000 | The maximum size of each chunk. |
overlap | int | 0 | The number of characters to overlap between chunks. |