RecursiveChunker

The RecursiveChunker class specializes in dividing text into smaller, more manageable sections using a recursive method. This allows for various levels of granularity depending on the specified separators.

​

Properties

Required properties:

• None

Optional properties:

• chunk_size: The target size for each text chunk.
• chunk_overlap: The amount of overlap desired between adjacent text chunks.
• batch_size: The number of text chunks to process together.
• separators: A list of strings used to split the text at different granularity levels.