Chonkie Documentation

from chonkie.cloud import TokenChunker 

chunker = TokenChunker(api_key="{api_key}") 

chunks = chunker(text='YOUR_TEXT')

[
  {
    "text": "<string>",
    "start_index": 123,
    "end_index": 123,
    "token_count": 123
  }
]

Authorization

string

header

required

multipart/form-data

200 - application/json

Successful Response: A list of Chunk objects.

A list containing Chunk objects, each detailing a segment of the original text based on token count.

from chonkie.cloud import TokenChunker 

chunker = TokenChunker(api_key="{api_key}") 

chunks = chunker(text='YOUR_TEXT')

[
  {
    "text": "<string>",
    "start_index": 123,
    "end_index": 123,
    "token_count": 123
  }
]

Token Chunker