Python
from chonkie.cloud import SentenceChunker 

chunker = SentenceChunker(api_key="{api_key}") 

chunks = chunker(text="YOUR_TEXT")
[
  {
    "text": "<string>",
    "start_index": 123,
    "end_index": 123,
    "token_count": 123,
    "sentences": [
      {
        "text": "<string>",
        "start_index": 123,
        "end_index": 123
      }
    ]
  }
]

Authorizations

​
Authorization
string
header
required

Your API Key from the Chonkie Cloud dashboard

Body

multipart/form-data
​
file
file

The file to chunk.

​
tokenizer_or_token_counter
string
default:gpt2

Tokenizer or token counting function to use. Can be a string identifier or an instance.

​
chunk_size
integer
default:2048

Maximum number of tokens per chunk.

​
chunk_overlap
integer
default:0

Number of overlapping tokens between chunks.

​
min_sentences_per_chunk
integer
default:1

Minimum number of sentences to include in each chunk.

​
min_characters_per_sentence
integer
default:12

Minimum number of characters per sentence.

​
approximate
boolean
default:false

Use approximate token counting for faster processing (deprecated).

​
delim
default:[".","!","?","\n"]

Delimiters to split sentences on.

​
include_delim
enum<string> | null
default:prev

Include delimiters in the chunk text. If so, specify whether to include the previous or next delimiter.

Available options:
prev,
next
​
return_type
enum<string>
default:chunks

Whether to return chunks as text strings or as SentenceChunk objects.

Available options:
texts,
chunks

Response

200 - application/json

Successful Response: A list of SentenceChunk objects.

A list containing SentenceChunk objects, each detailing a segment of the original text and the sentences within it.

​
text
string

The actual text content of the chunk.

​
start_index
integer

The starting character index of the chunk within the original input text.

​
end_index
integer

The ending character index (exclusive) of the chunk within the original input text.

​
token_count
integer

The number of tokens in this specific chunk, according to the tokenizer used.

​
sentences
Sentence · object[]

List of Sentence objects contained within this chunk.