Search results

Add fuzzing to crate

Status: Open.

#7 In instant-labs/instant-clip-tokenizer;

· michael-p opened on Nov 24, 2023

Cache tokenization results for individual words

Status: Open.

#5 In instant-labs/instant-clip-tokenizer;

· michael-p opened on Nov 24, 2023

Replace word-splitting regex with a custom parser

Status: Open.

#4 In instant-labs/instant-clip-tokenizer;

· michael-p opened on Nov 24, 2023

Make lowercasing input text responsibility of caller

Status: Open.

#3 In instant-labs/instant-clip-tokenizer;

· michael-p opened on Nov 24, 2023

Use custom error type for <code>Tokenizer::with_vocabulary</code>

Status: Open.

#2 In instant-labs/instant-clip-tokenizer;

· michael-p opened on Nov 24, 2023