Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: openai/tiktoken
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: main
Choose a base ref
...
head repository: devchat-ai/tiktoken
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: main
Choose a head ref
Checking mergeability… Don’t worry, you can still create the pull request.
  • 6 commits
  • 6 files changed
  • 2 contributors

Commits on May 14, 2024

  1. Configuration menu
    Copy the full SHA
    f88d01f View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. update to 0.7.0

    yangbobo2021 committed May 15, 2024
    Configuration menu
    Copy the full SHA
    7f7c9a3 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    01de9f4 View commit details
    Browse the repository at this point in the history

Commits on May 18, 2024

  1. feat: Improve error handling in CoreBPE.encode_ordinary()

    The code changes in this commit add error handling to the `encode_ordinary()` method in the `CoreBPE` class. Previously, the method would raise an exception if an error occurred during the encoding process. With this change, the method now catches any exceptions and returns an empty list instead.
    
    This commit addresses the need for robust error handling in the `encode_ordinary()` method, ensuring that the code gracefully handles any unexpected errors and prevents them from propagating further.
    
    Co-authored-by: Lőrinc Pap <[email protected]>
    yangbobo2021 and l0rinc committed May 18, 2024
    Configuration menu
    Copy the full SHA
    b269401 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d4cd729 View commit details
    Browse the repository at this point in the history

Commits on May 19, 2024

  1. Configuration menu
    Copy the full SHA
    da97858 View commit details
    Browse the repository at this point in the history
Loading