@naveen521kk/expo-hf-tokenizers

Port of HuggingFace's tokenizers using Expo Modules for React Native Apps


Keywords
react-native, expo, expo-hf-tokenizers, ExpoHfTokenizers, tokenizers, HuggingFace, tokenizer
License
MIT
Install
npm install @naveen521kk/expo-hf-tokenizers@0.1.0

Documentation

@naveen521kk/expo-hf-tokenizers

Port of HuggingFace's tokenizers using Expo Modules for React Native Apps.

Installation in managed Expo projects

For managed Expo projects, install the npm package and start using.

Note that you would need a development client while developing and will not work with Expo Go.

Installation in bare React Native projects

For bare React Native projects, you must ensure that you have installed and configured the expo package before continuing.

Add the package to your npm dependencies

npm install @naveen521kk/expo-hf-tokenizers

Example

See example folder for a simple example on how to use it.

See this file for a list of exported functions available.

Contributing

Contributions are very welcome!