Port of HuggingFace's tokenizers using Expo Modules for React Native Apps.
For managed Expo projects, install the npm package and start using.
Note that you would need a development client while developing and will not work with Expo Go.
For bare React Native projects, you must ensure that you have installed and configured the expo
package before continuing.
npm install @naveen521kk/expo-hf-tokenizers
See example folder for a simple example on how to use it.
See this file for a list of exported functions available.
Contributions are very welcome!