A high level package for Nvidia Triton requests
pip install triton-requests==0.0.3
Python package to interact with Nvidia Triton Server
from triton_requests import TritonEndPoint
tep = TritonEndPoint(model_name="emotion-english-distilroberta-base_onnx_inference", url="localhost:9000")
tep.encode("Harry is really happy after his present")
Will result a numpy array
array([[-1.1953125 , -2.4921875 , -2.8964844 , 4.9921875 , 0.35498047, 0.70458984, 1.9570312 ]], dtype=float32)
The Tidelift Subscription provides access to a continuously curated stream of human-researched and maintainer-verified data on open source packages and their licenses, releases, vulnerabilities, and development practices.
Learn more →Something wrong with this page? Make a suggestion
Export .ABOUT file for this package
Last synced: 2023-08-02 17:35:14 UTC
Login to resync this project