#ONNX Inferencing

2 messages · Page 1 of 1 (latest)

somber hornet Dec 4, 2023, 8:19 AM

Hi, I'm currently exploring HuggingFace transformer for named entity recognition use case, I found this repo cahya/bert-base-indonesian-NER.
I've sucessfully run it on my local machine and make an inferencing.

Now, I'm trying to convert it into .onnx format, then also make an inferencing to make sure the model yield the same result.
I got the model in .onnx format, but I do not know how to make an inferencing with the .onnx model, can someone help me with this?

Thanks 🙇‍♂️

cold spruce Dec 5, 2023, 3:21 PM

This really helped me figure it out. With this and a bit of API reading you'll get it. https://colab.research.google.com/github/neuml/txtai/blob/master/examples/18_Export_and_run_models_with_ONNX.ipynb#scrollTo=RImohEnFyFg0

Google Colaboratory