#Update vLMM to 0.12.0 or Nightly in order to use with PaddleOCR and HunyuanOCR
5 messages · Page 1 of 1 (latest)
I second to this, I think there's going to be lots of small to middle enterprises wanting to try the paddleocr-vl in runpod.
Yes, I'm trying to forking the repo but I have issue with workers stuck at initializing and build test running indefinitly. Only in one case I get a response from the model HunyuanOCR but the test logs were still running IDK.
I was able to use the template successfully by making these changes:
https://github.com/Loudsrl/worker-vllm/commit/5a089239669c4e371e7655e948d9abaa8ca327ae