PaddleOCR-VL-GGUF

PaddleOCR-VL GGUF for llama.cpp

PR: https://github.com/ggml-org/llama.cpp/pull/18825

Test with some images:

1. A receipt

with command:

./build/bin/llama-cli -m /media/shun/bigdata/Models/PaddleOCR_VL_SFT/PaddleOCR-VL-GGUF.gguf \
  --mmproj /media/shun/bigdata/Models/PaddleOCR_VL_SFT/PaddleOCR-VL-GGUF-mmproj.gguf \
  --color on\
  --image /home/shun/Pictures/1640.jpeg \
  --prompt "OCR:"

1. A table

with command:

./build/bin/llama-cli -m /media/shun/bigdata/Models/PaddleOCR_VL_SFT/PaddleOCR-VL-GGUF.gguf \
  --mmproj /media/shun/bigdata/Models/PaddleOCR_VL_SFT/PaddleOCR-VL-GGUF-mmproj.gguf \
  --color on\
  --image /home/shun/Pictures/paddleocr.jpg \
  --prompt "Table Recognition:"

can be formatted:

SDK下载

#安装ModelScope
pip install modelscope

#SDK模型下载
from modelscope import snapshot_download
model_dir = snapshot_download('megemini/PaddleOCR-VL-GGUF')

Git下载

#Git模型下载
git clone https://www.modelscope.cn/megemini/PaddleOCR-VL-GGUF.git

如果您是本模型的贡献者，我们邀请您根据模型贡献文档，及时完善模型卡片内容。