Qwen3-1.7B-int4-sym-ov-npu
113 downloads
0 likes
on ModelScope
updated
Model card
Description
This is Qwen/Qwen3-1.7B model converted to the OpenVINO™ IR (Intermediate Representation) format with weights compressed to INT4 by NNCF.
Quantization Parameters
Weight compression was performed using nncf.compress_weights with the following parameters:
mode: INT4_SYM
group_size: -1
ratio: 1.0