Hugging Face's logo

llmware
/
qwen2.5-coder-7b-instruct-ov

OpenVINO
qwen2
green
llmware-chat
p7
ov
Model card Files
xet
Community

qwen2.5-coder-7b-instruct-ov

qwen2.5-coder-7b-instruct-ov is an OpenVino int4 quantized version of Qwen2.5-Coder-7B-Instruct, providing a fast inference implementation, optimized for AI PCs using Intel GPU, CPU and NPU.

This is from the latest release series from Qwen, and is an excellent chat/instruct coding assistant model.

Model Description

  • Developed by: Qwen
  • Quantized by: llmware
  • Model type: qwen2.5
  • Parameters: 7 billion
  • Model Parent: Qwen/Qwen2.5-Coder-7B-Instruct
  • Language(s) (NLP): English
  • License: Apache 2.0
  • Uses: Chat, general-purpose LLM
  • Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website

Downloads last month
3
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for llmware/qwen2.5-coder-7b-instruct-ov

Base model

Qwen/Qwen2.5-7B
Finetuned
Qwen/Qwen2.5-Coder-7B
Finetuned
Qwen/Qwen2.5-Coder-7B-Instruct
Quantized
(165)
this model

Collection including llmware/qwen2.5-coder-7b-instruct-ov