Supported Models ================ .. list-table:: Supported Models :widths: 25 25 25 25 25 :header-rows: 1 * - Architecture - Models - Hugging Face Models - ModelScope Models - Quantization Models * - QWenLMHeadModel - Qwen1 - `Qwen/Qwen-1_8B-Chat `_ `Qwen/Qwen-7B-Chat `_ `Qwen/Qwen-14B-Chat `_ - `qwen/Qwen-1_8B-Chat `_ `qwen/Qwen-7B-Chat `_ `qwen/Qwen-14B-Chat `_ - \ * - Qwen2ForCausalLM - Qwen1.5 Qwen2 - `Qwen/Qwen1.5-7B-Chat `_ `Qwen/Qwen1.5-14B-Chat `_ - `qwen/Qwen1.5-7B-Chat `_ `qwen/Qwen1.5-14B-Chat `_ `qwen/Qwen2-72B-Instruct `_ - `qwen/Qwen2-72B-Instruct-GPTQ-Int4 `_ `qwen/Qwen2-72B-Instruct-GPTQ-Int8 `_ * - Qwen2MoeForCausalLM - Qwen1.5 MoE Qwen2 MoE - \ - `qwen/Qwen1.5-MoE-A2.7B-Chat `_ - * - LlamaForCausalLM - LLaMA-2 LLaMA-3 - `meta-llama/Llama-2-7b-chat-hf `_ `meta-llama/Llama-2-13b-chat-hf `_ `meta-llama/Meta-Llama-3-8B-Instruct `_ - `modelscope/Llama-2-7b-chat-ms `_ `modelscope/Llama-2-13b-chat-ms `_ `modelscope/Meta-Llama-3-8B-Instruct `_ - \ * - ChatGLMModel - ChatGLM - `THUDM/glm-4-9b-chat `_ - `ZhipuAI/glm-4-9b-chat `_ - \