zzh/vllm-npu-plugin
1
0
Fork 0
mirror of https://github.com/handsomezhuzhu/vllm-npu-plugin.git synced 2026-02-20 19:50:15 +00:00
Code Issues Packages Projects Releases Wiki Activity
8 Commits 1 Branch 0 Tags
b8b4516b988847968bfbacd8fcc87a5427773e37
Commit Graph

4 Commits

Author SHA1 Message Date
handsomezhuzhu
b8b4516b98 fix: replace ATB reshape_and_cache with pure PyTorch indexing 2026-02-10 19:56:47 +08:00
handsomezhuzhu
7120cd803b fix: KV cache shape needs leading 2 dim for key+value pair 2026-02-10 19:27:10 +08:00
handsomezhuzhu
a274fd82ad fix: accept cache_dtype_str in get_kv_cache_shape 2026-02-10 19:23:20 +08:00
handsomezhuzhu
e75504df72 feat: initial vllm-npu-plugin for Ascend NPU adaptation 
- NPUPlatform: device management, HCCL process group, config adaptation
- AscendAttentionBackend: npu_fusion_attention (prefill) + npu_incre_flash_attention (decode)
- NPUCommunicator: HCCL-based distributed communication
- NPUWorker: NPU device init, memory profiling
- Custom ops: SiluAndMul, RMS norm, rotary embedding
- Plugin registered via vllm.platform_plugins entry point

Based on vllm-ascend official pattern, targeting Ascend 910B
 2026-02-10 11:06:01 +08:00