vllm-npu-plugin

zzh/vllm-npu-plugin

Fork 0

mirror of https://github.com/handsomezhuzhu/vllm-npu-plugin.git synced 2026-02-20 19:50:15 +00:00

Commit Graph

Author	SHA1	Message	Date
handsomezhuzhu	4ca9d52cf2	feat: Add Ascend NPU attention backend with NPU-specific FlashAttention, LayerNorm, and Rotary Embedding implementations.	2026-02-10 21:56:45 +08:00
handsomezhuzhu	e75504df72	feat: initial vllm-npu-plugin for Ascend NPU adaptation - NPUPlatform: device management, HCCL process group, config adaptation - AscendAttentionBackend: npu_fusion_attention (prefill) + npu_incre_flash_attention (decode) - NPUCommunicator: HCCL-based distributed communication - NPUWorker: NPU device init, memory profiling - Custom ops: SiluAndMul, RMS norm, rotary embedding - Plugin registered via vllm.platform_plugins entry point Based on vllm-ascend official pattern, targeting Ascend 910B	2026-02-10 11:06:01 +08:00

Author

SHA1

Message

Date

handsomezhuzhu

4ca9d52cf2

feat: Add Ascend NPU attention backend with NPU-specific FlashAttention, LayerNorm, and Rotary Embedding implementations.

2026-02-10 21:56:45 +08:00

handsomezhuzhu

e75504df72

feat: initial vllm-npu-plugin for Ascend NPU adaptation

- NPUPlatform: device management, HCCL process group, config adaptation
- AscendAttentionBackend: npu_fusion_attention (prefill) + npu_incre_flash_attention (decode)
- NPUCommunicator: HCCL-based distributed communication
- NPUWorker: NPU device init, memory profiling
- Custom ops: SiluAndMul, RMS norm, rotary embedding
- Plugin registered via vllm.platform_plugins entry point

Based on vllm-ascend official pattern, targeting Ascend 910B

2026-02-10 11:06:01 +08:00

2 Commits