Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mooncake Transfer Engine 支持华为的Ascend昇腾平台和NPU显卡吗 #34

Open
zhaofangtao opened this issue Dec 13, 2024 · 1 comment

Comments

@zhaofangtao
Copy link

看doc文档,需要配置cuda环境。 现在算力资源都在国产化,请问Mooncake Transfer Engine 能适配华为的Ascend昇腾平台和NPU显卡吗?

@alogfans
Copy link
Collaborator

Mooncake 适配国产化算力设备是未来工作的一个重要部分。Transfer Engine 自身支持 RoCE/eRDMA 等网络,因此可使用国产设备部署。CUDA 用于实现 GPU VRAM 数据直传远程 DRAM 功能,该功能需使用 GPUDirect RDMA。如果国产卡有类似的功能接口可以移植。也可以由用户自行实现经本地 DRAM 中转将数据传到远程 DRAM(多一次拷贝),这种模式下不需要开启 USE_CUDA 开关。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants