New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding Lightning Attention 2 Support #13

Open

James4Ever0 opened this issue Jan 28, 2024 · 0 comments

Labels

James4Ever0 commented Jan 28, 2024 •

edited by polar-sh bot

Loading

🚀 Feature Request

Using newly proposed model architecture Lightning Attention 2 to increase context size and inference speed.

Motivation

Looks promising and easy to implement, only requires Triton and NVIDIA GPU.

Upvote & Fund

We're using Polar.sh so you can upvote and help fund this issue.
We receive the funding once the issue is completed & confirmed by you.
Thank you in advance for helping prioritize & fund our backlog.

Fund with Polar

James4Ever0 added the enhancement label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment