Skip to content

Issues: sgl-project/sglang

Development Roadmap (2024 Q4)
#1487 opened Sep 21, 2024 by Ying1123
Open 22
[Feature] DeepSeek V3 optimization
#2591 opened Dec 26, 2024 by zhyncs
Open 20
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

203 Open 768 Closed
203 Open 768 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Feature] Support for Qwen2.5-VL
#3247 opened Feb 1, 2025 by BenasdTW
2 tasks done
[Docs] Add docs for running SGLang on AMD amd documentation Improvements or additions to documentation good first issue Good for newcomers help wanted Extra attention is needed
#3245 opened Feb 1, 2025 by zhaochenyang20
2 tasks done
@zhaochenyang20
1
[Feature] Add examples for running SGLang on Slurm documentation Improvements or additions to documentation good first issue Good for newcomers help wanted Extra attention is needed
#3244 opened Jan 31, 2025 by zhaochenyang20
2 tasks done
@zhaochenyang20
[Feature] Instructions for running Sglang on AMD RX 7900 XTX (gfx1100) ROCm 6.2.4 amd documentation Improvements or additions to documentation
#3243 opened Jan 31, 2025 by shahizat
1 of 2 tasks
@zhaochenyang20
2
[Bug] [ROCm] Running DeepSeek V3 on MI300X, getting "Config not found, Performance might be sub-optimal" error amd help wanted Extra attention is needed
#3219 opened Jan 30, 2025 by nikhil-tensorwave
5 tasks done
@zhaochenyang20
1
Support for saving sharded checkpoints? help wanted Extra attention is needed RLHF Using SGLang for post training
#3209 opened Jan 30, 2025 by Kipok
@zhaochenyang20
3
[Bug] CUDA error: uncorrectable ECC error encountered deepseek
#3204 opened Jan 29, 2025 by HuanzhiMao
5 tasks done
@zhaochenyang20
1
[Bug] min_p_sampling_from_probs() related crashes
#3201 opened Jan 29, 2025 by zifeitong
5 tasks done
1
@zhaochenyang20
2
[Bug] Tried to run DeepSeek V3 by amd instructions amd documentation Improvements or additions to documentation help wanted Extra attention is needed
#3200 opened Jan 28, 2025 by Vladimir-A
5 tasks done
@zhaochenyang20
3
[Bug] constant errors + hangs using sglang + deepseek v3 + AMD (httpcore.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)) deepseek help wanted Extra attention is needed
#3198 opened Jan 28, 2025 by pseudotensor
5 tasks done
@zhaochenyang20
2
[Feature] deepseek v3 60 tokens/sec on deepseek API vs. 13 tokens/sec on sglang help wanted Extra attention is needed
#3196 opened Jan 28, 2025 by pseudotensor
2 tasks done
@zhaochenyang20
15
[Feature] Support DeepSeek Janus Models help wanted Extra attention is needed visIon-LM
#3195 opened Jan 28, 2025 by juliancoy
2 tasks done
@zhaochenyang20
1
[Bug] ERROR: No matching distribution found for vllm==0.6.3.post2.dev1; extra == "srt-hip" amd
#3189 opened Jan 28, 2025 by pseudotensor
5 tasks done
@zhaochenyang20
8
[Feature] Step-by-Step Guide to Use SGLang on NVIDIA Jetson Orin platform documentation Improvements or additions to documentation good first issue Good for newcomers
#3182 opened Jan 27, 2025 by shahizat
2 tasks
@zhaochenyang20
5
[Feature] Rewrite Sampling Parameter documentation Improvements or additions to documentation good first issue Good for newcomers
#3165 opened Jan 27, 2025 by zhaochenyang20
2 tasks
@zhaochenyang20
2
[Feature] fix docs in Streaming-Synchronous-Generation documentation Improvements or additions to documentation good first issue Good for newcomers
#3164 opened Jan 27, 2025 by zhaochenyang20
2 tasks
@zhaochenyang20
1
[Feature] Reduce docs CI time good first issue Good for newcomers high priority
#3163 opened Jan 27, 2025 by zhaochenyang20
2 tasks done
@zhaochenyang20
[Feature] Remove Redundent CI of Docs good first issue Good for newcomers
#3160 opened Jan 27, 2025 by zhaochenyang20
2 tasks done
@zhaochenyang20
[Feature] Support new Qwen Models good first issue Good for newcomers
#3159 opened Jan 27, 2025 by zhaochenyang20
2 tasks done
@zhaochenyang20
[Feature] Split Docs CI good first issue Good for newcomers
#3158 opened Jan 27, 2025 by zhaochenyang20
2 tasks done
@zhaochenyang20
[Feature] Accuracy test of VLM good first issue Good for newcomers help wanted Extra attention is needed high priority visIon-LM
#3142 opened Jan 26, 2025 by zhaochenyang20
2 tasks
@zhaochenyang20
2
[Feature] Vision LM accuracy test
#3141 opened Jan 26, 2025 by zhaochenyang20
2 tasks
@zhaochenyang20
[Feature] GGUF Q4KM(4bit) format for deepseek R1 support
#3140 opened Jan 26, 2025 by wuyaoxuehun
2 tasks done
[Feature] Star attention support
#3131 opened Jan 25, 2025 by shimizust
2 tasks done
2
[Bug] Service crashed with 4 H100s and QPS=25
#3112 opened Jan 24, 2025 by yh-yao
5 tasks done
3
ProTip! no:milestone will show everything without a milestone.