Skip to content

Issues: vllm-project/production-stack

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

20 Open 13 Closed
20 Open 13 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

chore: Use setuptools_scm to replace STACK_VERSION in the router good first issue Good for newcomers help wanted Extra attention is needed
#87 opened Feb 8, 2025 by gaocegege
chore: Implement singleton pattern for enginestatscraper, requeststatsmonitor, and router good first issue Good for newcomers help wanted Extra attention is needed
#86 opened Feb 8, 2025 by gaocegege
feat: Hash-based request ID design feature request New feature or request good first issue Good for newcomers help wanted Extra attention is needed question Further information is requested
#81 opened Feb 7, 2025 by gaocegege
@Electronic-Waste
4
Discussion: Unifying versions for helm and router, or not question Further information is requested
#80 opened Feb 7, 2025 by gaocegege
6
Feat: Router observability (Current QPS, router-side queueing delay, etc) feature request New feature or request
#78 opened Feb 7, 2025 by sitloboi2012
@sitloboi2012
feat: Distributed tracing for router feature request New feature or request help wanted Extra attention is needed
#77 opened Feb 7, 2025 by gaocegege
1
feat: Allow remote backend configuration feature request New feature or request
#75 opened Feb 7, 2025 by askulkarni2
@ApostaC
1
[CI/CD] Automatically build the router docker image via github action feature request New feature or request good first issue Good for newcomers help wanted Extra attention is needed
#74 opened Feb 7, 2025 by ApostaC
2
Download model from Object Storage feature request New feature or request
#69 opened Feb 6, 2025 by nitin302
2
Tutorial for AWS EKS documentation Improvements or additions to documentation
#68 opened Feb 6, 2025 by nitin302
@askulkarni2
2
Why Hugging Face Token? question Further information is requested
#67 opened Feb 6, 2025 by nitin302
2
Support Disabling Router feature request New feature or request good first issue Good for newcomers help wanted Extra attention is needed
#66 opened Feb 5, 2025 by danehans
1
Create an Example Building Ingress for Router Service documentation Improvements or additions to documentation
#60 opened Feb 4, 2025 by 0xThresh
@0xThresh
[RFC] prefix-cache-aware routing
#59 opened Feb 4, 2025 by KuntaiDu
8
Helm Chart Lacks Clear Support for Multi-Node vLLM Deployment help wanted Extra attention is needed
#50 opened Jan 31, 2025 by shohamyamin
2
feat: Offline batched inference based on OpenAI offline batching API feature request New feature or request
#47 opened Jan 31, 2025 by gaocegege
3
Document how to configure /dev/shm size documentation Improvements or additions to documentation
#44 opened Jan 30, 2025 by nrober734
1
Fix Installation Steps in vLLM Production Stack Tutorials documentation Improvements or additions to documentation
#37 opened Jan 29, 2025 by dxu104
3
Pluggable Router Implementations feature request New feature or request
#36 opened Jan 29, 2025 by danehans
3
[Roadmap] vLLM production stack roadmap for 2025 Q1
#26 opened Jan 27, 2025 by ApostaC
5 of 15 tasks
15
ProTip! Find all open issues with in progress development work with linked:pr.