Skip to content

Pull requests: vllm-project/llm-compressor

New pull request New
32 Open 334 Closed
32 Open 334 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Bdellabe/e2e vllm tests more datasets
#1131 opened Feb 7, 2025 by brian-dellabetta • Draft
6
[Bugfix] SparseGPT, Pipelines
#1130 opened Feb 7, 2025 by kylesayrs Loading…
1
[DataInputType] Decouple downstream func from data_args ready When a PR is ready for review
#1120 opened Feb 3, 2025 by horheynm Loading…
13
Update examples to only load required number of samples from dataset
#1118 opened Jan 31, 2025 by kylesayrs • Draft
1
Support user-defined batch size for one shot
#1117 opened Jan 30, 2025 by kylesayrs Loading…
@kylesayrs
16
[VLM] Qwen 2.5 VL ready When a PR is ready for review
#1113 opened Jan 29, 2025 by kylesayrs • Draft
@kylesayrs
5
[Oneshot Refactor] Main refactor
#1110 opened Jan 28, 2025 by horheynm Loading…
27
[Oneshot refactor] Refactor initialize_model_from_path ready When a PR is ready for review
#1109 opened Jan 28, 2025 by horheynm Loading…
11
Implement lazy loading for traceable models ready When a PR is ready for review
#1105 opened Jan 28, 2025 by kylesayrs Loading…
@kylesayrs
10
[Oneshot Refactor] dataclass Arguments ready When a PR is ready for review
#1103 opened Jan 27, 2025 by horheynm Loading…
47
Add compressed-tensors appropriate code from llm-compressor
#1098 opened Jan 24, 2025 by horheynm • Draft
2
[Audio] People's Speech dataset and tracer tool ready When a PR is ready for review
#1086 opened Jan 20, 2025 by kylesayrs Loading…
@kylesayrs
8
[Audio] Qwen Audio Example
#1082 opened Jan 19, 2025 by kylesayrs • Draft
Add group act order case to lm_eval test
#1080 opened Jan 17, 2025 by dsikka • Draft
1
[Research] Custom Deepseek Routing
#1070 opened Jan 14, 2025 by kylesayrs • Draft
1
[Test Run] Oneshot refactor + hfquantizer
#1055 opened Jan 10, 2025 by horheynm • Draft
1
[BugFix] FSDP script script bug fix ready When a PR is ready for review
#1040 opened Jan 7, 2025 by horheynm Loading…
3
Remove missing weights silencers in favor of HFQuantizer solution
#1017 opened Dec 28, 2024 by kylesayrs • Draft
@kylesayrs
3
Dataset Processing Args
#1006 opened Dec 20, 2024 by kylesayrs • Draft
1
Dataset split fallbacks
#953 opened Dec 4, 2024 by kylesayrs • Draft
3
Move SparseGPTModifier location with backwards compatibility
#919 opened Nov 16, 2024 by kylesayrs • Draft
@kylesayrs
3
[Bugfix] Support model offloading SparseGPTQ
#918 opened Nov 16, 2024 by kylesayrs • Draft
1
[WIP] Adding un-/semi-structured pruning via ALPS
#874 opened Oct 29, 2024 by kayhanbehdin • Draft
Awq re implementation
#824 opened Oct 7, 2024 by rahul-tuli • Draft
2
Extend usability of calculate_offload_device_map
#768 opened Oct 2, 2024 by kylesayrs • Draft
2
ProTip! Filter pull requests by the default branch with base:main.