Skip to content

Issues: xorbitsai/inference

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

161 Open 1,418 Closed
161 Open 1,418 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

多模态embeding 支持和llamacpp embeding后端支持 feature
#2768 opened Jan 17, 2025 by ZanePoe v1.x
1
CosyVoice2 requires prompt_speech gpu
#2767 opened Jan 17, 2025 by peterliang5678
1 of 3 tasks
v1.x
1
@codingl2k1
6
MiniCPM-o-2_6全模态模型有支持计划吗？ feature
#2766 opened Jan 16, 2025 by yhfgyyf v1.x
3
v1.2.0 版本是不是与 pydantic 冲突了 gpu
#2765 opened Jan 16, 2025 by JasonHZS
1 of 3 tasks
v1.x
1
如果xinference启动模型失败后再重启会显示模型已存在list feature
#2764 opened Jan 16, 2025 by pyaaaa v1.x
1
大模型 feature
#2762 opened Jan 15, 2025 by YSblack v1.x
1
HunyuanDiT-v1.2-Distilled生成图片报错expected scalar type Float but found Half gpu
#2758 opened Jan 12, 2025 by githust66
1 of 3 tasks
v1.x
4
Codegeex4 ERROR: ChatGLM4Tokenizer._pad() got an unexpected keyword argument 'padding_side'"} gpu
#2757 opened Jan 12, 2025 by Oaklight
1 of 3 tasks
v1.x
2
Improve kv block transfer feature stale
#2754 opened Jan 10, 2025 by codingl2k1 v1.x
1
embedding模型接口调用后名称发生变化
#2751 opened Jan 10, 2025 by sliontc
1 of 3 tasks
v1.x
3
添加对deepseek v3的支持 feature
#2736 opened Jan 4, 2025 by jqhr v1.x
6
增加跨域的配置 good first issue Good for newcomers pr welcome
#2735 opened Jan 4, 2025 by closer-finger
1 of 3 tasks
v1.x
2
请问咱们平台支持中国移动的九天模型吗？ feature pr welcome stale
#2729 opened Jan 2, 2025 by jieguolove v1.x
2
分布式节点部署，launch时指定卡有问题 gpu stale
#2710 opened Dec 26, 2024 by syd1997 v1.x
12
集群模式下注册自定义模型启动时会提示not found的问题 gpu
#2645 opened Dec 10, 2024 by DawnOf1996
1 of 3 tasks
v1.x
5
建议增加xgrammar结构化输出支持 feature
#2620 opened Dec 2, 2024 by ZanePoe v1.x
9
xprobe/xinference:v0.14.0.post1 运行Alibaba-NLP/gte-Qwen2-7B-instruct报错 no moudle run install flash_attn gpu
#2022 opened Aug 6, 2024 by xujingsen521
1 of 3 tasks
v1.x
2
Please Support Embedding Model BGE-Multilingual-Gemma2 feature good first issue Good for newcomers pr welcome
#2020 opened Aug 5, 2024 by Rookie-Kai v1.x
Windows 使用 qwen2 无法设置 GPU 使用 gpu
#2019 opened Aug 5, 2024 by allanpk716
1 of 3 tasks
v1.x
1
使用网页启动自定义模型报错 _extractNVMLErrorsAsClasses.<locals>.gen_new.<locals>.new() gpu
#2014 opened Aug 5, 2024 by edwar172038
1 of 3 tasks
v1.x
4
internlm2.5-chat-gptq-int4运行时报错 gpu
#2013 opened Aug 5, 2024 by c935289832
1 of 3 tasks
v1.x
1
autodl上使用xinference加载qwen2-72b-instruct模型，运行不起来
#2012 opened Aug 4, 2024 by qq745639151
1 of 3 tasks
v1.x
1
ONNX Model Support feature
#2005 opened Aug 2, 2024 by zhipeng9802 v1.x
2
运行模型sd3-medium 提示 AutoPipeline can't find a pipeline linked to StableDiffusion3Pipeline
#2003 opened Aug 2, 2024 by Fun-Fox
1 of 3 tasks
v1.x
4
用户调用多，出现bug，到2500后自动卡死 gpu
#2001 opened Aug 1, 2024 by stevensy123
1 of 3 tasks
v1.x
@codingl2k1
16
ProTip! Exclude everything labeled bug with -label:bug.