Skip to content

Commit

Permalink
Add gptq known issue (#2080)
Browse files Browse the repository at this point in the history
Signed-off-by: Kaihui-intel <[email protected]>
  • Loading branch information
Kaihui-intel authored Dec 5, 2024
1 parent 3bc8e4d commit 306bd63
Showing 1 changed file with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions docs/source/faq.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,3 +26,9 @@ Intel TBB is required, try:
$ conda/pip install tbb
```
**Solution:** It's actually already installed by `requirements_pt.txt`, so just need to set up with `export LD_LIBRARY_PATH=/usr/local/lib/:$LD_LIBRARY_PATH`.
#### Issue 6:
torch._C._LinAlgError: linalg.cholesky: The factorization could not be completed because the input is not positive-definite.
**Solution:** This is a known issue. For more details, refer to
[AutoGPTQ/AutoGPTQ#196](https://github.com/AutoGPTQ/AutoGPTQ/issues/196).
Try increasing `percdamp` (percent of the average Hessian diagonal to use for dampening),
or increasing `nsamples` (the number of calibration samples).

0 comments on commit 306bd63

Please sign in to comment.