Petter Reinholdtsen <[email protected]> writes:
> [Cordell Bloor]
>
> Once this was done, the llama-server program started as it should.
Not quite. It started and no longer crashed, but not as it should. I
starts with this:
load_backend: loaded BLAS backend from
/usr/lib/x86_64-linux-gnu/ggml/backends0/libggml-blas.so
load_backend: loaded CPU backend from
/usr/lib/x86_64-linux-gnu/ggml/backends0/libggml-cpu-icelake.so
warning: no usable GPU found, --gpu-layers option will be ignored
warning: one possible reason is that llama.cpp was compiled without GPU support
warning: consult docs/build.md for compilation instructions
build: 5882 (Debian) with cc (Debian 14.3.0-5) 14.3.0 for x86_64-linux-gnu
system info: n_threads = 16, n_threads_batch = 16, total_threads = 32
And there is no sign of any GPU being used. :(
I tried to work around this by installing libggml0-backend-hip, but
alas, it do not work:
% LC_ALL=C sudo apt install libggml0-backend-hip
Solving dependencies... Error!
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:
Unsatisfied dependencies:
libggml0-backend-hip : Depends: libggml0 (>= 0.9.4) but
0.0~git20250712.d62df60-5 is to be installed
Depends: libhipblas2 (>= 6.4.3) but it is not
installable
Depends: librocblas4 (>= 5.3.3) but it is not
installable
Error: Unable to satisfy dependencies. Reached two conflicting decisions:
1. libggml0:amd64=0.9.4-4+hip~exp2 is not selected for install
2. libggml0:amd64=0.9.4-4+hip~exp2 is selected as an upgrade because:
1. libggml0-backend-hip:amd64=0.9.4-4+hip~exp2 is selected for install
2. libggml0-backend-hip:amd64 Depends libggml0 (>= 0.9.4)
%
I tried disabling experimental as a source in sources.list, but then I
only got this:
Package libggml0-backend-hip is not available, but is referred to by another
package.
This may mean that the package is missing, has been obsoleted, or
is only available from another source
Error: Package 'libggml0-backend-hip' has no installation candidate
--
Happy hacking
Petter Reinholdtsen
