Package: llama.cpp-tools
Version: 9721+dfsg-1
Severity: normal
X-Debbugs-Cc: [email protected]
Hello and thanks a lot for packaging and maintaining llama.cpp in Debian!
I have tested llama-cli and llama-server. They allow me to interact with
a LLM obtained (for instance) from the Hugging Face model repository.
However, I haven't been able to find a way to save a transcript of the
conversation I had with the LLM.
I thought there could be a command (something like /save <file> in
llama-cli), but there seems to be nothing of the kind...
I also failed to find something in the web interface of llama-server.
I tried the good old UNIX way:
$ llama-cli -hf <GGUF-file> | tee chat.log
but the user prompts and the replies of the LLM are apparently not sent
to stdout, hence this approach also fails to work.
Manually copying and pasting chunks of the conversation works, but... how
tedious and error-prone!!!
If there's a better strategy, I think it should be documented (the man pages
do not seem to say anything about this topic).
If there's no better strategy, I really think this missing feature is a
bug that should be fixed: logging the conversations is important in
order to compare different LLMs and to keep track of a useful reply that
a LLM could (occasionally) give...
Please fix this bug and/or forward this bug report upstream, as appropriate.
Thanks for your time and dedication!
-- System Information:
Debian Release: forky/sid
APT prefers testing
APT policy: (800, 'testing'), (500, 'unstable')
Architecture: amd64 (x86_64)
Kernel: Linux 7.0.13+deb14-amd64 (SMP w/12 CPU threads; PREEMPT)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8),
LANGUAGE=en_US:en
Shell: /bin/sh linked to /usr/bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled
Versions of packages llama.cpp-tools depends on:
ii debconf [debconf-2.0] 1.5.92
ii libc6 2.42-17
ii libgcc-s1 16.1.0-2
ii libggml0 0.15.2-1
ii libllama0 9721+dfsg-1
ii libssl3t64 3.6.3-1
ii libstdc++6 16.1.0-2
ii systemd [systemd-tmpfiles] 261.1-2
ii wget 1.25.0-2
llama.cpp-tools recommends no packages.
Versions of packages llama.cpp-tools suggests:
pn llama.cpp-tools-webui-downloader <none>
-- debconf information:
llama.cpp-tools/path-error:
llama.cpp-tools/default-ui-custom-path:
llama.cpp-tools/default-ui: simplechat
