branch: elpa/gptel
commit dcc4e3640ebaa0f94e24b3ad2099a01f7f3a517a
Author: Karthik Chikmagalur <karthikchikmaga...@gmail.com>
Commit: Karthik Chikmagalur <karthikchikmaga...@gmail.com>
gptel-ollama: Set num_ctx to 8192
* gptel-ollama.el (gptel--request-data): Set Ollama's default
context to 8192, which is what Llama 3 supports (#330). This is
currently not customizable, but is intended to be in the future.
---
gptel-ollama.el | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
diff --git a/gptel-ollama.el b/gptel-ollama.el
index 3c76837f5f..b3ef7993c9 100644
--- a/gptel-ollama.el
+++ b/gptel-ollama.el
@@ -80,7 +80,8 @@ Intended for internal use only.")
:stream ,(or (and gptel-stream gptel-use-curl
(gptel-backend-stream gptel-backend))
:json-false)))
- options-plist)
+ ;; TODO num_ctx chosen according to #330, make customizable
+ (options-plist '(:num_ctx 8192)))
(when gptel-temperature
(setq options-plist
(plist-put options-plist :temperature
