Re: Project-wide LLM budget for helping people

2025-01-15 Thread Helmut Grohne
Hi Mo, before going into criticizing things, I would like to thank you for your continued work in the AI space. In particular, your way of classifying models into different degrees of freedom demonstrates how much you care about Debian's values. I see that your focus is on enabling users and that'

Re: Project-wide LLM budget for helping people (was: Re: Complete and unified documentation for new maintainers

2025-01-14 Thread Andrey Rakhmatullin
On Tue, Jan 14, 2025 at 08:52:39AM +0100, Philip Hands wrote: > I'd really like to know how it is possible for one to use an LLM to make > a contribution to a permissively licensed project (e.g. Expat) without > in effect stealing the code from one's own tribe of Copyleft authors. > > Can one even

Re: Project-wide LLM budget for helping people (was: Re: Complete and unified documentation for new maintainers

2025-01-13 Thread Philip Hands
"M. Zhou" writes: > On Sun, 2025-01-12 at 16:56 +, Colin Watson wrote: >> >> (I have less fixed views on locally-trained models, but I see no very >> compelling need to find more things to spend energy on even if the costs >> are lower.) > > Locally-trained models are not practical in the cu

Re: Project-wide LLM budget for helping people (was: Re: Complete and unified documentation for new maintainers

2025-01-13 Thread Holger Levsen
On Sat, Jan 11, 2025 at 11:25:20AM -0500, M. Zhou wrote: > On Sat, 2025-01-11 at 13:49 +0100, Fabio Fantoni wrote: > > > > Today trying to see how a new person who wants to start maintaining new > > packages would do and trying to do research thinking from his point of > > view and from simple s

Re: Project-wide LLM budget for helping people

2025-01-12 Thread Simon Richter
Hi, On 1/13/25 03:46, M. Zhou wrote: So what I was talking is simply a choice among the two: 1. A contributor who needs help can leverage LLM for its immediate response and help even if it only correct, for 30% of the time. It requires the contributor to have knowledge and skill t

Re: Project-wide LLM budget for helping people (WAS: Re: Complete and unified documentation for new maintainers

2025-01-12 Thread Ángel
On 2025-01-12 at 18:03 +, Andrew M.A. Cater wrote: > Watching other people find and fix bugs, even in code they > have written or know well, I can't trust systems built on modern > Markov chains to do better, no matter how much input you give them, and > that's without crediting LLMs as able to

Re: Project-wide LLM budget for helping people

2025-01-12 Thread M. Zhou
On Sun, 2025-01-12 at 22:36 +0100, Philipp Kern wrote: > > No-one is stopped from using any of the free offers. I don't think we > need our own chat bot. Of course that means, in turn, that we give up on > feeding it domain-specific knowledge and our own prompt. But that's... > probably fine? One

Re: Project-wide LLM budget for helping people

2025-01-12 Thread Philipp Kern
On 1/12/25 7:46 PM, M. Zhou wrote: > So what I was talking is simply a choice among the two: > 1. A contributor who needs help can leverage LLM for its immediate response > and > help even if it only correct, for 30% of the time. It requires the > contributor > to have knowledge and skil

Re: Project-wide LLM budget for helping people (was: Re: Complete and unified documentation for new maintainers

2025-01-12 Thread M. Zhou
On Sun, 2025-01-12 at 16:56 +, Colin Watson wrote: > > (I have less fixed views on locally-trained models, but I see no very > compelling need to find more things to spend energy on even if the costs > are lower.) Locally-trained models are not practical in the current stage. State-of-the-art

Re: Project-wide LLM budget for helping people (WAS: Re: Complete and unified documentation for new maintainers

2025-01-12 Thread Andrew M.A. Cater
On Sun, Jan 12, 2025 at 04:56:15PM +, Colin Watson wrote: > On Sat, Jan 11, 2025 at 07:13:58PM -0800, Otto Kekäläinen wrote: > > I don't think Debian should as an organization pay for LLMs. On the > > contrary I would expect LLM providers to offer API keys for free to > > Debian Developers just

Re: Project-wide LLM budget for helping people (was: Re: Complete and unified documentation for new maintainers

2025-01-12 Thread Colin Watson
On Sat, Jan 11, 2025 at 07:13:58PM -0800, Otto Kekäläinen wrote: > I don't think Debian should as an organization pay for LLMs. On the > contrary I would expect LLM providers to offer API keys for free to > Debian Developers just like we have other perks listed at > https://wiki.debian.org/MemberBe

Re: Project-wide LLM budget for helping people (was: Re: Complete and unified documentation for new maintainers

2025-01-11 Thread Otto Kekäläinen
... > Debian should consider allocating some budget like several hundred USD > per month for the LLM API calls for all members and new-comers' usage. I don't think Debian should as an organization pay for LLMs. On the contrary I would expect LLM providers to offer API keys for free to Debian Devel

Re: Project-wide LLM budget for helping people (was: Re: Complete and unified documentation for new maintainers

2025-01-11 Thread Andrey Rakhmatullin
On Sat, Jan 11, 2025 at 11:25:20AM -0500, M. Zhou wrote: > Opinion against this post will include something about hallucination. > In the case LLM write something that does not compile at all, or write > some non-existent API, a human is intelligent enough to easily notice > that build failure or l

Re: Project-wide LLM budget for helping people

2025-01-11 Thread Philipp Kern
On 1/11/25 5:25 PM, M. Zhou wrote: > Opinion against this post will include something about hallucination. > In the case LLM write something that does not compile at all, or write > some non-existent API, a human is intelligent enough to easily notice > that build failure or lintian error and tell

Project-wide LLM budget for helping people (was: Re: Complete and unified documentation for new maintainers

2025-01-11 Thread M. Zhou
On Sat, 2025-01-11 at 13:49 +0100, Fabio Fantoni wrote: > > Today trying to see how a new person who wants to start maintaining new > packages would do and trying to do research thinking from his point of > view and from simple searches on the internet I found unfortunately that > these parts a