On Fri, 2026-01-30 at 13:20 +0800, hongxu via lists.openembedded.org wrote: > ChatGPT[1] has been popular for several years, perhaps you also know > Deepseek[2] which is an open-source language model and run locally. > > The local runner to run Deepseek is Ollama[3]. It lets you download > and run large language models (LLMs) on your own machine, without > relying on cloud-hosted services. > > That is good for Yocto, so I integrate ollama to Yocto-based Linux > system, build from source, offline install and deploy. > > For the convenience of review, show it on my github [4] temporary, > - The BUILD.md [5] provides the steps to build and run on CPU by > default, - The BUILD-cuda-x86-64.md [6] provides the steps to build > and run on NVIDIA GPU with CUDA for x86-64
I appreciate there was a lot of discussion on this, I'm not going to try and respond to all the points individually. The TSC discussed this a few times and is not convinced that either this or the proposed meta-ai is the right way to proceed with this at this time. We are keen not to repeat the past and create a "catch all" layer like meta-openembedded where it is unclear what is needed/used/tested and in which combinations. Equally, a focused layer that is target to one specific use is also not appealing. We're aware that the rate of change in this space is extremely high and that will further compound the problem. We would suggest that people work on their layers outside of git.yoctoproject.org and that as things get established, it should be clearer what the best solution is and we'd be in a better position to make decisions once there is more consensus and we can help focus development and adoption. We can see the potential for a common "meta-ai-support" type layer where the common dependencies used by the integrations could be shared, but this is not what is currently being proposed. Cheers, Richard (channelling the YP TSC's discussion)
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#2305): https://lists.openembedded.org/g/openembedded-architecture/message/2305 Mute This Topic: https://lists.openembedded.org/mt/117540395/21656 Group Owner: [email protected] Unsubscribe: https://lists.openembedded.org/g/openembedded-architecture/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
