https://discussion.fedoraproject.org/t/fedora-ai-developer-desktop-objective/184941
Seems to me like its mostly just an out of box spin with CUDA and other libs preinstalled so you can spin up pytorch/tensorflow dependent stuff without manually installing all the necessary packages from different sources.
The only unusual thing is the LTS kernel. Thst should probably be out of scope or as a separate preoject not under Fedora’s resources.
I think we will go through the same process as we did with electric cars. First “terrible, the work if satan.”, “this is no good”, “it is worse than the old” … resist resist. A few will adopt, the tech gets better, more will adopt, then finally almost everyone agrees it is actually quite good, we want this.
Smart use of local LLM is good :) Producing funny pics, using big llm as search engine, or worse as an encyclopaedia, etc is bad.
Two problems:
-
The technology cannot actually improve. Increasing model scale increases power costs and compute time in return for higher accuracy. The returns from increasing model scale at optimal compute times diminish at a rate which will stop producing better results when about 94% accuracy is reached with literally infinite training data and compute time. There is no evidence that this approach will ever be improved upon in a way that approximates human output such as an AGI.
-
Even if it were free it creates liability and it’s still also free to simply just not to use it and since it isn’t necessary for literally any task: the costs will never be justified under any circumstance.
in response to your first point: 24B models from this year are far better than 24B models from 3 years ago. Same model size, similar energy consumption, far better results.
30 years ago there was a lot of doubt that Moore’s law could continue the pace for so long. There was no evidence that PCs would continue improving, and yet they did.
So it’s really anybody’s guess whether or not AI will continue improving. But with the amount of money being poured into it I’m willing to bet it will.
Okay, first of all, Moore’s law continuing was caused by a different approach to memory technology which allowed vertical stacking of silicon. Secondly, you literally just gave an example of diminishing returns making steady improvement physically impossible in spite of public expectations, unless a new and different technology is developed, so if anything that’s a great argument against AI not for it. Thirdly, Moore’s Law is still fucked because right now we’re etching silicon with gamma rays and a near-perfect lense which means we pretty much hit the physical constraints of etching smaller circuits.
Moore’s law continuing was due to a ton of different advancements and innovations, not just one. And yes it’s slowing down but it still went for 30+ years. If AI continues to improve at this rate for 30 years, hard to imagine how good it could get.
There’s been a ton of innovation in the space right now. Like MoE, which was only introduced like 2 years ago and now it’s everywhere. It’s hard to say what can happen when you have millions of engineers working on something.
-
…or sadly if some uneducated tiktoker with tons of followers think it is cool …😅🐑🐑
The Fedora Council has paused the Community Initiatives process, stating that the current framework no longer effectively supports identifying, discussing, and advancing major strategic efforts.
Importantly, already approved Community Initiatives will continue.
Going forward, the Fedora Council says it wants to develop a new mechanism for setting strategic direction in a more open and transparent way, with stronger community involvement earlier in the process.
Context: Fedora’s AI Developer Desktop Was Approved, Then Blocked. Here’s Why. & Heavy Community Backlash Blocks Fedora’s AI Developer Desktop Initiative
Seems like it is primarily a technical backlash about having to support another kernel branch for stability with proprietary nvidia drivers. A bit of pushback on AI branding. But also
Part of what made this blow up the way it did was a communications gap. Fabio Valentini of the FESCo noted that he only became aware the proposal was being voted on after stumbling across the council meeting on Matrix accidentally.
According to the Fedora Council, the AI Developer Desktop proposal exposed deeper problems with the current process. The Council said the Community Initiatives framework has failed to provide a good space where new ideas can surface, receive respectful feedback, and gain support when they fit Fedora’s present or future direction.
As a first step, the Fedora Council will immediately pause the Community Initiatives process. This pause affects only the process, not overall Fedora development.
Sure reads like “we don’t care if the entire community is against it, we’re doing this anyway and there won’t be any new features until we finish”
the AI Developer Desktop proposal is closed under this process
Instead, the Fedora Council says that if the AI Desktop work matures, it can follow the existing path toward becoming an official Fedora offering. That would first require a Council ticket for trademark and branding approval, followed by a Fedora Change Proposal for technical review by FESCo. Until then, the proposal remains an independent exploration rather than an official Fedora offering.
deleted by creator
I was thinking to test fedora for some time … now i dont know I want to …
They literally didn’t want the AI spin
why? bevause they gave people an option that dorsnt affect anyone else?
why? bevause they gave people an option that dorsnt affect anyone else?
It always starts like this. I criticized the initial optional and ai features in Firefox. People said “oh its just this one time in the PDF” and so on. What happened? Mozilla added more and more Ai functionality, to a point where they had to integrate a kill switch because so many were bothered by. Also even if you disable all the features, it affects you in some way. Because now they will not integrate an alternative feature without the need of Ai. That means if you disable Ai, you miss out on features otherwise. And it takes lot of resources and development time from the team for stuff you don’t care.
Therefore I do not accept the defense of “it is optional, it does not affect you” for these various reasons I just outlined.
Its a sign of whats to come sooner or later. Look at ubuntu. I am using arch right now, loved ubuntu in the past, but that has became a shitshow to say the least. Now I wanted a changed and was looking heavily at fedora, but Im afraid i will settle down and It will end up with something from that project being integrated in the main distro. Idk just my thoughts.
I mean you can try it. I’ve used it briefly in the past but moved on from it because it’s a damn frustratingly opinionated distro with a community that gives the GNOME user/dev base a run for their money.
It works well enough. some things you really got to play with to get working on it. If you’re on Nvidia I’d just save yourself the headache and skip it. If you want a distro you can install and just completely forget about and just use flatpaks or whatever, yeah it’s good.
I’m on AMD, and yes right Noe I want a disteo with flatpacka I can just run and forget about haha :)
If you’re on Nvidia I’d just save yourself the headache and skip it
Just to offer a counter balance, my gaming desktop with Nvidia is running Fedora. Other than an weird issue with the mouse cursor - which was easily fixed - it has been working flawlessly.
deleted by creator
so glad I abandoned that shithole of a distro when IBM started making anticonsumer changes.
If you don’t want the AI features don’t use them
I do want a good file system embedding plugin for semantic search, image categorization and content recognition, better OCR, etc. I can run all those locally for less energy than playing a video game and wasting zero water, but a good OS integration would be game changer.
There are definitely things to say against AI, but the anti-AI crowd can sometimes be incredibly short sighted and assholishly militant.
Right?! Those are all more mature technologies that have immediate use.
MCP servers for the underlying OS is a stretch further towards “ok but why?”.
Getting specifically LLMs to run in fedora? Sure someone could do that but it’s not a desktop thing to me and the space is in so much constant flux that creating a “standard” way is an effort in futility.
But yeah seeing something like immich’s search features being brought OS level would be awesome.
OCR and TTS both are kind of neglected accibility features that really could use some love imho too
your last sentence is willfully ignoring the systematic horrors of AI that can only be properly fought by making AI as a whole socially unacceptable.
There are definitely things to say against AI, but the anti-AI crowd can sometimes be incredibly short sighted and assholishly militant.
I’d both-sides this except that one side has to constantly fix the other side’s mass-produced garbage-on-demand while their management continues to shrink the resources and time available to do both that and their own job.
Sure, you can responsibly use AI, and creating an environment for that would generally be a good thing. That ignores the reality of the world we live in though, and it’s easy to understand why people are exhausted over the artificial hype and want their spaces to remain untainted by it.
nope.
deleted by creator
Part of the point is all about how a healthy community discusses and decides upon proposals. This effort to ram a deeply disdained, extractive capitalist creation into a Fedora Atomic Desktop version that basically violated some ethical choices that Fedora makes…Is part of the reason why it thankfully failed. It didn’t help that the people who held the vote actively avoided having a discussion involving the community, that is a Microslop tactic. Not an open source project’s tactic, it tells me a lot about the ethical soundness of what they were trying to accomplish. A healthy community is so much better than what AI Chuds want, always.
There are always other places the AI Chuds could go anyway, like Ubuntu or whatever cesspool infected itself with slop.
Ai isnt going away.
Neither is global warming
It isnt. But the water is, your ram is, your CPU is, your GPU is, and your HDD/SDD is, your PERSONAL computer is, heck all that you have used of using as tech is as well because you will own nothing and you will be happy!
Agreed. But I feel like people are in denial that they can stop Ai. The surveillance aspect alone is keeping Ai alive for good.
If corporations are pushing it THAT hard… We regular people can’t do Jack shit.
Don’t care and I’ll hate it vocally and publicly till I die.
you wont be alone in this matter :)
Just like nfts!
