270
submitted 2 months ago by that_leaflet@lemmy.world to c/linux@lemmy.ml
you are viewing a single comment's thread
view the rest of the comments
[-] drwankingstein@lemmy.dbzer0.com 4 points 2 months ago

I don't even think this is the case, google does a lot pretty much everywhere. one example is one of the things they are pushing for is locally run AI (gemini, stable diffusion etc.) to run on your gpu via webgpu instead of needing to use cloud services, which is obviously privacy friendly for a myriad of reasons, in fact, we now have multiple implementations of LLMs that run locally in browser on webgpu, and even a stable diffusion implementation (never got it to work though since my most beefy gpu is an arc a380 with 6gb of ram)

they do other stuff too, but with the recent craze push for AI, I think this is probably the most relevant.

[-] that_leaflet@lemmy.world 6 points 2 months ago

LLMs are expensive to run, so locally running them saves Google money.

[-] drwankingstein@lemmy.dbzer0.com 2 points 2 months ago

ehh... not really, the amount of generated data you can get by snopping on LLM traffic is going to far out weigh the costs of running LLMs

[-] that_leaflet@lemmy.world 1 points 2 months ago* (last edited 2 months ago)

There's nothing technical stopping Google from sending the prompt text (and maybe generated results) back to their servers. Only political/social backlash for worsened privacy.

[-] elucubra@sopuli.xyz 1 points 2 months ago

I doubt that. I'm going to guess that Google is going towards a sort of "P2P AI"

this post was submitted on 04 Sep 2024
270 points (99.6% liked)

Linux

48036 readers
770 users here now

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

founded 5 years ago
MODERATORS