this post was submitted on 10 Jul 2023

42 points (93.8% liked)

Asklemmy

43852 readers

699 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy 🔍

If your post meets the following criteria, it's welcome here!

Open-ended question
Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
Not ad nauseam inducing: please make sure it is a question that would be new to most members
An actual topic of discussion

Looking for support?

Looking for a community?

Lemmyverse: community search
sub.rehab: maps old subreddits to fediverse options, marks official as such
!lemmy411@lemmy.ca: a community for finding communities

~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~

founded 5 years ago

MODERATORS

Who is the third faction in the leaked Google memo about AI? (lemmy.dbzer0.com)

submitted 1 year ago by Melatonin@lemmy.dbzer0.com to c/asklemmy@lemmy.ml

16 comments fedilink hide all child comments

https://www.theverge.com/2023/7/10/23790132/google-memo-moat-ai-leak-demis-hassabis

In this link this discussion:

The memo, which was obtained by SemiAnalysis from a public Discord server, says that neither Google nor OpenAI have what they need to succeed in the AI industry. Instead, the researcher claims “a third faction has been quietly eating our lunch”: open-source AI models that the researcher says are “faster, more customizable, more private, and pound-for-pound more capable.”

WHO IS THE THIRD FACTION?

top 13 comments

sorted by: hot top controversial new old

[–] jsveiga@sh.itjust.works 27 points 1 year ago (2 children)

Open source AI models?

[–] BartsBigBugBag@lemmy.tf 6 points 1 year ago

Yep, that is what I got out of it too.

[–] huiccewudu@lemmy.ca 4 points 1 year ago* (last edited 1 year ago) (1 children)

Just wanted to add that The Verge article quotes from the source document, but does not include its links, etc. Here's a hyperlinked version, including some specific open source resources, which the author calls 'third faction' content: https://www.semianalysis.com/p/google-we-have-no-moat-and-neither

[–] Melatonin@lemmy.dbzer0.com 2 points 1 year ago

Hell of a good read there

[–] navigatron@beehaw.org 19 points 1 year ago

Go a level deeper, beyond this news about news, and read the moat memo.

The third faction is the open source community.

The memo has an entire timeline section, dedicated to showing the speed at which the open source community absorbed and iterated on the leaked facebook model, LaMMa.

The memo puts a lot of emphasis on how google and co are building new models from scratch, over months, with millions of dollars - and yet open source is building patches, in days, with only a few hundred dollars - and the patches stack, and are easily shareable.

The open source models, through these patches, are getting better faster than google can re-architect and re-train new models from scratch.

The main point of the memo is that google needs to change their strategy, if they want to stay “ahead” (some would argue they’re already behind) of the competition.

[–] dr_catman@beehaw.org 3 points 1 year ago* (last edited 1 year ago) (1 children)

huggingface is full of models not created by a large corporation. Maybe they mean those?

[–] Obi@sopuli.xyz 1 points 1 year ago (2 children)

Can I, as a dumb end-user, use models from there?

[–] dr_catman@beehaw.org 3 points 1 year ago (1 children)

Yes! …well, with a caveat.

Huggingface models (even the ones published to the platform by Google or fb) are available for anyone to use, but they’re not quite intended to be chatbots; they’re more like pretrained machine learning models for data science pipelines.

Still, if you know python or are willing to learn, you can use huggingface however you want. You’re totally allowed to download a model, open it in python, and ask questions to it. Or feed it a long text and ask for summaries etc.

[–] Obi@sopuli.xyz 1 points 1 year ago

Yeah no I guess I'm more looking for the open-source end-products I could use similarly to chatGPT or midjourney etc. I did learn a bit of python a while back but I'm no coder.

[–] philoko@lemmy.ml 1 points 1 year ago

Yeah, Oobabooga let’s you easily download models from HuggingFace and has a chat interface.

[–] nonearther@lemmy.ml 2 points 1 year ago

A wild guess, but could it be Microsoft?

I mean they are already creating use cases and integrating them in their apps, especially their business suite.

While Google and OpenAI are ahead in AI innovation, I feel Microsoft is getting ahead in implementation and actual end user scenarios.

Microsoft office offerings are still much larger than Google's, plus they capture Dev's needs with GitHub CoPilot and VS/ VSCode integrations.

I feel like by the time Google will be ready or OpenAI's contract with MS ends, both of these companies will lag sufficiently behind MS in real world.

[–] LachlanUnchained@lemmyunchained.net 2 points 1 year ago* (last edited 1 year ago)

Meta. They are smashing it with small customisable, specialised models.

Listen to the latest lex fridman podcast with zuck. I found it quite fascinating.

And then there’s worrying about not wearing the same thing twice. My god! Don’t know how you do it.

[–] BananaTrifleViolin@kbin.social 1 points 1 year ago* (last edited 1 year ago)

Instead, the researcher claims “a third faction has been quietly eating our lunch”: open-source AI models that the researcher says are “faster, more customizable, more private, and pound-for-pound more capable.”

The sentence you quote says who the 3rd faction is: Open-source AI models.

load more comments