This must be a sign that Meta is not confident in their AI offerings.
They use "open source" to whitewash their image.
Now ask yourself a question: where does Meta's data come from? Perhaps from their users' data? And they opted everyone in by default. And made the opt-out process as cumbersome as possible: https://threadreaderapp.com/thread/1794863603964891567.html And now complain that the EU is preventing them from "collecting rich cultural context" or something https://x.com/nickclegg/status/1834594456689066225
> In 2012, Red Hat Inc. accused VMWare Inc. and Microsoft Corp. of openwashing in relation to their cloud products.[6] Red Hat claimed that VMWare and Microsoft were marketing their cloud products as open source, despite charging fees per machine using the cloud products.
Other companies are way more careful using "open source" in relation to their AI models. Meta now practically owns the term "Open Source AI" for whatever they take it to mean, might as well call it Meta AI and be done with it: https://opensource.org/blog/metas-llama-2-license-is-not-ope...
This is such devious, but increasingly obvious, narrative crafting by a commercial entity that has proven itself adversarial to an open and decentralized internet / ideas and knowledge economy.
The argument goes as follows:
- The future of AI is open source and decentralized
- We want to win the future of AI instead, become a central leader and player in the collective open-source community (a corporate entity with personhood for which Mark is the human mask/spokesperson)
- So let's call our open-weight models open-source, and benefit from its imago, require all Llama developers to transfer any goodwill to us, and decentralize responsibility and liability, for when our 20 million dollar plus "AI jet engine" Waifu emulator causes harm.
Read the terms of use / contract for Meta AI products. If you deploy it, some producer finds the model spits out copyrighted content, knocks on Meta's door, Meta will point to you for the rest of the court case. If that's the future for AI, then it doesn't really matter whether China wins.
As much as I hate Facebook, I think that seems pretty… reasonable? These AI tools are just tools. If somebody uses a crayon to violate copyright, the crayon is not to blame, and certainly the crayon company is not, the person using it is.
The fact that Facebook won’t voluntarily take liability for any thing their users’ users’ might do with their software means that software might not be useable in some cases. It is a reason to avoid that software if you have one of those use cases.
But I think if you find some company that says “yes, we’ll be responsible for anything your users do with with our product,” I mean… that seems like a hard promise to take seriously, right?
While Mark claims his Open Source AI is safer, because fully transparent and many eyes make all bugs shallow, the latest technical report makes mention of an internal, secret, benchmark that had to be developed, because available benchmarks did not suffice at that level of capabilities. For child abuse generation, it only makes mention that it investigated this, not any results of these tests or conditions under which it possibly failed. They shove all this liability on the developer, while claiming any positive goodwill generated.
It completely loses their motivation to care for AI safety and ethics if fines don't punish them, but those who used the library to build.
Reasonable for Meta? Yes. Reasonable for us to nod along when they misuse open source to accomplish this? No.
I think the success of the "Threads + Fediverse = <3" relies on the Fediverse not throwing the towel and leaving Threads as the biggest player in the space. That would mean fixing a lot of problems that that people have with Activity Pub today.
I don't want to say the big tech are awesome and without fault, but at the end of the day big-techs will be big-techs. Let's keep the Fediverse relevant and Meta will continue to support it, otherwise it will be swallowed by the bigger fish.
Given the nature of the fediverse, if it happened or not depends on the instance you use/follow.
So Meta says "well we will buy tons of compute and try to make it distributed" "we'll make the model open and people will fine-tune with data that they found" and so on. Now google and openAI aren't competing versus meta, they are competing versus meta + all compute owned by amateurs + all data scrapped by all amateurs, which is non-trivial. so it's not so much as aspiring to be #1 as capping the knees of the competition who has superior competitiveness - but people love it because the common man wins here for once.
Anyway, eventually, they'll all be open models. Near future weaker models will run on a PC, bigger models on the cluster, weakest models on the phone... then just weak models on the phone and bigger on the PC.. eventually anything and everything fits on a phone and maybe iWatch. Even Google and openAI will have to run on the PC/phone at this point, it wouldn't make sense not to. Then since people have local access to these devices, it all gets reverse engineered, boom boom boom. now they're all open
Code is a single input and is cheap to compile, modify, and distribute. It's cheap to run.
Models are many things: data sets, data set processing code, training code, inference code, weights, etc. But it doesn't even matter if all of these inputs are "open source". Models take millions of dollars to train, and the inference costs aren't cheap either.
edit:
Remember when platforms ate the open web? We might be looking at a time where giants eat small software due to the cost and scale barriers.
Everyone tries this. Apple tried it with lawsuits and patents, Facebook did it under the guise of privacy, OpenAI will do it under the guise of public safety.
There's almost no case where a private company is going to be able to successfully argue "they shouldn't be allowed but we should" I wonder why so many companies these days try. Just hire better people and win outright.
1. Open source is for losers. I'm not calling anyone involved in open source a loser, to be clear. I have deep respect for anyone who volunteers their time for this. I'm saying that when companies push for open source it's because they're losing in the marketplace. Always. No companiy that is winning ever open sources more than a token amount for PR; and
2. Joel Spolsky's now 20+ year old letter [1]:
> Smart companies try to commoditize their products’ complements.
Meta is clearly behind the curve on AI here so they're trying to commoditize it.
There is no moral high ground these companies are operating from. They're not using their vast wisdom to predict the future. They're trying to bring about the future the most helps them. Not just Meta. Every company does this.
It's why you'll never see Meta saying the future of social media is federation, open source and democratization.
[1]: https://www.joelonsoftware.com/2002/06/12/strategy-letter-v/
Then I can go ahead and train my open source model.
Because all indications are that the powers over you cannot abide your freedoms of association, communication and commerce.
So, if it’s something your family needs to survive - it has better be distributed and cryptographically secured against interference.
This includes interference in the training dataset of whatever AIs you use; this has become a potent influence on the formation of beliefs, and thus extremely valuable.
All of these models, including the "open" ones, have been RLHF'ed by teams of politically-motivated people to be "safe" after initial foundation training.
This corruption must be disclosed as assiduously as the base dataset, if not more so.
Try it for yourself: https://huggingface.co/mistralai/Mistral-Large-Instruct-2407
* does not apply to training data
This is chess pieces being moved around the board at the moment.
yet when you look back at history, things that were revolutionary, it was due to low cost of production. web, bicycles, cars, steam engine cars etc.
Nuclear everything, rockets/satellites, tons of revolutionary things that are very expensive to produce and develop.
Also software scales differently.
Cost of compute will continue decreasing and we will reach that point where it is feasible to have AI everywhere. I think with this particular technology we have already reached a no return point
Which costs significantly more than H100 at least when renting[1]. Also the price of hardware isn't significantly lower.
Also, both AMD and Nvidia have been deliberately stopping progress in cheaper consumer graphics card by not increasing VRAM and removing things like fast interconnect.
There is a lot of interest in regulating open source AI, but many sources of criticism miss the point that open source AI helps democratize access to technologies. It worries me that Meta is proposing an open source and decentralized future because how does that serve their company? Or is there some hope of creating a captive audience? I hate to be a pessimist or cynic, but just wondering out loud, haha. I am happy to be proven wrong.
If that means it'll be free/cheaper... sure
And for all the negativity seen in many of the comments here I think it’s actually quite remarkable that they make model checkpoints available freely. It’s an externality, but a positive one. Not quite there yet in terms of the ideal - which is definitely open source - and surely with an abuse of language, which I also note. But overall, the best that is achievable now I think.
The true question we should be tackling is, is there an incentive-compatible way to develop foundation models in a truly open source way? How to promote these conditions, if they do exist?
The #1 problem is not compute, but data and the manpower required to clean that data up.
The main thing you can do is support companies and groups who are releasing open source models. They are usually using their own data.
To my knowledge all of the notable open source models are subsidised by corporations in one way or another, whether by being the side project of a mega-corp which can absorb the loss (Meta) or coasting on investor hype (Mistral, Stability). Neither of those give me much confidence that they will continue forever, especially the latter category which will just run out of money eventually.
For open source AI to actually be sustainable it needs to stand on its own, which will likely require orders of magnitude more efficient training, and even then the data cleaning and RLHF are a huge money sink.
The #1 problem is absolutely compute. People barely get funding for fine tunes, and even if you physically buy the GPUs it'll cost you in power consumption.
That said, good data is definitely the #2 problem. But nowadays you can just get good synthetic datasets from calling closed model APIs or just using existing local LLMs to sift through trash. That'll cost you too.
Alternatively we could create standardized open source training data like wikipedia, wikimedia as well as public domain literature and open courseware. I'm sure that there are many other such free and legal sources of data.
Look at how much computer purple AI actually has. It’s basically nothing.
AFAICT it decentralizes the training of these models by giving you an incentive to train models which will mine the crypto if you're improving it.
I learned about it years ago, mined some crypto, lost the keys and now kicking myself cuz I would've made a pretty penny lol
> OpenAI or Claude seem to garner more positive views than llama open sourced.
that's more about Meta than the others. Although OpenAI isn't that far from Meta already.
Now ask yourself a question: where does Meta's data come from? Perhaps from their users' data? And they opted everyone in by default. And made the opt-out process as cumbersome as possible: https://threadreaderapp.com/thread/1794863603964891567.html And now complain that the EU is preventing them from "collecting rich cultural context" or something https://x.com/nickclegg/status/1834594456689066225
nope, not yet.
FAIR, the people that do the bigboi training, for a lot of their stuff cant even see user data, because the place they do the training can't support the access.
Its not like openAI where the lawyers don't even know whats going on, because they've not yet been properly taken to court.
at Meta, the lawyers are everywhere and if you do naughty shit to user data, you are going to be absolutely fucked.
This assumes that abstractions are no longer possible.
In the same way that detectron and Segment anything is an industry standard.
Sure, for LLMs openAI released a product first. but its not unusual for meta to release useful models.
Actually, those seem like an apt composite description of the PoV of the typical mass-market AI... 8/
I wonder if video game engines could use it as an alternative to Steam or Discord integration.
Slack did the same killing xmpp and irc bridge. I don't see them making a matrix bridge.
There is a reason why datasets are private and the model weights aren't.
But, I think in that case the failing is not in not taking the liability for what other people do with their tool. It is in producing the tool in the first place.
OpenAI produced GPT-2, but did not release it, as it couldn't be made safe under those conditions, when not monitored or patch-able. So it put it behind an API and owned its responsibility.
I didn't take issue with Meta's business methods and can respect its cunning moves. I take issue with things like them arguing "Open Source AI improves safety", so we can't focus on the legit cost-benefits of releasing advanced, ever-so-slightly risky, AI into the hands of novices and bad actors. It would be a failure on my part if I let myself get rigamaroled.
One should ideally own that hypothetical 3% failure rate to deny CSAM request when arguing for releasing your model still. Heck, ignore it for all I care, but they damn well do know how much this goes up when the model is jailbroken. But claiming instead that your open model release will make the world a better place for children's safety, so there is not even a need to have this difficult discussion?
Of course, from a PR perspective, it would be extremely "unsafe" for a publicly traded company to release a tool that can spew out pedophile literature, to the point of being an existential threat. Twitter was economically cancelled for much less. But as far as dangerous AI goes, it's one of the most benign and inconsequential failure modes.
1. https://arxiv.org/abs/2311.08105
2. https://github.com/NousResearch/DisTrO?tab=readme-ov-file
Also, this doesn't seem to actually solve the issue of fine tuners needing funding to rent those GPUs? One alternative is something like AI Horde, which pays GPU providers with "labour vouchers" that allow them to get priority next time they want GPU. Requires a central platform to track vouchers and ban those who exchange them. Basically a sort of real-life comparison of mutualism (AI Horde) vs capitalism (bittensor).
If the thing required breaking the law to make, it just shouldn’t have been made. But, in that case, Facebook should not accept liability for how their users use the thing. They should just not share it at all, and delete it.
Crayons don’t generate content either.
If I download something from megaupload (rip) megaupload is the one that gets in trouble. They are storing, compressing, and shipping that information to me.
The same thing happens with AI, the information is just encoded in the model weights instead of a video or text encoding or whatever. When you download a model, you’re downloading a lossy compressed version of all the data it was trained on.
This 70B pieces puzzle is an LLM.
You can reproduces likings of any hero from Marvel universe close enough using this puzzle. Or you can create
Who is to blame?
I even provided the links that has screenshots of their opt-out form.
--- start quote ---
Al at Meta is our collection of generative Al features and experiences, like Meta Al and Al Creative Tools, along with the models that power them.
Information you've shared on our Products and services could be things like:
- Posts
- Photos and their captions
- The messages you send to an Al
...
We may still process information about you to develop and improve Al at Meta, even if you object or don't use our Products and services. For example, this could happen if you or your information:
- Appear anywhere in an image shared on our Products or services by someone who uses them
- Are mentioned in posts or captions that someone else shares on our Products and services
--- end quote ---
See the words "Meta AI" and "models powering it"?
Meta couldn't give crap about simpler clear-cut cases like "don't track users across the internet", much less this.
and I am asking you to think like a lawyer.
The reason they are doing this is because they want to access user data. They cannot yet.
As I stated in the post, FAIR can't process user data, as a large part of their infra doesn't support it.
If the rest of the AI team want to process the shit people enter into it, they need to get explicit legal review to do so. This warning/ToC change is the direct result of that.
bear in mind that the FCC audits the place every year, so if they see that the lawyers have gone "nope do use that data until we have implied permission" and then the audit turns up that they've just ignored the lawyers, its going to cost literal billions.
> We may still process information about you
Can you outline how might someone reliably and accurately detect your face in a photo taken by a tourist in a public place?
Again, that's lawyer for covering arses.
Given that Facebook explicitly said they are going to use user data for training if their AIs and given that Facebook explicitly designed the opt-out form as cumbersome as possible while at the same time saying they will not even honor it if it suits them... they've already talked to their lawyers.
> Can you outline how might someone reliably and accurately detect your face in a photo taken by a tourist in a public place
If a friend of mine didn't go through the consent form and posts a picture of me, Facebook will use that for their AI
If a friend of mine didn't go through the consent form and posts information about me, Facebook will use that for their AI
> Again, that's lawyer for covering arses.
Lawyers explicitly covering their asses would not even allow opt in by default, and statements like "we're still using your data even if you opt out".
I am also not sure if it is deliberate or just realizing that running this stuff is error prone and requires a lot of capex, power and infrastructure. It is difficult to support that at the consumer level, so why bother when enterprises are now offering super computers for rent. It is not their wheelhouse, so I can see why they do not want to take on the extra risk.
This is a side project and the vast majority of companies were added by me without being paid for it. I now charge to get listed or add a banner because the site takes too much time for me to maintain.
And totally agree, AMD GPUs are not covered enough. Happy to list your company at no cost to help me fix that. Feel free to email me if interested.
What good is any of this other than driving clicks for your benefit? If I'm going to get any traffic from your site, it is all going to be driven by people just searching or quoting comparisons, not actual sales.
For example, right now, you list another MI300x provider. Right at the top of the page you parrot their bogus claims about 20k GPUs by 2024. They don't have pricing, it is just "contact us". "Based on our records, XXX has at least 2 data center locations around the world"... yet it lists both of them in the US, not "around the world". I could go on and on, but what I know is that I don't want to be associated with something like this.
Sorry for the truth bomb, but if it is taking too much time for you to maintain, you should shut it down or find someone else willing to maintain it properly. Having incomplete and bogus data isn't helpful for anyone.
More info would be appreciated. Because I tried finding the pricing for all the providers and they aren't similar. In my research, in almost all the cases, 2*A100 is superior than both H100 and MI300x in VRAM, performance and pricing if the usecase supports multi GPU.
Please bear with me though, I would like to take this opportunity to explain a bit how this industry works cause I feel like there is a lot of justified confusion.
You'll find that there is no public pricing because it is usecase dependent. Everyone needs something unique and per/gpu/hr pricing doesn't really quantify the entire hardware stack. Inference doesn't need machines with 8x400G networking. One person needs a week, others need multiple years. Some people want CFD, others want HFT. Frankly, there is also a supply/demand aspect... not many companies offer or have MI300x for rent and we've taken on that capex risk for you.
That said, I can speak about what we are doing and where we are going that aligns with our overall transparency. We've got base weekly pricing now in public (which is competitive to H100's) and we're working on publishing a set of public % discount tiers that should cover longer term rentals. Eventually, we plan to offer inference specific hardware, for even lower prices, since it has different requirements that do not cost as much. We're also going to be offering an hourly docker experience soon too.
At the end of the day though, we're not trying to be the cheapest. We will let others fight that race to zero. We're trying to be the best in our own niche. That happens by picking the best data centers, best hardware vendors, professional next business day support contracts with Dell, and white glove customer support. This sets us apart and above the rest.
Those are areas that the capex moat, is very difficult to compete with. You'll try the cheapest route first and realize that when you see things overheating or failing and taking forever to resolve, you will wish you had come to us. The idea is that we've spent quite a bit more to de-risk your business, as well as ours.
If OpenAI, Facebook, or whoever asked for permission to gobble up all publicly visible data to train a program to output statistically similar data, I don’t believe they would’ve got the permission.
In that sense, I don’t think these models should’ve been made.
I dont think any of those companies would be in the clear. That’s my point.
AI is a copyright black hole, albeit a useful one.
Facebook are explicitly not allowed to farm for PII, so unless they have explicit consent, they can't scan for faces to reject people who have opted out. Plus, how do you hold a descriptor for someone who's opted out, because you're not allowed to hold any data on them?
Therefore its unreasonable for them to guarantee them they will never process your data when submitted by a third party.
You seem to be taking my comments as a pro-meta stance. Its very much not.
If you can design a way to stop people's data being processed when uploaded by a third party, I want in on that. lets start a movement to get it working.
And for the past 8 years Facebook has been fighting this in courts and kept collecting every scrap of data they could get their hands on
> Therefore its unreasonable for them to guarantee them they will never process your data when submitted by a third party.
No, it's not unreasonable. They wouldn't be in this situation if they didn't opt everyone by default in the first place. They very explicitly looked at your "not allowed to farm for PII", said "fuck it, we have deep pockets and lawyers" and literally opted every one into PII farming.
> If you can design a way to stop people's data being processed when uploaded by a third party, I want in on that.
Don't farm it in the first place. Don't opt-in everyone by default into your PII farming machine.
It's also funny how you went from "AI people have no access to user data" to "oh they cannot guarantee user data for people who explicitly opted-out won't end up in the models"
No, I said they didn't _yet_. hence this thing.
> Don't farm it in the first place.
how do you host photos?