Then they ask us to do it by hand?!
- Rocky
https://futurism.com/artificial-intelligence/real-monet-ai-c...
Should people be scared of their food containing Red Dye 3? Yes. Aspartame? Maybe. MSG? Probably not. Dihydrogen Monoxide? Nope.
Should you feel "shame" for using AI to generate fake news? Yes. Art? Not really. See the numerous examples of people disliking famous human-made art just because it was presented as AI.
The hyper macho’ism on show by a large majority of pro-AI posters on other threads is frankly embarrassing and if I was trying to promote a positive spin on AI I’d be telling the bro’s to STFU.
No, there's no law requiring disclosure of AI use yet, as far as I know.
> pretending you're not American when asked
Many people do so for various reasons, for example saying you're Canadian when on vacation. Do you count that as evidence that they're "ashamed" of being american? Or that being american is automatically a bad thing, because sometimes people hide it?
Much like how the entirety of Hollywood, book publishers, academic publishers, and game developers have won against piracy despite being some of the largest corps on earth and dedicating untold billions to the issue over the past 30 years?
I don't really see it. I think it's important to win on both fronts.
> works for Google
Gee, I wonder why...
- Watermarks are optional by AI provider so bad actors will circumvent by using another provider
- GH project proves watermarks can be removed
Given these, trying to ensure "truth" is a futile effort unfortunately, and watermarking only gives companies advantage to violate privacy
I'm not entirely sure how hiding that something is GenAI fits in here. It surely doesn't have anything to do with Privacy though.
I think ethical considerations were always a bit secondary to technical power when it came to so called "hacker ethos".
After all, instructions on how to remove watermarks definitely feels like the sort of thing that would have been in phrack back in the day.
but I also live in a society that requires trust to function. making a tool the obliterates that trust(genAI imagery pipelines) then creating a tool that makes it trivial for normal people to remove any hint of controls over said trust eroding system is, toxic.
I get the argument about not putting in fingerprints that identify users, Good I agree. But this also removes the things that identify this as an AI image.
Now, what are the legitimate uses of that?
No really, why would I _need_ to remove a watermark for _legitimate_ purposes? Assuming that watermark is generic, rather than a fingerprint of a specific person
When removing the watermark is easy, a very legitimate purpose of making the code to do it publicly available is to make a public demonstration that it's easy to do.
As for content use cases, suppose someone is using AI to modify their appearance because they're being unjustly targeted by an oppressive government. That government naturally bans doing that because they want to be able to identify and arrest their critics, so now if you make videos with your real face you get arrested but if you use a generated avatar then the watermark enables automated censorship because the government orders anything with the watermark to have its reach automatically restricted.
Without truth freedom and privacy are endangered too.
The other comment talks about laws that can already handle that. How if images, video and audio aren’t reliable proof anymore?
Also note that people have been falling for obviously watermarked videos already.
And even if they weren't, wouldn't that just make them more gullible towards non-watermarked models?
ie the video of garbage being thrown out the windows that his team already confirmed was real:
https://www.kptv.com/2025/09/03/trump-says-video-showing-ite...
Also the Lincoln Project video footage him him stumbling while walking and over his words: https://www.forbes.com/sites/mattnovak/2023/12/04/donald-tru...
It just defaults to 1K. But I didn't see anything in the docs stating that it's just a simple upscale for larger resolutions.
https://ai.google.dev/gemini-api/docs/image-generation#gener...
Qwen-Image-2512 / Z-Image / Flux.2 absolutely crush SDXL if you're actually generating moderately complex scenes.
Sorry, how does using AI to generate images have anything to do with this? Image generators cannot insert watermarks into things they did not generate, and it seems highly unlikely that you will get a false-positive watermark on human-generated art, especially if, as the readme says, these watermarks have high enough fidelity to trace to a specific session id. Plus the modifications to the image needed to erase watermarks would necessarily change the thing being "preserved."
[edit]: the more I read the more I'm convinced, the claimed use cases in the README are bullshit and the real reason is to provide a tool that helps people bypass "AI-generated" labels on social media for AI slop.
> Image generators cannot insert watermarks into things they did not generate
It's actually very easy to take a real image, ask Gemini/ChatGPT to modify some tiny part of it (could be something as silly as lighting/shadow/etc), and often the resulting image will be detected by their watermarking tools. This way you can easily present any real image as AI-generated.
We need to get to a place where we're checking digital signatures to see which humans were involved in the creation of something, and ignoring everything else.
The takeaway should be that watermarks aren't very reliable and you should keep your guard up anyway.
I don't think we've even seen the full brutal force of disinformation that we are capable of yet.
I'd be more interested in some kind of trusted Non-AI watermark.
This is something that could get integrated into cameras for example. However, considering how much AI-processing we already have in "normal" photos, it will be difficult to decide where to draw the line.
But then again, the photo itself would be authentic in this case strictly speaking.
It's not an easy problem. If I had a good solution, I would have tried to monetize it already ;)
People want to dismiss the potential harms of deepfakes while also excitedly releasing the deepfake-hider-3000 and saying they just really, really care about privacy (for people who make deepfakes).
for example, 35 years ago PGP was a "casually malevolent" thing, enabling terrorists and pedophiles to email each other with impunity. the effort to make math illegal had (very predictably) failed and now we have encryption everywhere. did the world end? how do you feel about Chat Control and numerous other initiatives to roll it all back?
This is a very specific tool with the purpose of making it easier to lie, in an area where the kinds of lies people tell are directly injurious to society. "It's just math" doesn't fly here, and all the primary uses for such a tool are malevolent.
putting cyphertext in high frequency noise is old news. in generative land would be far more interesting to use the generative flexibility to encode in macrostructure.
Probably it's worth reminding of also considering we're on HN here... ;)
> Hackers believe that essential lessons can be learned about the systems—about the world—from taking things apart, seeing how they work, and using this knowledge to create new and more interesting things.
> Access to computers—and anything which might teach you something about the way the world works—should be unlimited and total.
> Mistrust authority—promote decentralization
> All information should be free
I phrased it a bit differently, and perhaps a little less sympathetically, but i think i was more or less saying the same thing.
In any case a tool like the article that strips watermarks seems exactly the sort of thing that would fit into what i quoted above. Its mistrusting authority - there is nothing more central authority then having a literal central authority adding hard to remove digital signatures to images. It promotes freedom of information - it supports explaining how watermarks work and what they are. Its fundamentally taking apart a system, which teaches us how the system works.
I’m also Canadian.
Then use a mask like everyone else. digital mask, one that obscures.
which is my main point, no, there isn't a legitimate need.
realtime avatars don't generally have invisible watermarks, also they are running from your machine, otherwise you've got a (normally credit card) trail to your front door. plus a video stream
also if you are generating stuff from a public provider, then tracing people isn't that hard to do.
There are no reliable tools for the end user, normal person, to work out if an image is AI or not. This erodes trust and lets bad actors get away with "oh thats AI generated" or use AI to defraud users.
> Produce production-ready assets with native 1K output and built-in upscaling to 2K and 4K resolutions
The API doc you linked is misleading.
$0.067 per 1K image*, $0.101 per 2K image*, and $0.151 per 4K image*.
If you're on a Mac, I've heard that Draw Things is supposed to be pretty "batteries included" simple for image gen along the same lines as LM Studio.
https://github.com/Haoming02/sd-webui-forge-classic/tree/neo
If you take a photograph that is misidentified as AI generated, you can “preserve the historical record“ by using this tool before publishing the image.
(Anyone know the false positive rate with watermark IDs, would’ve hoped it’s like zero)
Trust should be between people, not a person and some data.
So showing how easy to generate "false" data, this makes it more obvious for people focus on other people. Trusting people makes life much easier in my experience, while focusing on data, again in my experience, is a game of cat and mouse.
Sure, but how do you apply that to a society at large where powerful people are interested in making everybody distrust all reliable sources of information?
AI watermarks are no panacea, but at least they are a clear signal of what not to trust.
We now have the tools to increase trust in specific information, for example: by signing images that need high trust for things like news reporting using camera hardware root of trust with time and geo stamping. If signatures are removed, that's back to a default low-trust state.
That is how we ended up with the situation where "reputed" media organizations peddle daily lies or selective truths that are useful to their benefactors.
It's too late already. We live in a post-trust society now.
Preserving the illusion that that assumption is still useful only helps the people who are exploiting it.
would you say the same thing about a ROT13 breaker, or would you recognize how laughably naive that sounds?
AI generated images have never existed before, they will break our ability to use the digital tools we have built society on if we let them. Ensuring they can be identified and have attribution tracing data embedded is a reasonable step to prevent abuse.
That said, this tool is incredibly lossy, garbling text, completely changing shapes. It also fails to remove the new gemini spark / placement that moved since yesterday.
I know of at least one music GenAI service whose ToS forbid me from using their productions in ways that are incompatible with my local rights. If Google decides, as they did with YouTube, that they'll enforce this company's watermark even though I have a right to use their results then I've passively accepted that a (foreign) company decides which of my legal rights I can exercise.
For a more pessimistic outlook: for the GenAI companies that work for the military, are those pictures also watermarked? Because if watermarks only apply to one group then the "implicit trust" argument doesn't work.
I'm in favor of watermarking the same way I am in favor of paying artists for their work. But just as with youtube-dl and DVD decryption libraries, tools like these are necessary to level the playing field.
Making untraceable assets means parties can’t be held liable for harms.
Just because a bad actor might poison a toddler doesn’t mean you should sell them the arsenic.
Just because the effects of arsenic on the neurons of a brain are interesting means you should feed them to a toddler and watch the effects unfold.
I support the legal freedom to pursue any idea, but we should also mentor our colleagues about the consequences of our projects and avoid unnecessary harm.
All watermarks are cures that are worse than the diseases they are trying to prevent (and never achieved to even cure anything).
Watermark is a blatant violation of legitimate privacy expectations, while not preventing anything because they can be easily removed.
So all the honest usages are punished, while illegitimate ones are not caught.
Isn't that the scenario the watermarks are useless against? Adversarial governments or anyone with enough money will be the ones who can generate images without watermarks even if you force them on the proles.
> AI watermarks are no panacea, but at least they are a clear signal of what not to trust.
Which seems like it only makes the actual problem worse? If most of them have watermarks, that only encourages people to put more trust in the ones that don't, even though those are the ones "powerful people" can still forge to manipulate everyone. What good is something that increases the credibility of adversarial government forgeries?
Only people with resources will be allowed to make content that is AI generated passed off as real.
Pandora's box is open. Instead of making a multi-tiered privileged society, we need to fundamentally restructure society to adapt.
Before that restructuring occurs it is critical to keep the playing field level. These are not tools that should be controlled by a minority authority, they are far too dangerous.
You can’t, it’s an inherent contradiction. Human social structures have sophisticated and robust evolved mechanisms for establishing and maintaining trust. These dynamics are not one option among many, they are the optimum. By their definition they don’t scale to strangers around the planet. This is an immutable factor in why we have spam, bank fraud, etc. We want the benefits of trust without the cost of local constraints but wishing doesn’t make it so.
as for the rest of it: would banning a tool that breaks ROT13 make ROT13-encrypted communications safe?
ROT13 decryption does not have the same issues, and is not a good parallel here. Again, we're talking about a specific tool with specific use cases; a general algorithm being able to be used for negative ends is not the same as a tool being designed to be used for negative ends.
I also haven't mentioned banning anything; that's all on you. It really feels like you've jumped in with pre-prepared talking points rather than engaging with my comments.
To restate: "AI will benefit humanity" is a tough sell when so many people who are in to AI deliberately make tools that support the negative uses. This is an example of a project that superficially presents as high-minded, but is designed for exploitation.
A knife and a handgun aren’t comparable to a machine gun and a bomb. When you have equal access to all of those, the damage you can enact is exponentiated.
You could lie with text before, but it took effort and time and skill to do it convincingly. You could also lie with images but they took even more time and effort and skill, greatly limiting the pool of people who could do it and the possible damage.
When anyone anywhere can convincingly lie and have it do two laps around the world in a matter of minutes, the whole game changes.
It’s becoming very hard to believe that people making arguments like yours are doing so in good faith. Maybe you’re not even a person but a shill bot. That’s a very real and trivial possibility today, which is the whole point and illustrates the problem.
The photo could be staged (e.g. Cottingley Fairies), it could be altered physically (like cutting or painting over, e.g. Stalin), it could be cropped intentionally to tell a different story (plenty of examples), and more recently it could be photoshopped, etc. All of these were possible, though harder than it is now, but let's not pretend we didn't "trust pixels". We all did, just as we trusted newspaper photographs. Now that era must come to a firm end, and I believe it's a tragedy.
If you want to discredit an imagine, upload a slightly ai-edited copy of it.
This is not a new insight, and it doesn't add anything to the discussion. It's effectively a platitude.
This project is absolutely not motivated by a wish to inform, and it's disingenuous to prevaricate around that; there are countless ways to inform that don't endorse.
for fuck's sake, Photoshop existed for how many years now? you would be a fool to trust any random photo to be genuine at any point in time. yes, yes, yes, back then only the people who had spent a few days learning it could do it, and now everyone can. that makes no difference whatsoever.
We're not talking about Photoshop, because it's not a parallel here. We're not talking about trust in authenticity. These are points you have plucked from the ether. Please reread my earlier comments.
Now Nancy, a tech-phobic waitress who has a grudge against her coworker can make up an entire scenario with one prompt and her colleagues might blindly believe her.
Let's not pretend they're the same thing.
Gen AI is inevitable. Watermarking is likely futile. But in my opinion it is still very important to discuss how, as a society, we're going to live in a post-truth world now that anybody can, IN SECONDS, not only fabricate a story but also spread it to thousands of people through their social media.
"Don't trust what you see on the Internet. Trust instead what you read in a reputable daily newspaper, or Peter Jennings or Tom Brokaw on the nightly news, or BBC World News."
Today, the Internet, especially the part which is not trustable, has nearly finished killing most of the "trustworthy" news sources, by outcompeting them for ad dollars - by being way better at targeting ads (e.g. Meta) and by scientifically perfecting addiction (e.g. TikTok). What remains is mostly controlled by governments and has far from a perfect record of being fact-based and impartial.[1] There are a ton of independent people out there in good faith posting facts on the Internet, but we just agreed that we shouldn't trust what we see on the Internet.
So doesn't this become "Don't trust anything"? And doesn't that, in practice, get implemented as "Don't trust anything that challenges what you believe to be true"? This feels like a really, really bad change to our society - and I'd argue it's already completely happened.
[1] https://apnews.com/article/bbc-gaza-documentary-hamas-sancti...
Effective democracy requires an informed voter base. Society requires its constituents to be invested in its continuity. Neither of those is achievable when we completely discard trust.
AI kind of makes this worse, but also only barely. Because most people really ought to know by now that almost any content could be AI, a video of, say, Trump kicking a baby or violating a goat wouldn't convince anyone that those acts happened (unless they already believed they happened).
Thing is, we're so flooded in biased BS, and no one has any incentive to produce non-sensational, factual news. I absolutely see 'post-truth' as the inevitability. You can't "weed a garden" when it is 100% weeds. The term "news" will cease to mean facts, and just become a branch of entertainment. Kind of the way "Reality TV" went from being supposedly a documentary (e.g. COPS) to just being a flavor of entertainment, where nothing needs to be real.
Do you want to make it easier for the next Stalin?
We already have the problem of people blindly trusting shit they read on the Internet.
This sort of solution to the fake image problem, makes it easier for stalin not harder. If everyone can make fake images that is one thing. If only the dictator can, well that is much worse.
In reality, all images will cease to be trustworthy and there's nothing that can be done about this.
They've got some sort of hypervisor bypass for basically all Denuvo games.
But, they are greedy above all else. And so, we are once again seeing a resurgence of piracy. Large corporations seem to snatch defeat from the jaws of victory.
[1] https://news.gallup.com/poll/695762/trust-media-new-low.aspx
[2] https://www.businessinsider.com/these-6-corporations-control...
Which independent journalists do you like?
Losing to piracy would see companies like Netflix and Spotify not thriving.
By which definition they utterly failed.
> Losing to piracy would see companies like Netflix and Spotify not thriving.
Not at all. Netflix and Spotify do well because they are a good value proposition for the average customer. Piracy is free at point of "purchase" but is (and always has been) expensive in terms of various sorts of overhead.
I for one do not enjoy the “Which service has the classic film I wanted to watch this week?” Nor having to switch services every time I want to see a new TV series.
We need (and have!) similar “free” alternatives to the watermarked generative services. Just like I hate the yellow dots on my printed images, I am not happy to have my creative assets (I do nothing nefarious) stained with SynthID.
But this is moving the goalposts. You can win against piracy either by making piracy less attractive or by making the paid offering more attractive. The first has utterly failed, piracy remains easy as a rule, and to the extent that they've succeeded it's not only disproportionately by doing the second thing, the DRM itself is a net negative because it has such a small effect on the ease of piracy while making the paid offering worse.
Unless we're only considering final assembly. Just gotta get that weapons grade fissile material supplier lined up. That might or might not qualify as rich hobbyist territory depending on how high a price tag is permissible.
This subthread starts off with the argument that the big corps will never beat the little determined hackers, one of the founding myths of the early internet. And then every now and then a strong little branch of the argument runs up against an example and it becomes well sure, the little hobbyist hackers don't have anything there but that is because the big corps/gov/billionaires/whatever put so much into beating them.
I mean reading it all certainly sounds like the people on the little guy's side are overestimating the value of pluck, an observation Hollywood generally makes just before the heroes with pluck win for ever!
It's almost never about the level of resources the organization puts in. The usual reason is that there isn't enough incentive to do it. What is a hobbyist going to do with a nuclear weapon? Why spend your time creating one if you, like the overwhelming majority of people, have no desire to blow up a city?
Preventing something that hardly anybody would be trying to do even if it wasn't being suppressed is a lot more practical than preventing something millions of people would do given the chance.
Drugs are banned, they still exist. Many torrents flourish (that violate copyright laws), humans can't seem to stop those.
Generative AI has too much commercial utility to ever be "snatched back" at this point through legislative means.
> It's kind of a big problem for the future of the justice system and politics.
People will adapt, but this "big problem" is going nowhere.
My argument is that the grant of monopoly is a regulatory decision and the real cause of "winning". No amount of DRM would confer the same benefit because the ability to bypass it through piracy would be totally legal with no economic or other consequences and so a robust cracking and distribution ecosystem would emerge. Thats a drastically different story than when napster gets shut down, and limewire gets shut down and pirate bay gets shut down every time it relaunches. Imagine a world where there is are 1000 pirate bays
I think this is largely an incorrect take. DRM is anti consumer, not anti piracy. In fact, it has done very little to deter actual piracy (and remember it only takes ONE person to break the DRM), while affecting some casual pirates and all legitimate users. In the process, they got rid of reselling stuff you own.
It's anticonsumer, not antipiracy, never forget that. It means something like this would have happened regardless of pirates.
I think so, because their main goal is to prevent unwanted use of the digital product -- to the detriment of end users -- in more ways than just piracy. In fact, they don't solve the piracy issue.