FLUX 3 Image Klein(bfl.ai) |
FLUX 3 Image Klein(bfl.ai) |
Flux 2 Klein 9b also had anatomical issues as well, but this one feels practically lobotomized.
What the heck are they doing?
Is this fast/cheap at the pareto frontier? Doesn't really work if humans look deformed.
https://reddit.com/r/StableDiffusion/comments/1x79gth/why/
https://reddit.com/r/StableDiffusion/comments/1x7ktbu/enshit...
I gave Flux 3 Klein my typical human test that has never failed on newer image models and it did fail; in addition to lower quality, the fingers were definitely not the correct proportions.
Whether the cause is due to more safeguards against NSFW content is hard to confirm technically; it was more an intuition back in the Stable Diffusion XL days but I suspect modern training paradigms are better at correlative inference.
Was creating characters for a clients social media avatar and so was doing various tests with the latest bunch of models and omg the characters from flux were like deliberately ugly I was shocked
At high resolutions, structural integrity on people can definitely fall apart like older models, where you get one person turning into a long spaghetti spanning across the frame. It might be that you need to do grounding by generating some kind of scene reference at its stable resolutions first then having it use that for the larger resolution like older models too.
They say that their prompt "upscaler" model or system prompt are essentially necessary for the model, but my results have been hit or miss with that claim. Some basic prompts are better, some upscaled prompts are better. I think that if you gain an intuition for how the model understands things, you might get better results by default by hand crafting prompts specifically for it.
Some of the stylized art I'm getting out of it at higher resolutions are really nice and I prefer them over other models.
All of these models seem to have their own character in terms of system requirements, performance, prompt adherence, artistic outputs and so on. None of the models I have tried are a complete homerun, so maybe in this case the model feels a little inconsistent in some ways, but it's a model I will probably keep around.
When the whole stack comprising the model is used, it occasionally produce erroneous anatomy and require running qitha different seed to get a good result; this is much less common than with Flux 2 Klein. Also, the step distilled version of the model, particularly, isn't great at generating photo-quality skin, despite otherwise being good at producing photographic-seeming outputs. (Even some of that might be exaggerated, because it was what I saw before fixes to the Comfy templates.)
But a lot of people on Reddit (and some here, I would guess—none are explicit about it but that's the only thing I can think if that would make the “worse than Flux 2” comments remotelt understandable) have decided that they don’t like that BFL’s approach to generality in prompt handling for the model was to train it with a particular style of detailed prompt and provide a LLM-based prompt rewriter (they call it the “prompt upsampler”) to process raw user prompts into the style of prompts the model accepts, and despite BFL flat out saying the model should bot be used without either the provided upsampler or some alternative one (e.g., the published system prompt used with a different LLM), and that that will produce poor results, have decided that the correct way to judge the model is by not upsampling prompts, and pretending that the upsampler isn't part of the stack. This makes generations far worse (it especially increases body horror, probably—from trying it and watching latent previews with and without—because it makes prompts more ambiguous making it harder for the diffusion process to resolve where new elements should be drawn or extra drafted elements should be pruned early in the generation process.
The problems being complained about aren't mostly what you'd expect from NSFW avoidance; it does have some of that, too, even though it is not particularly shy (or low quality) about nudity so long as the genitals specifically aren’t visible. It’s not great with women’s nipples/areolae, but it doesn't avoid them. Its clearly undertrained on NSFW material, but it doesn't look particularly moreso than most corporate base models; its usual for community LoRAs and finetunes to close that gap.
Bounding box support is nice, though the way it is aonewhat soft guidance makes it tricky to use reliably for straight t2i (it looks like it may be atronger for tying references tobit) and, while the Comfy workflow has a tool to help draft it, I think there are some wrinkles with upsampler interaction with it that the workflow doesn't account for.
That said, and despite being great and creative as a first pass composition model at high res that I will definitely keep in my t2i toolbox, it is definitely generally underwhelming for straight t2i, especially given that MOSS Image 5B just dropped, which despite its claim that its strength is in text generation and structured layout (a popular focus for recent models), is one of the best all-round base models I’ve seen in breadth of content knowledge, prompting flexibility, output quality in its strongest resolution range (seems to be 1-2MP for general purpose—full-frame “artistic”, not its structured layout text heavy focus—work), creativity, lack of censorship or undertraining, etc.
How many man hours go into not allowing things that might break some law of offense? How many hours wasted trying to change the meaning of words and related punishments.
I mean it doesn't make sense to me in any form of efficient civilisation.
Still though, it's a lot like the porsche mission S vs the tesla roadster situation with the weights release. Moss Image dropped which looks far better at the moment, leading to a "why Flux?" question in the community.
I still think the edit capabilites are absolutely excellent, but for t2i I'd try out moss: https://huggingface.co/OpenMOSS-Team/MOSS-Image-Base/tree/ma...
I've been VERY impressed with Moss' design capabilites out of the box. Some samples:
https://image.non.io/9a32f732-668e-4fb3-bfef-13f0f40a0972.we...
https://image.non.io/8b5ee315-1ffd-4985-8ff0-d62e19d33f29.we...
https://image.non.io/5130501a-5c07-4635-82f5-fa64d60e8871.we...
IMO the taste is lacking, but it has some of the best text reproductions I've seen with their new VAE. Here's a type ramp example:
https://image.non.io/57246870-a245-4875-983f-993656e09e3d.we...
Annoyingly, the original Qwen-Image was actually Apache 2 before they switched over unfortunately.
In addition to Moss, Boogu Image 0.1 is a unified model which came out in June and is kind of being slept on right now, is actually pretty decent and falls under the Apache 2.0 license. It scored surprisingly high on my GenAI benchmark (comparable to Krea 2 and Ideogram 4).
This example is a rough comparison to what actually happens, but it does attempt to demonstrate what compression and knowledge are, and how patterns, symmetries, and extrapolation/interpolation can make describing/modeling a complex system much more efficient.
Models can even go a step further, offloading entropy to the input. An efficient model exploits predictable structure; the remaining details can be expensive to compress further. The input can supply whatever additional information is necessary to produce the desired output within some margin of error. The information required depends on the model’s efficiency over a given domain, the structure of that domain, and the required precision of the output.
Consider generating an image of a pebble driveway. Most models today will generate a plausible arrangement of pebbles using their learned distributions. Reproducing a particular arrangement requires the input to convey the details that distinguish it from other plausible arrangements. The more closely you want to reproduce it, the more informative the input needs to be—potentially including a reference image of the arrangement itself.
This certainly raises a lot of open questions that are fun to pursue, such as the smallest possible model that can recover a complete description of our universe from minimal input.
This seems like a very competitive price for image models if it can compete on quality, no?
For example, Krea 3 released yesterday starting at $0.06/image.
Meanwhile a decent LLM that can do tool use and code and reason tends to weigh in at a minimum of 30B parameters, and you need over 100B to get good performance.
Do LLMs just contain more information or are diffusion models more efficient at compression?
I saw some work on language diffusion models a while back but I think they tend to have problems with reasoning versus transformer type models.
Image models are essentially a mapping of text embedding space -> image. So the clearer and cleaner the text embedding space is the better model you get as you need less weights trying to interpret a text prompt, recent image models even use multimodal versions of LLMs (Flux uses Qwen3 VL) so all the visual separation was done beforehand making the model even more efficient.
edit: Maybe a better analogy is that the image models are only half the model in a encoder-decoder sense, where the LLM is a pretrained frozen encoder and the image model is the decoder.
The get a proper LLM they have to model all of human knowledge regarding patterns, physics, biology, social interaction, skills, history, etc, etc. For images they have to recall what a dog looks like in a still photo. The image models aren't even necessarily good at a wide range of novel situations; usually they get used for stock scenes.
Natural evolution has also had a much easier time coming up with vision models (everything with eyeballs) than complex language models (as far as we know only a smallish family of monkeys).
Any lossless text description of a given image would just be a structured text output of the exact pixel values, or an encoding that losslessly exploits regularities. Anything less is categorically lossy. An ordinary semantic description of a reasonably complex image will generally be lossy. A short, lossless text description would need to exploit regularities in the image, such as a solid-color image, or a basic pattern or sequence which is easily reproducible, such as a precisely specified checkerboard image.
And being able to represent images losslessly in text simply establishes text’s capacity to encode information. It doesn't establish an LLM’s holistic understanding of images. There is heavy lifting in the phrase “images are a subset.” An image can be almost any conceivable perceptual arrangement of data. The bounds are not clear. Maybe what you meant to suggest was that images of our natural world contain exploitable regularities.
> Natural evolution has also had a much easier time coming up with vision models (everything with eyeballs) than complex language models (as far as we know only a smallish family of monkeys).
It isn't appropriate to explain complex biological systems in terms of today's technologies. This is something people have been doing for a long time. The mind is like a a book, a loom, a camera, an engine, a computer, an LLM/vision model. Etc. The cognitive abilities required for an organism to meaningfully interpret its vision can possibly largely be the same cognitive abilities underlying speech, and all that is missing for a brain to exploit this might be sufficiently advanced vocal cords or manual dexterity; nothing to do with the brain itself, but its auxiliary organs.
Then I considered whether the universe of imagery is simply smaller than the universe of ideas—which must, itself, include the universe of images, too.
But finally, I'm thinking maybe images are just harder to benchmark.
Or maybe they're _not_ actually worth 1,000 words.
When you say "look the same", what do you mean?
I understand this was just a casual one-off comment, but as presented I'm having a hard time understanding what you're trying to convey and if you have appropriate domain knowledge: Your "looks the same" and my "looks the same" might be vastly different, especially depending on context.
Diffusion models, surely, are "trained with next-[pixel] prediction", and that should suffice, no?
https://github.com/black-forest-labs/flux-3-image-klein/blob...
Some of this understanding is in the input embeddings themselves, embedding models do a lot of heavy lifting behind image generation models.
I posit that you can theoretically achieve the same capability in a model trained on the right sequence of "images" as you can purely text; both are turned into embeddings and can ultimately convey the same exact relationships. I don't think it's very useful to try and create delineations between text and image inference, especially as more models move towards native multimodality.
look at any study of llm depth vs multihop reasoning capability (here, just to help https://www.latent.space/p/ainews-death-of-params-zai-ceo-ji... but theres a long line of others).
i will grant that people do do "reasoning in image models" type benchmarks, and it's not nothing, but its kid stuff vs what we make LLMs do, and the only way you get image models that basically do reasoning is you glom a diffusion head on an LLM backbone, which is basically gpt image 2.0 and above
none of which is to dispute the original question which is perhaps "why are image models so smol vs LLMs" - which i agree with and wish there were funding for scaling them - but the abject failure of sora indicates that perhaps our data isn't nearly good enough (again pointing to another thing - much easier to pretrain and posttrain LLMs given quantity of text data)
It’s bafflingly worse than other comparably sized ones: Qwen-Image 2.1 7B, Z-Image Turbo 6B which was released practically a year ago, even its own predecessor Flux 2 Klein 9b.
Even if we concede that the Klein variants are intended more as editor models, the results I've seen on Reddit aren't that impressive either.
I feel like they just handed their collective heads on a platter over to the team over at Krea especially since Krea 3 addresses the major limitation of Krea 2 which was strictly text-to-image only.
Safetymaxxing at the expense of benign output quality is sad to see.
European edit model cannot make it easy to nudify people… they lobotomize it, it’s trash, Mission Accomplished!
Another reason that China is pulling ahead daily. They can leave in some anatomy and not knee cap their own product, leave in IP, and give away the model so as to undercut API/credit sales of US and EU models.
Finally… the Neo Puritan death march is having a direct financial toll.