nsfw.rest – Keep your platform safe of NSFW content, all for free

nsfw.rest – Keep your platform safe of NSFW content, all for free(nsfw.rest)

13 points by lngzl 4 years ago | 16 comments

Can you consider giving a score instead of a binary decision? Or differentiate between, say, beach pics and true 18+ content.

Edit: The accuracy leaves a lot to be desired - you can paste any images from clothing stores of models in dresses or tank tops and it will flag it as NSFW.

The "AI" seems to replicate an Islamic fundamentalist - a woman in a burqa did pass as SFW ;)

Google offers a hosted SafeSearch version [1] which has a lot more nuance: https://cloud.google.com/vision/docs/reference/rpc/google.cl...

lngzl 4 years ago | |

It gives a score as well, in the API, I can for sure add that to what you see on the "Try out" page. I was planning on adding a button where you could see the raw data.

swiley 4 years ago | |

The whole thing is built to export moderation to an external service. It's a bit creepy IMO.

lngzl 4 years ago | | |

I totally get that. That's why I'm planning on making the service (or at least parts of the service) open source. You can already get insights in the storage usage of the server through status.lngzl.nl (click scan.nsfw.rest). If you upload files, the storage size does not increase.

Also, one of the things I should make a little bit more clear is that it's best paired with data that will be made public anyways (for example, a social media platform) and shouldn't be run on private images (even though it's not storing anything it's probably not needed for those use cases).

soared 4 years ago | |

Corporate uses of nsfw filters typically want to filter out clothing store models and similar content. “Brand safe”

tentacleuno 4 years ago |

It's a good idea in theory, but what if it shuts down? And what about the privacy implications of sending all images to some server across the world?

lngzl 4 years ago | |

That's a really good question! I'm planning on making parts of it open source and for mission critical applications (for example, companies like Discord) that they have the option to host it on their own hardware. If the project fails, I'll make it completely open source so that people can continue to use it.

tentacleuno 4 years ago | | |

Oh brilliant! All power to you, then man :-)

peanut_worm 4 years ago |

It marked 3/4 SFW images as NSFW and then marked the only NSFW image I uploaded as being OK.

I am not sure this thing is very accurate at all.

Elidrake24 4 years ago | |

You’ve got me curious; would you mind sharing the images used? The SFW images that were mislabeled, rather.

peanut_worm 4 years ago | | |

I used a picture of myself, a picture of a tan colored bird and a Mortal Kombat character and it marked them all as NSFW

lngzl 4 years ago | | |

I added a number from 0-100 how confident it is

nextaccountic 4 years ago |

What are the API limits? That is, how many images scanned is too many?

lngzl 4 years ago | |

Currently, no limits. As long as it doesn't look like a DDoS attack nothing will be blocked.

cucumb3rrelish 4 years ago |

Amazing accuracy, I tried to trick it but it got everything right

lngzl 4 years ago | |

Awesome! It's based on an open source model :)