Ask HN: Know of any tool that uses NNs to alter text in images?

3 points by tbwriting 3 years ago | 1 comment

I've seen Facebook's TextStyleBrush (https://www.louisbouchard.ai/textstylebrush), along with a some specific papers with algorithms that do this (STEFANN [https://prasunroy.github.io/stefann/], SwapText [https://openaccess.thecvf.com/content_CVPR_2020/papers/Yang_SwapText_Image_Based_Texts_Transfer_in_Scenes_CVPR_2020_paper.pdf]).

Curious about whether anyone knows of a user-friendly tool out there that does this, e.g. you feed it a photo, some boundaries for the text to be changed, and the new text to replace it. Haven't found one, considering building.

sargstuff 3 years ago |

Picked a few articles from results of search engine terms, "app to translate using camera" and "finding blocks of text in an image using python"

Google Lens mobile translate app [1] via smartphone.

Article walking through how Google Lens does the translation.[2]

Article about the text box boundary(s) [3]

[1] : https://blog.google/products/translate/google-translates-ins...

[2] : https://medium.com/technovators/scene-text-detection-in-pyth...

[3] : https://nanonets.com/blog/deep-learning-ocr/