For example here's how weird Friends is in German: https://www.youtube.com/watch?v=nCoNSZV--z0 . Or Italian: https://www.youtube.com/watch?v=wO5qTzvyQ1s
Can AI detect the emotional tone of sentences yet, and recreate it in the target language?
My favorite conversation has been getting it to tell me about marshmallow vs marshmellow spelling and pronunciation, it became very strict but patient with me
It can reply in other languages too, but I cant detect dialect as well to say
They are even dubbing reality survival shows, so somebody has to sit in a studio and groan as if they are climbing a slippery hill in Alaska.
Can't talk for the German dubbing, but the Italian version sounds natural to us Italians while the original, English version, is hard to relate to and create a bond with. The dubbing makes it "close" to home if that makes sense. You might feel it's weird because you've grown accustomed to watching the original version while also immersed in everything that sitcom portrays.
This is a shocking parenthetical.
https://github.com/cubbK/dubbing_ai_netflix_client
I want to learn swedish and because there are so few dubbed movies in Swedish I take the subtitles(Netflix is good at having subtitles in different languages) and text-to-speech it :)
Do you think it's usable for learning? Seems like you could end up with some quirky learnings.
So, no, new jobs will not be created, except the kind of jobs that crush the human spirit into oblivion so that the rich tech oligarchs can play God.
Having a Babelfish is all well and good. Until it stops working, and you realise no one can understand each other any more.
Ironically localization is often pushed by well meaning Americans who only speak one language. "Oh, you're in a French speaking region. You MUST want French language. Let me force it down your throat while I prance around virtue signalling about how inclusive we are"
You obviously cannot use this to translate songs or movies because this method loses important information like voice, intonation, etc.
So it is still better to use subtitles.
I was like “silly dude doesn’t know how computers work” but maybe I was the silly one who can’t dare to imagine how something like that can work.
Yandex browser does the most impressive version of this and for free but only to Russian I believe, its quite amazing it does appropriate different voices and follows the correct intonation for everyone, just takes a few seconds for a YT video.
I just physically can't watch them. I wanted to watch the Blackadder series, but I couldn't even get through one episode.
If you can train an instrument model on laugh tracks Demucs should do that.
Is there any assessment about how good the translation is ?
For a sufficiently small period of time, there absolutely is a "lump of labor". If I were to go into a county with robots and rent them out to employers for 1/4 of the wage of their current employees, and they all fired their employees and accepted my robots, do you really believe that all of ex-employees would be able to find work again within 6 months? Or even 70% of them? What about their new wages? Do you think these new jobs would pay as well? I have a hard time believing that to be the case.
There is a point about industry size (not that many countries dub all their movies), but it is one of the intellectually more challenging professions.
It's fairly clear by now that that is not what happens and that the real AI risk is not the "grey goo" one of everything being converted to nanomush, but the age-old one of landlordism soaking up all the returns to economic activity.
AI certainly means everyone will be able to create 'art' and as a result we'll have more art than we know what to do with, music and images are already confetti, soon so will full length 'films/movies'. That leaves anyone who can actually sing, paint, play, dance, in prime position to take up those mantles.
What are you talking about? Many of us have tech jobs with much more comfort, creativity and autonomy than the jobs they displaced, and computerisation has made it much more practical for those who dare to strike out their own rather than needing wealthy family or friends before you can even begin to think of starting a business.
Nobody currently can say which patterns it cannot extract, hence "we always figured out new jobs" is ... challenged
Um, jobs where someone under age 30 can be earning hundreds of thousands of dollars a year programming them?
Not a very fulfilling job in my opinion, except for the money.
and the video can be the products, or tutoriala for another products. This allows me to do more, not less.
I agree with the point about "wealth accumulates at the top" though. Maybe Karl Marx was right about a thing or 2. Maybe the distribution of wealth should not fall into the hand of non-elected corporations. Whatever it is, it should be determined by a democratic process and not some "market mechanism" that is actually just arbitrary algorithms optimized for metrics no actual human cares about.
citation needed.
Now, as veterans of anime forum wars will know, subtitling is nearly always better than dubbing, and I hope this tech is capable of that as well. Most media systems let you put a whole load of subtitle tracks on and then pick one.
There's far, far too much content out there for more than a fraction of it to be ever professionally translated. While we should expect human translation review and a spot of localization for officially released works, most of the internet is just free content being given away for very little return. And that's where automatic translation is going to shine: release the non-English meme champions! Let us have a look in Bilibili!
Which languages someone speaks isn't simply a matter of "individual preference". Learning a new language takes a lot of time and energy, and people only have the time to learn a handful of languages in most cases unless they can make a career out of linguistics.
i.e. I know a sprinkling of words in various languages, and I've started learning Japanese, but I simply don't have the time to also learn Mandarin, Korean, Cantonese, etc. So I appreciate it when authors of works in those languages offer localizations into a language I can speak, or when third parties spend their time translating stuff for free to make it available to a wider audience.
What's the advantage of closing knowledge and communication off from a wider audience?
Maybe I'm misunderstanding and you're just angry about Google Translate/DeepL etc (which I have a strong distaste for since they're Fake)
Translating? Machine translation is already well established.
Copyright? IIRC the most popular voice generation company (ElevenLabs) uses copyright-safe models, where the sources for the base model were already consenting.
Likeness? As you said, just use a synthetic voice.
Replacement of jobs? Not really a legal issue. It's not much worse than self checkouts or driverless cars, for example. The only reason we're talking about it is because it affects white-collar workers and not blue-collar workers, and voice actors are more likely to be celebrities than cashiers, for example.
If a factory introduces automation, no doubt that the resulting job losses are a problem that must be addressed.
However, the lump of labor refers to the big picture - in the same time span, other jobs are created elsewhere. If they weren't, considering that automation started at least 200 years ago (in the most limited sense of the term), the whole planet would be out of jobs by now.
LLMs provide a certain level of mid/low quality content in nearly all mediums. And given that there many people producing such mid/low quality content today, LLMs will have an impact. LLMs affecting sales writers? Sure (not the best sales writers but the point is sales is mediocre but acceptable is a norm).
And say LLMs specifically. There's good evidence the technology has roughly peaked. That doesn't mean it's impact has peaked but it's indication that "all jobs at risk" might be an exaggeration.
We get both "cheaper, worse versions of material that would be dubbed anyway" but also "material that nobody would ever pay a human to dub".
If for no other reason, this tool is a net-positive because it may raise the bar on the quality of dubs expected from dubbing actors.
No.
Lets ask the influencers, the twitch celebs, the podcasters id they would prefer to shovel horse crap, or play with their e-device all day.
And to be completely fair, the manufacturing jobs may be gone because elected leaders were told it was OK export the vast majority of those jobs (millions) abroad, where labor doesn't have govt benefits or red tape. This makes new jobs go to foreigners instead of staying stateside.
So, we all save a few pennies on each item made in china and sold on Amazon, at the price of nuking all US craftsmanship and artisans.
The job elimination can mean people who spent decades honing a craft and no longer have any realistic job opportunities at a remotely equivalent pay level, and have no path into a new career because they're now decades behind (or too old to realistically train up a new skill if they're a physical laborer). Sure, it's progress, but it's weird to imply that all the labor that's being eliminated lacks value or artistry.
And the new jobs are frequently things like acting as a babysitter for an AI or sitting in a call center pressing buttons. Certainly, this is also "work", but if we're comparing it to shoveling horse manure I wouldn't necessarily consider it elevated much even if it's more comfortable.
That reads like the premise of a joke: “What’s the difference between a manure cleaner and a social media influencer? The former reduces the amount of shit in your life, the latter adds to it”.
Preferences aside, if we take into account both physical and mental damage, I wonder which job is more harmful. Not only to the practitioner, but society in general. I’m not advocating for bringing back the job of horse manure cleaner, but I don’t think social media influencer should be a job either.
You made a good point regarding exporting jobs.
False dichotomy. Not every modern-day twitch celeb would be shoveling manure. And another false dichotomy: I was not arguing for either NOW or THE TIME before cars. And I wonder how many people would trade their modern influence job for shoveling manure in return for living in an area with cleaner air. Also, ask the question again to people living NEXT to tire factories that stink and whose only job is collecting garbage NOW like bottles from trash because they don't have enough education to get a proper job.
Besides, I am one of those "influencers" -- not exactly on Twitch, but a full-time content creator. And I WOULD go back to those times.
Why is it that every time I bring up the dangers of technology, some techie HAS to bring up cars versus manure shovelers, as if that settles every argument about the dangers of technology? Rather intellectually stifled, I feel. And rejecting technology doesn't mean going back to the way things WERE; rather it means making changes NOW to go to a NEW future that has less technology.
But also yes a creator should be able to ban translations.
Seems reasonable. However, given French media quotas e.g. https://www.independent.co.uk/arts-entertainment/music/news/... , companies may be providing stuff only in French to ensure that it meets a legal requirement.
> But also yes a creator should be able to ban translations.
We've been round and round this for at least twenty years; creators like being able to ban accessibility measures like "read aloud this document" or "display it in a more readable format" or "fix the audio mix so the dialogue is audible" or "buy the DVD from a different country", but that's not exactly welfare-maximising. Are translations an accessibility measure? What about a translation into ASL?
(on the other hand, the reputational risk of a poor translation is real, and in the extreme can result in someone being cancelled for something they never even wrote)
I do, the Amish do, and quite a few other people against technology DO want less. In fact, even ordinary people (non-techies) often tell me technology is too entrenched. What about those people ditching smartphones for dumphones. I don't think that tech improves things and I DO want less.
I can't find the article, but it said something around the lines of "each Microsoft Word user thinks that there are too many functionalities, and wants less".
His remark is that each user uses different functionalities, so one can't reduce a product's functionality in a way that satisfies everybody.
Everybody would sure love to have a smartphone tailored 100% to their usage, but in real world, either they accept smartphones in toto, or they just use a brick. In generalized form, the same concept applies to tech.
But back to the primary: is it really tech that some want less of, or the negative effects caused by its overuse/abuse? For example, IIUC the Amish are against modern tech primarily because it's changing their communities in ways they aren't fond of. But they still use tech that's not so modern, such as buggies (as opposed to just riding horses), manual plows for farming, saws and hammers for building, etc. Can anyone even go less than that? And that relative "less" only moves forward over time.
I doubt you want much dark in a neighborhood though, particularly if there are unsavory elements potentially roaming around. A sliver of light may be the difference between someone being attacked or a home robbed.