site banner

Culture War Roundup for the week of February 27, 2023

This weekly roundup thread is intended for all culture war posts. 'Culture war' is vaguely defined, but it basically means controversial issues that fall along set tribal lines. Arguments over culture war issues generate a lot of heat and little light, and few deeply entrenched people ever change their minds. This thread is for voicing opinions and analyzing the state of the discussion while trying to optimize for light over heat.

Optimistically, we think that engaging with people you disagree with is worth your time, and so is being nice! Pessimistically, there are many dynamics that can lead discussions on Culture War topics to become unproductive. There's a human tendency to divide along tribal lines, praising your ingroup and vilifying your outgroup - and if you think you find it easy to criticize your ingroup, then it may be that your outgroup is not who you think it is. Extremists with opposing positions can feed off each other, highlighting each other's worst points to justify their own angry rhetoric, which becomes in turn a new example of bad behavior for the other side to highlight.

We would like to avoid these negative dynamics. Accordingly, we ask that you do not use this thread for waging the Culture War. Examples of waging the Culture War:

  • Shaming.

  • Attempting to 'build consensus' or enforce ideological conformity.

  • Making sweeping generalizations to vilify a group you dislike.

  • Recruiting for a cause.

  • Posting links that could be summarized as 'Boo outgroup!' Basically, if your content is 'Can you believe what Those People did this week?' then you should either refrain from posting, or do some very patient work to contextualize and/or steel-man the relevant viewpoint.

In general, you should argue to understand, not to win. This thread is not territory to be claimed by one group or another; indeed, the aim is to have many different viewpoints represented here. Thus, we also ask that you follow some guidelines:

  • Speak plainly. Avoid sarcasm and mockery. When disagreeing with someone, state your objections explicitly.

  • Be as precise and charitable as you can. Don't paraphrase unflatteringly.

  • Don't imply that someone said something they did not say, even if you think it follows from what they said.

  • Write like everyone is reading and you want them to be included in the discussion.

On an ad hoc basis, the mods will try to compile a list of the best posts/comments from the previous week, posted in Quality Contribution threads and archived at /r/TheThread. You may nominate a comment for this list by clicking on 'report' at the bottom of the post and typing 'Actually a quality contribution' as the report reason.

10
Jump in the discussion.

No email address required.

I'm going to shamelessly steal @Scimitar's post from the Friday Fun thread because I think we need to talk about LLMs in a CW context:


A few months ago OpenAI dropped their API price, from $0.06/1000 tokens for their best model, to $0.02/1000 tokens. This week, the company released their ChatGPT API which uses their "gpt-3.5-turbo" model, apparently the best one yet, for the price of $0.002/1000 tokens. Yes, an order of magnitude cheaper. I don't quite understand the pricing, and OpenAI themselves say: "Because gpt-3.5-turbo performs at a similar capability to text-davinci-003 but at 10% the price per token, we recommend gpt-3.5-turbo for most use cases." In less than a year, the OpenAI models have not only improved, but become 30 times cheaper. What does this mean?

A human thinks at roughly 800 words per minute. We could debate this all day, but it won’t really effect the math. A word is about 1.33 tokens. This means that a human, working diligently 40 hour weeks for a year, fully engaged, could produce about: 52 * 40 * 60 * 800 * 1.33 = 132 million tokens per year of thought. This would cost $264 out of ChatGPT.

https://old.reddit.com/r/singularity/comments/11fn0td/the_implications_of_chatgpts_api_cost/

...or about $0.13 per hour. Yes technically it overlooks the fact that OpenAI charge for both input and output tokens, but this is still cheap and the line is trending downwards.

Full time minimum wage is ~$20k/year. GPT-3.5-turbo is 100x cheaper and vastly outperforms the average minimum wage worker at certain tasks. I dunno, this just feels crazy. And no, I wont apologize for AI posting. It is simply the most interesting thing happening right now.



I strongly agree with @Scimitar, this is the most interesting thing happening right now. If you haven't been following AI/LLM progress the last month, it has been blazingly fast. I've spent a lot of time in AI doomer circles so I have had a layer of cynicism around people talking about the Singularity, but I'll be damned if I'm not started to feel a bit uncomfortable that they may have been right.

The CW implications seem endless - low skill jobs will be automated, but which tribe first? Will HR admins who spend all day writing two emails be the first to go? Fast food cashiers who are already on their way out through self ordering consoles?

Which jobs will be the last to go? The last-mile problem seems pretty bad for legal and medical professionals (i.e. if an LLM makes up an answer it could be very bad) but theoretically we could use them to generate copy or ideas then go through a final check by a professional.

Outside of employment, what will this do to human relations? I've already seen some (admittedly highly autistic) people online saying that talking to ChatGPT is more satisfying than talking to humans. Will the NEET apocalypse turn into overdrive? Will the next generation even interact with other humans, or will people become individualized entirely and surround themselves with digital avatars?

Perhaps I'm being a bit too optimistic on the acceleration, but I can't help but feel that we are truly on the cusp of a massive realignment of technology and society. What are your thoughts on AI?

Like I've indicated, I work in a field - translation - where machine learning applications have already been commonplace for over a decade, seeing the development of machine translation from substandard early Google Translate effort that many people still associate with machine translation with the sophisticated effort put in by DeepL and other such engines. (ChatGPT also produces an OK effort, but as recounted here, still makes some more obvious mistakes than DeepL, at least when translating to Finnish.)

Furthermore, translation is a classic example of a field where overtly enthusiastic tech types have been predicting "human worker replacement by machine" for ages and ages now. An anecdote I often recount is when, during student days, I had been drinking with a friend who also studied translation and we went to a pizza place at the end of the night. We were accosted by a drunken engineer who started explaining how translation is a dead-end field and machines are going to replace translators any day now. I replied that when there's going to be a machine to replace the translators, it's also going to replace the engineers, and he got quiet and left. (At this moment, I wouldn't be surprised if the engineers weren't replaced before the translators.)

How has machine learning affected my workload? Well, the amount of money I've been making has if anything increased during the recent years, though this is also probably natural career development (and also a necessity to answer the rising inflation). For a long time, fair amount of my work has been checking and editing machine translation, a job that is common enough to just generally be referred by an acronym in the field (MTPE, Machine Translation Post-Editing). At the same time, I'm still able to charge 2/3 of my usual word-based rate for MTPE, evidence that there's still a lot of work to be done to not only fix the various errors that even advanced models make but get the "smell of machine translation" off the text.

Obviously, this is an issue of margins. While a lot of text is translated from one language to another, vastly greater amounts of texts getting produced right now aren't, including in commercial applications. Translator workloads getting lighter and translation getting cheaper has thus far just meant that more and more texts get translated now than previously. We'll see if the wall hits at some point.

Like I've also recounted previously, during the past few years I have, if anything, got less MTPE than previously, even though machine translation has improved. This is partly just random chance (ie. I've worked in projects which just aren't that suitable for modern MT applications) but also because some customers explicitly forbid translators from using MT, presumably because end-client companies are afraid that some trade secrets end up in Google's files. Of course I can't be sure they have means to actually check if I use MT if I just edit it good enough, but I can't not be sure of that, either, and getting caught for something like this would be a good way to lose a regular client.

From what I've learned, the biggest game changer in the field - from the point of view of a working translator - was when electronic communication enabled the translation from regular in-company jobs to enterpreneuer-based freelancing. This was actually going on while I was at the university - the teachers still mentioned in-company jobs as something to strive for, but often acknowledged they probably wouldn't be forthcoming and this would (negatively) affect pay for translators. Furthermore, even before machine translation, as such, got common, there have been the so-called translation memory programs, fairly simple tools that mostly replicate existing translations to new ones, and have done their share in making translation faster. Even in white-collar fields, the automation of gruntwork is hardly a new concept.

Of course we'll have to see in the coming years how, exactly, LLM's affect this field. One particular potential field for advancement would be when we get models that can, with some reliability, provess image, audio and text at the same time, since this might have a considerable effect on subtitling (or dubbing, but that is pretty rare in Finland, outside of children's programs). On the other hand, I work in a co-operative office and regularly chat with another translator who basically does not do MTPE at all, rarely uses MT in general and is generally not particularly aware of the developments in the machine-learning field. She seems to get by quite fine, nevertheless.

I edit highly technical documents, fixing grammar and spelling, and I've long thought a bot would eventually do my job. One of the companies I work for even uses a bot, sends us the bot-fixed papers, and then we double-check the bot, fixing its mistakes. Despite this going on for years, they are no closer to replacing us, in part because the standards keep getting raised. Like a recent update to the style guide suggests we should be using wherein in appropriate spots. Using where to mean in which has been normal in English for like forever, but it seems now that the bots are doing the easy stuff, we're expected to do the harder stuff too.