self_made_human
amaratvaṃ prāpnuhi, athavā yatamāno mṛtyum āpnuhi
I'm a transhumanist doctor. In a better world, I wouldn't need to add that as a qualifier to plain old "doctor". It would be taken as granted for someone in the profession of saving lives.
At any rate, I intend to live forever or die trying. See you at Heat Death!
Friends:
A friend to everyone is a friend to no one.
User ID: 454
I miss the old BC,
straight from Canary Wharf BC,
the Alawite rule BC
I hate the new BC,
This shtick got old BC,
Breaks all the rules BC,
thinks the mods are fools BC,
Ahem. Count, the mods are not retarded. I might often be quite entertained by your shenanigans, but they're better reserved for /r/drama, and being occasionally amusing isn't sufficient to let you off.
Hell, I was going to let you off, but then I remembered I have to actually set an example every once in a while, and I took a look at your moderation log. You have that one AAQC to your credit, and a laundry list of warnings, temp bans, and even a perma ban that was cut down because someone spoke up for you.
The second-last entry is "More baiting. Really should permaban him next time."
I really dislike permabanning people. Hate to do it, I'm a bleeding heart that way. I will find a middle ground and say you can sit in the corner for another 60 days, and consider that lenient. In the meantime, you can consider opening a bait-and-tackle store or drying your copious tears with stacks of money, or whatever it is finance people do. Consider this provisional, if the other mods want to extend it, or make it permanent, I'm not going to say a word.
I have to give it to you, if this is bait, then it's well done. From most other commenters, I would have assumed that they had genuine, sincere concern.
C'mon George, 90% of Indian men end up with a pot-belly eventually, no points for that guess haha. Of course, Ozempic must have its say.
conservatively cut
Hair sounds right, but I have faded sides and back. No overbite, I have excellent teeth! At least 2 people have asked me, unsolicited, if I had them done in Turkey, though they were very drunk.
I, apparently, have surgeon's hands. A surgeon said so! Ignore the fact that said surgeon is my dad. But women do like 'em.
Hmm.. On the colors. I think you're on to something there.
Still not a fan of those spikes off the field.
Genius is never appreciated in its time. Alas.
You could be a sympathetic minor character in a Spielberg movie set in New Delhi, but you get revealed as evil in the end.
I do not know what this implies, but I suppose getting eaten by a dinosaur isn't the weirdest thing that could happen in Delhi.
I think I've described myself quite a few times, but I'll bite.
I'm usually shy of card games or deck builders, but I've heard good things about it. I'll give it a shot!
I'd be happy to take a look at yours if you share a link!
(Theft of Fire was great, the author needs one lit under his ass so he comes out with the sequel quick)
I'm an early adopter of LLMs, but using them to "write" the thing would be counterproductive. If I had to give an estimate, less than 1%.
I use LLMs for:
- Editing
- Brainstorming
- Research
- As an alpha reader
Research is the big one. I remember, back in the GPT-4 days, I asked it to help make a certain Jamaican character's patois more realistic. Didn't think much of it, till six months later, when an actual Jamaican reader left a comment saying that he was really impressed at how authentic it was, and asked me if I'd asked a native speaker.
Writers are often advised to write what they know, and it's remarkable how easy it is to know more these days. I used to trawl Wikipedia articles and crib notes back in the day, now you can just ask an alien intelligence.
Hmm.. What else? There are half a dozen chapters I illustrated with the help of AI image generators. More of a novelty than anything, but it was super cool that it was even an option.
No.
(You're gorgeous)
As I elaborated on in another comment in this thread, I do not think that some moving of goalposts is necessarily illegitimate. Our specifications can be incorrect, no one's immune from good old Goodhart.
Yet AI skeptics tend to make moving the goalposts into the entire sport. I will grant that their objections exist in a range of reasonableness, from genuine dissatisfaction with current approaches to AI, to Gary Marcus's not even wrong nonsense.
There is a more subtle issue with LLMs writing computer programs. We may be underestimating the effort that goes into cleaning up LLM messes. LLMs learn to program from code bases written by humans. Not just written by humans, maintained by humans. So the bugs that humans spot and remove are under-represented in the training data. Meanwhile, the bugs that evade human skill at debugging lurk indefinitely and are over-represented in the training data. We have created tools to write code with bugs that humans have difficulty spotting. Worse, we estimate the quality of the code that our new tools produce on the basis that they are inhuman and have no special skill at writing bugs that we cannot spot, despite the nature of their training data.
This is an interesting concern, and I mean that seriously. Fortunately, it doesn't seem to be empirically borne out. LLMs are increasingly better at solving all bugs, not just obvious-to-human ones. The ones in commercial production are not base models, naively concerned only with the next most likely token (and which necessarily includes subtle bugs that exist in the training distribution), but they're beaten into trying to find any and all bugs they can catch. Nothing in our (limited but not nonexistent) ability to interpret their behavior or cognition suggests that they're deliberately letting bugs through because they seem plausible. I am reasonably confident in making that claim, but I hope @faul_sname or @DaseindustriesLtd might chime in.
At the end of the day, there exist techniques like adversarial training to make such issues not a concern. Ideally, with formal verifications of code, you can't have unwanted behavior, ruled out by mathematical certainty. Of course, interpreting that you haven't made errors in formulating your specification is a challenge in itself.
One old school of AI imagined that the language of thought would be importantly different from natural language. The architecture of AI would involve translating natural language into a more rigorous and expressive internal language, thinking in this internal language and then translating back to natural language for output. LLMs do perhaps partially realise this dream. The tokens are placed in a multidimensional space and training involves discovering the latent structure, effectively inventing that training run's own, custom language of thought. If so, that is a win for the bitter lesson.
There's been a decent amount of work done on dispensing with the need for tokenization in the first place, and letting the LLM operate/reason entirely in the latent space till it needs to output an answer. It seems to work, but hasn't been scaled to the same extent, and the benefits are debatable beyond perhaps solving minor tokenization errors that existing models have.
Human language, as used, is imprecise, but you can quite literally simulate a Turing machine with your speech. I don't see this as a major impediment, why can't LLMs come up with new words if needed, assuming there's a need for words at all?
I am agnostic on LLMs being conscious or having qualia. More importantly, I think it's largely irrelevant. What difference to me does it make if an unaligned ASI turns me into a paperclip but doesn't really dislike me?
Is a horse happy about the fact that the tractor replacing it isn't conscious? It's destined for the glue factory nonetheless.
We have no principled or rigorous way to interrogate consciousness in humans. We have no way of saying with any certainty that LLMs aren't conscious, even if I am inclined to think that, if they are, it's a very alien form of consciousness.
You mention an entity being 'cognizant' of something, but I would have thought that's the thing obviously missing here. To be cognizant of something is to be aware of it - it's a claim about interiority.
I'm talking about whoever is doing the assessment of consciousness being "aware" of the fundamental limitations of the entity they're testing. I could, in theory, administer a med school final exam to Terence Tao, and he'd fail miserably. I would be a bigger idiot if I went on to then declare that Tao is thus proven to not be as smart as he seems. That meme about subjecting a monkey, fish and elephant to the same objective test of ability in the form of climbing trees, while usually misapplied, isn't entirely wrong.
I also don't mean to make any implications about "interiority" here. I would happily say that an LLM is "cognizant" of fact X, if say, that information was in its training data or within the context window. No qualia or introspection required.
You're probably right. The biggest driver was just being able to sneak in games while work was slow.
I just found out that Total War Medieval II is available on mobile devices, and I'm tempted to buy it. It's one of the few entries in the franchise I missed out on, I played more than my fair share of Rome 1, it ran surprisingly well on a shitty 'netbook'.
Unsure whether to buy it there, on pc, or just hold out for a remaster.
Beyond what @sarker pointed out, Grok 4 is practically deep-fried through training on test sets, and it only managed a 12% the last go around. OAI isn't the most trustworthy company around, but I don't think they're fucking around here.
Diminishing returns != no returns.
Per year, it costs more to send someone to college or uni than it does to send them to school. If they come out of it with additional skills, or even just the credentials to warrant that investment, it's worth it. Even if you need to go into temporary debt for that purpose, as long as it's something less stupid than underwater basket weaving..
Just look at the wage disparities within humans. A company might be willing to pay hundreds or thousands of times more for a leading ML researcher or quant than they would for a janitor. The same applies to willingness-to-pay for every more competent AI models. Could you not afford to pay for AI Einstein if your competitor will?
Training costs are still going up, it isn't all test time compute. I don't know if we're going to have super-intelligence too cheap to meter (as opposed to mere intelligence on par with an average human), but what can we do but hope?
I would endorse something like:
"Intelligence is the general-purpose cognitive ability to build accurate models of the world and then use those models to effectively achieve one's goals."
Or
"Intelligence is a measure of an agent's ability to achieve goals in a wide range of environments."
This, of course, requires the assessor to be cognizant of the physical abilities and sensory modalities available to the entity. Einstein with locked-in-syndrome would be just as smart, but unable to express it. If Stephen Hawking had been unlucky enough to be born a few decades earlier, he might have died without being able to achieve nearly as much as he did IRL.
Thanks. Looks like AG came out six months before it.
An interesting idea. I think it's not being actively pursued because, companies like OAI don't see the economic value in such niche specialization unless it's for something as lucrative as say, producing a superhuman programmer. There's not much money in winning the Nobel Prize for Literature.
They also seem to me to be hoping that it's better to have general capabilities, and then let the user elicit what they need through prompting. If you want high-brow literary criticism, ask for it specifically, but by default, they know that mid-brow LM Arena slop and fancy formatting wins over the majority of users. Notice how companies no longer make a big deal out of the potential to make private finetunes of their models, instead claiming that RAG or search is sufficient given their flexibility and large context lengths. Which is true, IMO.
OAI did kinda-sorta half-arse personalization with their custom GPTs, but found no traction. Just the standard model becoming better made them obsolete.
I am skeptical that optimising for maths and engineering ability will produce intuitive social machines because, well…
Heh. Good one. However, look at Elon Musk or Zuck for examples of people who definitely lean more on technical abilities instead of people skills.
Gary Marcus failing to beat the stopped clock benchmark of being right at least twice in a day:
To an extent, they're forced to be! In a lot of mushy-mushy realms like literature, if you ask ten people to choose the "best", you'll get eleven different and mutually exclusive answers. And there's no objective way to grade between them. The closest would be RLHF, which has obvious weaknesses.
(Is JK Rowling the best living writer because she made the most money off her books? That would be a rather contentious claim. So we don't even know what to optimize for there)
I believe the hope is that there's strong expectation that there's some degree of cross-pollination, that making these models great at code, maths or physics will pay dividends elsewhere. Seems true to me, but I'm no expert.
The Turing Test explicitly allows for just about any query under the sun. Literally no one, including the people submitting their bots to such a challenge, would make such an objection. If they did, they'd be laughed out of the room by their peers. You're making up a hypothetical here.
I don't deny that some moving of goal-posts is justified. AI intelligence is far more spiky than their human counterparts, and a lot of unexpected weaknesses exist alongside clear strengths. If, in hindsight, the metrics did not correspond to the skills we imagined, it is fair to challenge said metrics. I might promise to buy a car that does >x MPG of diesel, but if you then give me a car that's only there because it uses petrol, then I don't want your car. Worse, it might require a solid rocket booster and fall apart when it gets to its destination. A hospital that rewards nurses in an NICU for ensuring that preemied gain weight won't be very moved if the latter argues that feeding them iron filings was an effective strategy.
Words can be imprecise.
There exists no human alive that has as much crystalline intelligence or general knowledge as even an outdated model like GPT-3, maybe even 2. Expectations existed that an AI with such grossly encompassing awareness of facts would be as smart/competent as a polymath human. This did not turn out to be the case. We have models that are superhuman in some regards, while being clearly subhuman in others, being beaten by small children in some cases.
They are still, as far as I'm concerned, clearly intelligent. Not intelligent in exactly the same way as humans, but approaching or exceeding peer status despite their alien nature. To deny this is to be remarkably myopic.
We have models that can:
- Compose music.
- Win the IMO
- Control robots in physical environments .... blah blah blah
The space of capabilities they lack is itself becoming increasingly lacking. If such an entity isn't intelligent, then neither am I, because I couldn't solve the IMO or play chess at 1800 Elo like GPT 3.5. If I still am somehow "intelligent" despite such flaws, then so are LLMs. I promise you that even if I were to flatter myself and claim I could get there and beyond with sufficient effort, the AI will be beat me to everything else. This hold true for you too.
I should have put that in quotes. I'm not that much of a wordcel apologist, even if I'm a wordcel.
I'll take your word for it. My eyes glaze over when I read this posts. Now that you mention it, he certainly does strike me as a Hananianite or a Hanania-lite. As someone with libertarian sympathies, I wish I had better representation.
For years, the story of AI progress has been one of moving goalposts. First, it was chess. Deep Blue beat Kasparov in 1997, and people said, fine, chess is a well defined game of search and calculation, not true intelligence. Then it was Go, which has a state space so vast it requires "intuition." AlphaGo prevailed in 2016, and the skeptics said, alright, but these are still just board games with clear rules and win conditions. "True" intelligence is about ambiguity, creativity, and language. Then came the large language models, and the critique shifted again: they are just "stochastic parrots," excellent mimics who remix their training data without any real understanding. They can write a sonnet or a blog post, but they cannot perform multi step, abstract reasoning.
I present an existence proof:
OpenAI just claimed that a model of theirs qualifies for gold in the IMO:
To be clear, this isn't a production-ready model. It's going to be kept internal, because it's clearly unfinished. Looking at its output makes it obvious why that's the case, it's akin to hearing the muttering of a wild-haired maths professor as he's hacking away at a chalkboard. The aesthetics are easily excused, because the sums don't need one.
The more mathematically minded might enjoy going through the actual proofs. This unnamed model (which is not GPT-5) solved 5/6 of the problems correctly, under the same constraints as a human sitting the exam-
two 4.5 hour exam sessions, no tools or internet, reading the official problem statements, and writing natural language proofs.
As much as AI skeptics and naysayers might wish otherwise, progress hasn't slowed. It certainly hasn't stalled outright. If a "stochastic parrot" is solving the IMO, I'm just going to shut up, and let it multiply on my behalf. If you're worse than a parrot, then have the good grace to feel ashamed about it.
The most potent argument against AI understanding has been its reliance on simple reward signals. In reinforcement learning for games, the reward is obvious: you won, or you lost. But how do you provide a reward signal for a multi page mathematical proof? The space of possible proofs is infinite, and most of them are wrong in subtle ways. Wei notes that their progress required moving beyond "the RL paradigm of clear cut, verifiable rewards."
How did they manage that? Do I look like I know? It's all secret-sauce. The recent breakthroughs in reasoning models like o1 and onwards relied heavily on "RLVR", which stands for reinforcement learning with verifiable reward. At its core, RLVR is a training method that refines AI models by giving them clear, objective feedback on their performance. Unlike Reinforcement Learning from Human Feedback (RLHF), which relies on subjective human preferences to guide the model, RLVR uses an automated "verifier" to tell the model whether its output is demonstrably correct. Presumably, Wei means something different here, instead of simply scaling up RLVR.
It's also important to note that previous SOTA, DeepMind's AlphaGeometry, a specialized system, had previously achieved a silver-medal level performance and was within spitting distance of gold. A significant milestone in its own right, but OpenAI's result comes from a general-purpose reasoning model. GPT-5 won't be as good at maths, either because it's being trained to be more general at the cost of sacrificing narrow capabilities, or because this model is too unwieldy to serve at a profit. I'll bet the farm on it being used to distill more mainstream models, and the most important fact is that it exists at all.
Update: To further show that isn't just a fluke, GDM also had a model that scored Gold this Olympiad. Unfortunately, in a very Google-like manner, they were stuck waiting for legal and marketing to sign off, and OAI beat them to the scoop.
Very well, since the two of you did speak up for him, I'm going to knock it down to 2 weeks. It'll only get worse if he doesn't get better.

"Innocent until proven guilty" might work in the legal system, but the medical one goes by "if you hear hooves, think horses, not zebras".
Please pull the other one guvna', it's got bells on it.
More options
Context Copy link