@self_made_human's banner p

self_made_human

amaratvaṃ prāpnuhi, athavā yatamāno mṛtyum āpnuhi

16 followers   follows 0 users  
joined 2022 September 05 05:31:00 UTC

I'm a transhumanist doctor. In a better world, I wouldn't need to add that as a qualifier to plain old "doctor". It would be taken as granted for someone in the profession of saving lives.

At any rate, I intend to live forever or die trying. See you at Heat Death!

Friends:

A friend to everyone is a friend to no one.


				

User ID: 454

self_made_human

amaratvaṃ prāpnuhi, athavā yatamāno mṛtyum āpnuhi

16 followers   follows 0 users   joined 2022 September 05 05:31:00 UTC

					

I'm a transhumanist doctor. In a better world, I wouldn't need to add that as a qualifier to plain old "doctor". It would be taken as granted for someone in the profession of saving lives.

At any rate, I intend to live forever or die trying. See you at Heat Death!

Friends:

A friend to everyone is a friend to no one.


					

User ID: 454

Almost all of the improvement thus far is based on throwing more compute at the problem

Compute can be spent in many different ways. We're moving from a paradigm of scaling up the size of a model, in terms of parameter count, in favor of scaling run-time compute (time spent thinking) and reinforcement learning.

Scaling worked well, but was known to have diminishing returns, and limited by availability of high quality data to train on. It turns out that raw text dumps of the internet will only get you so far, and then curation matters.

RL, however, side-steps the issue entirely, models like OAI o1, o3 and DeepSeek's R1 were further trained on synthetic data. You take a normal LLM (or a base model), get it to attempt to solve a well defined problem where you can grade an answer. In the event they succeed at the task, you save that particular conversation/reasoning trace, and then use it to further train the model. This generates a data flywheel, which by all rights sounds like it shouldn't work (and many people didn't expect it to, thinking that the exhaustion of human generated data would stymie progress), but it turned out to work exceedingly well.

That's why models are doing particularly well at tasks like maths or coding, because you can rigorously vet the answers. This is harder to do with tasks like being a good writer, or poetry, because human evaluators often don't even agree with each other, let alone have a ground truth to refer to.

AGI is supposed to be GENERAL. This is the stuff that's supposed to be taking people's jobs in a few years

As dozens of benchmarks have shown us, doing better than chance on a metric is half the battle. The time taken to get there dwarfs the rapidity with which models then conquer and saturate the benchmark. If we have an LLM doing poorly on Pokémon (but far better than previous models, GPT-3.5 would have flunked it, GPT-2 would flop around like a magikarp), then it's not going to be much longer before it does it in its sleep.

There isn't much of a market for AI playing Pokémon. There is immense demand for them to be good at coding and maths. We've seen stunning progress in that regard, as you acknowledge. You attempt to back-chain your argument, saying that they're said to be good at maths but look, they're shit at Pokémon, which apparently invalidates the former. It really doesn't.

The argument is: this AI is struggling in a VERY non-human way with what we would consider a pretty trivial task. This reveals that its operational parameters are not like those of a human, and that we should figure out where else it is going to perform at sub-human levels. The fact that we're seeing this at the same time as it performs at SUPERhuman levels in other tasks shows that this is not AGI, or even in the direction of AGI, but rather is tool AI.

That's just Moravec's Paradox. Intelligence can be spiky.

Tell me, if you saw a human genius in the field of physics struggle with tying his laces or riding a bike, does that make his genius in his field invalid?

Claude is excellent in maths and coding, a good conversationalist and writer, if you described a human being with those properties, I'd be impressed, and it being bad at Pokémon doesnt invalidate the former.

If you're concerned about job losses, employers will be looking at coding skill before laying off programmers, not at their ability to play games.

We both agree that there was no reason to expect Claude to succeed with Pokemon at the level of an eight-year-old.

I had never given it any thought before the demonstration. But plenty of people have speculated that LLMs would never be any good at video games, and now that they're not good but not terrible, it's only a matter of time before they're great. And that time can be very short.

We've got the first AI agents out there. This was something impossible even a few years back, and they're only getting better.

A chess AI that plays the game by making random moves has an elo of 478 and will occasionally beat a novice, which usually have an elo around 800. A dice is not AGI.

I believe that was a joke.

At any rate, even sticking to chess, I used an elo calculator and the dumb chess AI would win 13.55% of games. I still think it would be rather impressive if a dog make valid moves, even if at random.

When the first chess bots came out, public opinion was far from acknowledging the possibility that they even might become superhuman at Chess. Today, we're at the point where even grandmasters are utterly crushed by Stockfish.

Pokemon is such an easy game that it can conceivably be beaten with entirely random inputs, and provably beaten by very-close-to random inputs.

If you have a few million or billion years to wait around I suppose.

Twitch Plays Pokemon was essentially built on this premise.

As far as I'm aware, the spectators interacting with the stream were using strategies and had an idea of how to win at the game. There were plenty of trolls or awful players, but it wasn't random or too random.

https://community.openai.com/t/advanced-voice-mode-limited/959015

"The GPT-4o model used in Advanced Voice Mode is multimodal and directly receives audio."

My understanding is that LLaVa has long been supersede by things like cogVLM. I'm not clear on the finer implementation details.

For models like Gemini and the latest GPTs, we have very little public information about their architecture.

Most telling is the fact that none of the top commercially available chatbots have any native capability whatsoever to output images, and just blindly ram your prompt into a diffusion model api. They'll happily generate for you something totally unlike the prompt, and cheerfully insist that it's exactly what you asked for.

GPT-4V was demoed to have image generation capabilities that blew dedicated image models out of the water. OAI hasn't released it, despite strong clamoring, but Altman has said it's on the cards.

The issue you're describing is just poor implementation of image gen, at the very least GPT-4V does astonishingly better.

Claude 3.7 Sonnet has a context window of 200k tokens. That is massive compared to the first commercial LLMs, which ranged from 4k to 16k.

It is, however, utterly dwarfed by other models like Gemini 2.0 Pro by Google. That one has a whopping 2 million token large context window, and I've personally made good use of it by throwing absurd amounts of text, including massive textbooks, into it.

There's plenty of ongoing research into both online learning, as well as drastically extending context lengths. We've gone from 4k to 2 million in about 2 years, without the original quadratic scaling of memory use still holding. I presume @DaseindustriesLtd would be better placed to answer how they pulled it off. Even accounting for performance degradation with very large context windows (needle in a haystack tests don't capture this), you can probably get around strictly needing online learning.

Claude, at least past the 2.0 models, has been excellent. 3.0 Opus was good, 3.5 Sonnet was great, and 3.7 Sonnet only continues the hot streak. Given that GPT 4.5 is a resounding meh (look at those prices dawg, they're back to early GPT-4 days and don't beat even OAI's reasoning models in price or performance), I don't think Anthropic is doing poorly. They've released a reasoning model (3.7 can do it and standard output), and have plenty of good talent.

That being said, the way they treat paying users, both through subscription and the API, is terrible. I can only hope that they're simply strapped for GPUs, especially for inference, and are using the bulk of their compute on the 4.0 models they're cooking. Hopefully they take a page out of DeepSeek's book, those buggers aren't GPU poor, they're GPU beggars in comparison, but outside of when they're being DDOS-d, they practically throw tokens away for free.

I believe the follow feature only posts notifications when the person you've followed makes a standalone post on the front page. Even top level comments in the main CWR thread are technically subposts.

As mentioned below, there are things from the rdrama code base that aren't fully implemented, such as themes. They probably work fine for a normal user, but using anything but the default breaks things in annoying ways if you're an admin like me.

Oops. Thanks for telling me.

I mean, it's easy to win an argument when my opponent is invisible, but I'll let him through the filters. I don't need the handicap.

In other news: a streamer with deep pockets and a love of AI has decided to have Claude play Pokemon.

Well, if that's what you want to call an Anthropic researcher who decided to make their experiment public.

"Claude Plays Pokémon continues on as a researcher's personal project."

https://x.com/AnthropicAI/status/1894419042150027701

How should we interpret this? On the simplest level, Claude is struggling with spacial modeling and memory. It deeply struggles to interpret anything it's seeing as existing in 2D space, and has a very hard time remembering where it has been and what it has tried. The result is that navigation is much, much harder than we would anticipate. Goal-setting, reading and understanding dialogue, and navigating battles have proven trivial, but moving around the world is a major challenge.

This reminds me of a very good joke:

A woman walks in and says "holy crap, your dog can play chess?! That's amazing! What a brilliant dog! "

The man says "you think my dog is brilliant? Pffft. Hardly. He's pretty dumb, I've won 19 games out of the 20 we've played."

Jesus Christ, some people won't see the Singularity coming until they're being turned into a paperclip.

Nuh uh, this machine lacks human internal monologues and evidence of qualia, you insist, as it harvests the iron atoms from your blood.

At this point, the goalposts aren't just moving, they're approaching relativistic speed headed straight out of the galactic plane.

This AI can strategize in battle, understand complex instructions, and process information, BUT it struggles with spatial reasoning in a poorly-rendered 2D GameBoy game, therefore it's not intelligent.

It wasn't designed to play Pokémon. It still does a stunningly good job when you understand what an incredibly difficult task that is for a multimodal LLM.

Last, and most controversial: AI needs abstract "concepts." When humans reason, we often use words - but I think everyone's had the experience of reasoning without words. There are people without internal monologues, and there are the overwhelming numbers of nonverbal animals in the world. All of these think, albeit the animals think much less ably than do humans. Why, on first principles, would it make sense for an LLM to think when it is built on a human capability absent in other animals? Surely the foundation comes first? This is, to my knowledge, completely unexplored outside of philosophy (Plato's Forms, Kant's Concepts, to name a couple), and it's not obvious how we could even begin training an AI in this dimension. But I believe that this is necessary to create AGI.

This is the classic, tired, and frankly, lazy argument against LLMs. Yes, LLMs are trained on massive datasets of text and code, and they predict the most likely output based on that training. But to say they are merely "next likely text" generators is a gross oversimplification.

It's like saying humans are just “meat computers firing neurons". That is trivially true, but I'm afraid you're letting the "just" do all the heavy lifting.

The power of these models comes from the fact that they are learning statistical correlations in the data. These correlations represent underlying patterns, relationships, and even, dare I say, concepts. When an LLM correctly answers a complex question, it's not just regurgitating memorized text. It's synthesizing information, drawing inferences, and applying learned patterns to new situations.

LLMs have concepts. They operate in latent spaces where those are represented with floating point numbers. They can be cleanly mapped, often linearly, and interpreted in terms that make sense to humans, albeit with difficulty.

These representations can be analyzed, manipulated, and even visualized. I repeat, they make intuitive sense. You can even perform operations on these vectors like [King] - [Male] + [Female] = [Queen]. That isn't just word tricks, they’re evidence of abstracted relational understanding.

If you're convinced, for some reason, that tokens aren't the way to go, then boy are AI researchers way ahead of you. Regardless, even mere text tokens have allowed cognitive feats that would have made AI researchers prior to 2017 cream in their pants and weep.

There really isn't any pleasing some people.

Edits as I spot more glaring errors:

Second, AI needs more than one capacity. LLMs are very cool, but they only do one thing - manipulate language. This is a core behavior for humans, but there are many other things we do - we think spacially and temporally, we model the minds of other people, we have artistic and other sensibilities, we reason... and so on.

Even the term "LLM" for current models is a misnomer. They are natively multimodal. Advanced Voice for ChatGPT doesn't use Whisper to transcribe your speech to text, the model is fed raw audio as tokens and replies back in audio tokens. They are perfectly capable of handling video and images to boot, it's just an expensive process.

While the obvious argument around Tay was whether it was racist or dangerously based, a more serious concern is: should an intelligence allow itself to get swayed so easily by obviously biased input? The users trying to "corrupt" Tay were not representative and were not trying to be representative - they were screwing with a chatbot as a joke. Shouldn't an intelligence be able to recognize that kind of bad input and discard it? Goodness knows we all do that from time to time. But I'm not sure we have any model for how to do that with AI yet.

https://gwern.net/leprechaun

There appear to be several similar AI-related leprechauns: the infamous Microsoft Tay bot, which was supposedly educated by 4chan into being evil, appears to have been mostly a simple ‘echo’ function (common in chatbots or IRC bots) and the non-“repeat after me” Tay texts are generally short, generic, and cherrypicked out of tens or hundreds of thousands of responses, and it’s highly unclear if Tay ‘learned’ anything at all in the short time that it was operational

Besides, have you ever tried to get an LLM to do things that its designers have trained it, through RLHF or Constitutional AI, to not do? They're competent, if not perfect, at discarding "bad" inputs. Go ahead, without looking up an existing jailbreak, try and get ChatGPT to tell you how to make meth or sarin gas at home.

It is plausible, though obviously not possible to confirm, that ClaudeFan has updated the model some to attempt to handle these failures. It's unclear whether these updates are general bugfixes

I don't think that Anthropic, strapped for compute as it is, is going to take a fun little side gimmick and train their SOTA AI to play Pokémon. If it was just some random dude with deep pockets, as you assumed without bothering to check, then good luck getting a copy of Claude's code and then fine-tuning it. At best they could upgrade the surrounding scaffolding to make it easier on the model.

The AI will struggle to get past its training and see the question de novo, as a human would be able to.

There is a profound difference between "struggling" to do so, and being incapable of doing so.

I'm 4 episodes into Pantheon, and I think it's really good. It's not a real spoiler to say that it's about a girl whose dad (a programmer) died of a terminal illness a few years back, but it turns out that his 'failed' mind upload did in fact work.

What I found particularly hilarious was the clear Ambani-analogue in the form of a particularly unscrupulous telecom billionaire from India who owns a massive personal skyscraper with a helipad next to slums in Mumbai. Yeah, there are so many people who fit that description. I'm surprised he didn't get it banned outright in India, given how many distribution channels the real Reliance owns.

That being said, it's obvious that this was a product of a pre-GPT age. We've made minimal progress in mind uploading any organism, even nematodes. We've got connectomes, but that's like having an LLM with parameters but no weights. It seems clear to me that it'll be entirely artificial AGI unlocking human mind uploads, and not the other way around. Still a good watch, and I've only heard good things about the second season.

Yes, but I don't see how something like "we perceive our own continuity" can be proven wrong.

I don't think I'm disputing that, as far as I can tell.

There is a dystopian scenario in the writing where people like me are conditioned to brainwash themselves into ego death because being able to productively fork oneself and share resources between forks without regard to the fork's individual needs for them is the only way to stay competitive.

Cheer up! It's very unlikely that human uploads will be enslaved for cognitive labor, we're likely not cost-competitive with dedicated AI. Something like the Age of Ems or Pantheon requires technology to advance in ways that it very much does not appear to be advancing.* If you want to allow for enormous levels of pruning and optimizing to achieve parity, I strongly expect you won't have much recognizably human left by the time you're done. So you both can't really compete solely by Molochian self-abnegation, and you probably won't be expected to. Of course, I can't rule out that things go south in other ways and we all starve regardless.

*We can't properly emulate a nematode, but we have synthetic AI that can do graduate level mathematics.

Human intuition is often wrong! Our intuition does not equip us in the least to naturally handle things like relativistic speeds or quantum phenomena. It evolved to handle the narrow ranges or scales that were relevant to macroscopic animals.

Even in that domain, our expectations fail us. Newton had to break from Aristotlian mechanical intuitions that were Plain Common Sense for hundreds of thousands of years.

I care about living because of my biological substrate's reward system, not because I intellectually (on what basis?) prefer an existence of a "pattern" of sun_the_second over its nonexistence.

I believe you, and why wouldn't I? At the end of the day, some values are entirely arbitrary and can't be otherwise (without solving infinite regress). This is as true for me as it is for you.

It is entirely fair for someone to believe that they value living for its own sake, and that their value systems exclude something like an upload. Now, sometimes there might be underlying beliefs or justifications that build on axiomatic bedrock, and those can be wrong when judged against their building blocks.

For example, someone might think it not even theoretically possible to upload a human mind and run its algorithms on a computer. I would, of course, think that they're mistaken on factual grounds, even if it is an enormously difficult feat to pull off.

Intuitive understandings of personal identity are often not robust in the least, but I'm confident mine are far more internally consistent than many people (especially since they've never even thought about it).

That being said, if someone recognizes that an upload might have the same thoughts and values as them, including a belief that uploads aren't moral persons or identical to the original (which might be overruled by self-interest, it's hard to make a man accept something if his literal existence hinges on not accepting it); and they still disagree with me on the moral equivalence of their own uploads, then I can't argue further.

We would agree on the facts, and disagree on their implications. I know that my mutual respect for any forks of myself drastically increase the odds that they will respect me back, and that we would be able to achieve peaceful co-existence and mutual aid. That is a fortunate fact about me, if someone would hate a copy of themselves, then their copy is going to hate them and they shouldn't make one.

I don't consider myself to be exactly the same person after any period of time that can be measured on a clock. I think it's quite clear that I'm not particularly bothered by this.

If I can identify with and care about the wellbeing of the person "I" will be in decades, then I can identify with an upload.

We're talking about a hypothetical technology, one that might pass through decades of improvement and iteration.

The minimum viable product is one that isn't a gibbering mess after destructive scanning. The ideal is one that is absolutely indistinguishable (outside of being in a computer) from the original human and leaves the OG meat intact.

There's plenty of room in between. I'm not the exact same person when I go to bed and wake up the next day, and I don't write a will before I do. Or when I consider what I'll be like in a year, or even decades.

I can't say with 100% certainty what I'll be like in a few decades as is, but I'm reasonably confident that short of a brain disease, I won't become a serial killer or try and suffocate my parents in their sleep.

Scanning the brain in any fashion is the hard bit. Making sure the hardware and simulated environment is congenial is trivial in comparison. If we diverge over time, that's no surprise, even twins do, or the me of today and next year.

The best person to speculate about a copy of myself would be me. And I don't think that would happen.

That is a strict improvement over the status-quo.

I'm not a biological chauvinist, and I think that the upload has equal claim to my name and assets. I also expect that unless things go really awry, the human version would probably end up acquiring biological immortality eventually. Destructive scans seem much easier than ones that preserve the original, but the latter isn't a bad thing as far as I'm concerned. It always leaves the option of another upload, one when the original is closer to death.

Even if that wasn't the case, I'd rest easier. Growing old and dying of old age sucks, but it is a great comfort to have seen your grandkids be born, follow in your footsteps and flourish. You can die with fewer regrets. In the same manner, if I had a backup, even one that would outlive me, I'd wish it well, and know that it would share most of my goals and desires, and would mourn my passing.

If someone is that greatly attached to their frailty and finitude, then who am I to object? I won't, as long as they don't get in the way of me escaping mine.

There are plenty of aspects of the "human condition" that were ubiquitous and seemingly unavoidable for all of human history till they were not. I don't think most people miss 50% infant mortality rates, or heart attacks being inevitable death. They're not going to miss old age either, and if they really want that experience for themselves, that's their prerogative.

For what it's worth, the human condition seems to be a consistent trend of overcoming how awful said condition could be at times.

Thank you! It's a wild world out there, browse by top of all time in /r/MartialMemes and you'll get a fair inkling.

The voice itself is really good. The underlying model didn't strike me as particularly intelligent, but the former is obviously the point of the demonstration.

Nota bene: I am old. You will get different perspectives on this.

That is by far the biggest downside of a baseline human body, and why I don't want to be stuck in one even if I like mine.

It will, despite our best medicines, decay and fail you. Maybe our drugs and treatments will get better, and we can keep people healthy indefinitely. But even then, I want things that no human body constrained by biology will be able to provide.

I don't hate my body. It comes in handy at times. It does what I ask it to, mostly, and hasn't broken down from old age even though I'm past the nominal best-by date.

That being said, I am a transhumanist, and would happily ditch it for an upgrade. I'd be more than ready to upload my mind into a computer, while relying on physical end-effectors to do things in the real world.

I’ve played my fair share of sports at the insistence of my parents as a teenager, and never felt anything other than irritation during and after training, so hearing others say it feels like listening to an alien describing the awesome parties of Alpha Centaura.

More or less the same. Never enjoyed sports much, though I did like tennis. Football was a nightmare since I wear glasses.

I don’t care much for travel, tinkering with things or the physical side of sex either

Can't say I don't like sex, but I'm not one for proactively seeking to travel. I'll go if someone does all the hard work of planning things out, and occasionally find the results enjoyable. Physical tinkering was never a real hobby, beyond it being a necessity for doing things like building a PC. I want the computer, I don't want to pay the premium for a prebuild, so I made one myself.

Is this some fairly unique side-effect of the ‘tism that makes me miss out on universal human experiences, or do some of you feel that way as well?

Autism often comes with sensory processing issues and body dysphoria.

You might say, ah ozempic type drugs, who cares, I’m not fat. But maybe the next unexpected discovery reverses Alzheimer’s, who knows. Maybe you are destined to get Alzheimer’s, at that point, would have been nice to have some strange new drug class that combats it.

Well, I just did a presentation on a massive study using EMR data from over a million patients in the States. It found that Ozempic reduced the incidence of Alzheimer's by about 50%.

Not quite a reversal (though studies are ongoing on people with prior diagnoses who then start semaglutide), but I just found this very funny.

All of the surprises were minor in absolute terms. I knew what to expect in terms of culture and the activities of daily living,

Before I landed in London a few years back, did I know that buses had little buttons you could press to ensure they pulled over before your stop? I didn't, they're not a thing in India, you usually just tell the conductor or driver if you want to get off. But I saw people use them, and in about 5 minutes I knew what to do. Most other minor surprises are of about the same magnitude, I can't recall seeing something of significant importance that I didn't know before I came.

There's just so much proliferation of US culture and lifestyles into internet spaces. No other nation really compares.

I, of course, intend to visit the States and scope out my options, but I wasn't blindsided to a significant degree when I moved to the UK either. People have a good idea of what to expect, and I'm confident I do.

Yes, and I do remember a surprising amount, given how long ago it was. Let's just say the NYC skyline was rather different just a few weeks after I got home.