@self_made_human's banner p

self_made_human

amaratvaṃ prāpnuhi, athavā yatamāno mṛtyum āpnuhi

16 followers   follows 0 users  
joined 2022 September 05 05:31:00 UTC

I'm a transhumanist doctor. In a better world, I wouldn't need to add that as a qualifier to plain old "doctor". It would be taken as granted for someone in the profession of saving lives.

At any rate, I intend to live forever or die trying. See you at Heat Death!

Friends:

A friend to everyone is a friend to no one.


				

User ID: 454

self_made_human

amaratvaṃ prāpnuhi, athavā yatamāno mṛtyum āpnuhi

16 followers   follows 0 users   joined 2022 September 05 05:31:00 UTC

					

I'm a transhumanist doctor. In a better world, I wouldn't need to add that as a qualifier to plain old "doctor". It would be taken as granted for someone in the profession of saving lives.

At any rate, I intend to live forever or die trying. See you at Heat Death!

Friends:

A friend to everyone is a friend to no one.


					

User ID: 454

I forgot what it's called. It definitely exists, and uses some kind of token system to ration gameplay.

To actually revolutionize robotics [...] would require entirely local models running on local power, local compute

Why entirely local? That is, as far as I can tell desirable rather than necessary, in a world with wireless internet connectivity. Your fridge might have an internet connection these days.

Waddle is an example. Their agents control robots through code and action models, build reusable skills, and even collect data to train smaller policies. Phillip Isola discusses the broader implications here.

I did say to give the robotics people a year. On reflection, I'd be willing to water that down to two or three. I'm not a robotics expert, and I certainly wasn't announcing that we've solved human dexterity. SOTA-Robotics:Human mobility is not SOTA-LLMs:Human Cognition, the latter is much closer, but it's trending the same direction.

But the possibility that robots inherit substantial capabilities from each improvement in frontier models seems rather consequential to me.

If you want a empirical definition its science fiction AIs like the Culture, The AIs in Hyperion, Daneel in Foundation.

A Culture Mind is a hell of a minimum specification. Two of the three examples are ASI, not AGI. I haven't called Astra an ASI.

And fictional examples don't give us an empirical definition. Which capabilities are required? How reliably? Why should I care whether it has emotions when assessing whether it can do my job?

“It's only able to really solve problems” is a rather confusing counter-argument. Depends on the problems, surely. Likewise, working towards an assigned goal doesn't tell us much about how general the intelligence doing the work is. I spend most of my working day performing tasks I am assigned, that do not intrinsically motivate me, mostly because I get paid for it.

The competitive advantage that you retain is the ability to learn shit without requiring millions, even billions of examples.

You're conflating training the model with teaching the trained model something new. I don't start from a blank brain when learning a game either.

ARC Prize tested Astra on unfamiliar interactive environments. It scored 62.7% with their standard interface, and 99.9% with an interface preserving its reasoning state. In the latter setup (at maximum reasoning effort) it used fewer actions than the median successful human on 96% of levels.

That isn't a comparison of total training data or energy efficiency, which wouldn't necessarily be the decisive factor:

Let's say a hypothetical architecture X is 1000 times less sample efficient than a human for a given unit of performance - well, it would be unfortunate if we managed to give it 10,000 times the training data a human can ingest, wouldn't it?

A mere year or two ago, a lot of people were awfully confident that we'd run out of training data, or that synthetic data and RLVR wouldn't pan out. God knows what the frontier labs are up to these days, but it has clearly not proven an impediment.

It does make “these things need millions of examples to learn something new” rather difficult to sustain, regardlws sof practical relevance - which I dispute. They observed it figuring out unfamiliar mechanics and constructing symbolic models to plan around them. Your claim about analogical reasoning needs similar qualification. I do not believe they're the same thing anyway.

Proper continual learning remains a significant advantage. I said so. Whether that advantage remains economically decisive as scaffolding improves is what I'm uncertain about. I lean towards a no.

Alternatively, we could solve continual learning, or simply reduce the temporal delta between train-deploy-train to the point that it has no practical relevance.

A model contributing original mathematics, writing software and learning unfamiliar environments already exhibits an awful lot of generality. It can even hold a conversation, which, I will note, would have been mind blowing not that long ago.

Call it AGI or don't. A rose by another name smells just as sweet, and has just as many thorns.

My concern is how much useful work it can do, how quickly that range is expanding, and what remains exclusively ours. I don't expect the terminology to buy us much time. I certainly don't want to spend more time arguing terminology.

I don't think I've talked about it. I've never been a particularly sports-oriented person. It just never appealed to me, beyond occasionally kicking a football around during recess.

That has been the story of my entire life so far, and I don't think it's likely to change anytime soon.

I was expecting AI to affect politics. I was not expecting to have no idea what that would look like. I very nearly spat out my drink when I saw Trump shit-talking Effective Altruists on X (or some intern with the password, whichever, at this point the distinction is academic).

At this rate we're getting a proper Race™, and with China, because who else could plausibly compete? Add the steadily growing military appetite for LLMs and it won't take more than one serious war before someone in the US government looks around and decides that nationalizing the labs might make perfect sense. I would not bet against that person getting their way.

I'm still reasonably optimistic that we'll land on an acceptable outcome, where "acceptable" means anything other than "everyone dies" or permanent disempowerment under a totalitarian regime whose values are inimical to mine. I want to stress the despite in "despite recent events." We have some very interesting people in charge of things, for a generous definition of "in charge"; nobody seems to have much actual control. Trump would be the closest, which is...

I've made half a peace with all of this. We could call it resignation. It's not quite fatalism.

It could be worse. The major labs calling for voluntary slowdowns and then unilaterally implementing them is a very good thing, IMHO. We have had some major warning shots, in the Yudkowskian sense, and it seems to be having >0 impact.

Now, after a lot of use and a lot of deliberation, I've more or less concluded that Astra is dangerously close to AGI, and probably meets most reasonable criteria for it (good luck finding a consensus definition; the goalposts are on Mars). I'd like to see proper continual learning, of course. In terms of raw intelligence, though, we're there and the right scaffolding buys enough in-context learning that the gap stops mattering for an absurd range of practical applications.

Navier-Stokes, people. Rogue agent swarms on the internet. Aren't you stoked about things?

I want to muster up the balls to just declare it: AGI is here. The issue is that I don't know whether my reluctance is epistemic caution or a psychological hangup - in the sense that saying it out loud would mean it's never been so over, or that it's barely started, and I can't tell which of those I'm more afraid of.

Does it even matter? I'd rather look at what the models actually do than argue semantics. They do things I could never do, and in some cases they've done things that eluded generations of the smartest humans we had. The competitive advantage I retain (and most people, really) is increasingly just whatever comes free with being a physically embodied, low-latency neural network with continual learning switched on by default. Which is to say: a body and a brain. Both increasingly close to obsolete.

Give the robotics people a year, since LLMs are already revolutionizing robotics too (why the fuck not). Maybe we get "true" continual learning, or maybe we get increasingly sophisticated substitutes, constant-train-and-deploy on timescales short enough that the whole question becomes moot. I'd take either.

So, uh, this is me, self_made_human, saying the future is here. It's just not evenly distributed and it smells weird. Welcome to the Singularity, motherfuckers. Enjoy your stay. It'll be many things, and boring won't be one of them.

The more the world turns into what I expected it to become, the more ridiculous and unreal it all feels. I miss when this was LessWrong nerd bullshit. I saw "STOP AI" graffiti on the way home from work today. I was watching the AI Doc on Netflix, occasionally getting exasperated, and then feeling strong emotions about the fact that I know most of the people interviewed, and have spoken to some of them personally in calmer times.

I'm going to do my best to enjoy the ride and have a life for as long as my individual actions still make a difference to my outcomes. I expected this to happen. I have mixed but slightly positive feelings now that it is.

I've managed to do a lot of things, but a sufficient amount of exercise eludes me. The gym isn't happening, but the pushups have fewer excuses. I'll try, thanks.

They'd be a good candidate. Especially when you can get away with an overarching strategic AI that either writes scripts or queues tactical actions for "normal" game AI to implement.

Could be done even in Paradox games, as opposed to more discrete turn based strategy games. "Ah, I'd like to organize a naval invasion, this is the current map layout, order all units to move to X port" and it just happens.

People are doing incredibly cool things with LLM integration in Rimworld.

It started off with "journals" where an AI would look at the game state and recent event, and write something about it (RimLegend, RimChronicle). Then came mods that let you "talk" to pawns, taking direction from their personality and relationships (RimDialogue, RimTalk, EchoColony).

That was fun enough, but didn't directly affect gameplay. Well, what I wanted the most is coming to fruition: the AI storytellers the game has being supplemented by actual AI. Or at least significantly more intelligence than dice rolls with various degrees of randomness (RimAI, Rimteller, Claude Storyteller, Tales from the RimWorld). That's somewhere where Rimworld falls flat compared to a much more simulation-oriented game like Dwarf Fortress - your actions have remarkably little impact on the wider world, forcing a lot of dirty scripting to give an impression of responsiveness, and trusting the player to make a coherent narrative out of it.

That means events in the game can be directly impacted by what an external LLM dictates. I haven't tried it yet, but we're about to start a golden-age anytime now, significantly easier in games where you don't need low latency instant decision-making.

No more five quadrillion rabid crows because you made your floors too shiny, or a group of orphans wanting enough medical supplies to stock my hospital in order to ransom their friend (at least in theory). Events can (hopefully) start to make sense in context. Just imagine what you could do in terms of diplomacy - there's already a semi-viral standalone geopolitics sim out there, where instead of a Paradox style interface, you just say what you, as the leader of a simulated nation, want to do.

Or quests that are truly unique. Base building made easier by telling an LLM what to do (RimAgent). Giving pawns a mind of their own.

As always, token pricing remains the biggest barrier, but $/unit of intelligence continues to drop precipitously.

I've been watching gameplay for years (I am too tired to get the actual games), and I get the strong impression - corroborated by most players - that the game is significantly less jank these days.

Like, definitely plenty of jank, just less of it. The physics has improved to the point that people are using legitimate HEMA tactics and finding benefit from it.

I do appreciate the concern, and the last week suggests that it's correct. I'm going off on vacation, which means I get a much needed break, and won't need nearly as much of the stimulants. That'll help, and if it doesn't I'll reconsider the GLPs, thanks!

I remain grateful for giving up on my (rather progressed) plans to switch from medicine to CS or ML a few years back. I'd started teaching myself when GPT 3.5 came out, and when 4 was realized, I gulped and decided medicine was the safer option.

I do not regret this decision. You guys are, unfortunately, rather screwed. I hope that we as a society figure something out, and soonish, it's only going to accelerate from here.

I suppose we're both in the same boat. My appetite is drastically diminished, though I'm on stimulants which provide additional suppression.

Down 2ish kilos since.

In fact, I'm now concerned I'm not eating enough, between the workload and sheer exhaustion, I've been skipping a lot of meals. I can do with losing a few more kilos, but at that point I'll either cut down the dosing or force myself to eat more regularly. Interesting problem to have.

That's a good point. I have been eating far less than I should, and that's not great for me. I appreciate the advice, and the kind words!

I'm going through hell at work. My mental health must have miraculously improved to well above the usual baseline, because I haven't collapsed yet.

Halfway through the day, I find myself so sore that even 500mg of naproxen doesn't cut it. To save my liver and kidneys, I've been avoiding more, or trying to handle the breakthrough pain with non-NSAID analgesics.

I have been sleeping poorly. Just enough to be functional, but the stress has me waking well before an alarm even when I only fall sleep late. It gets worse and worse through the week, though I manage to discharge some of the debt over the weekends.

At least I have dextroamphetamine. I can only hope that strong doses, and an upcoming vacation with my brother will help with things.

Fuck me. Only way out is through.

No.

Others have very kindly pointed out that the child did not have a life fit for a child, and that there was no hope for a cure. Thanks.

Well, I've seen a baby with icthyosis vulgaris during my career (Google that at your peril), and when you're that fucked, and end to the misery is in everyone's best interests.

It is worth noting that medical technology has, for a while, allowed to us to keep a lot of people alive, but not alive, if you get what I mean.

Thank you. I'm glad I did it, it was one of the most concrete examples of me failing in hard to see ways, my limited energy carefully rationed. Being able to overcome the tendency to procrastinate in some ways, while feeling utterly helpless in others.

I think that was the biggest ticket item. Compared to that, canceling a gym membership I don't use is nothing.

Thanks for the other advice! I am leery of gold or crypto, for various reasons, but general global exposure might not be the worst idea. Shame the Chinese stock market is borderline impenetrable...

I have finally used up a good chunk of my ISA, and put my money where my mouth has regularly been: In shares of the Vanguard S&P 500.

God knows how long I've been putting that off, it was surprisingly painless when I sat down and did it. Financial responsibility, brought to me by the resumption of dextroamphetamine.

Any advice on further diversification of my portfolio? I am not financially stressed, and I have no immediate plans on buying a house etc etc. The most likely significant financial liability in the near term would be a cheap(ish) car. I don't have to worry about providing for my family back home, at least unless things go horrendously, unimaginably wrong when it comes to their investments and holdings.

I would say I have a decent risk appetite, but I am of the opinion that the market is, in general, more efficient than I am. Thanks!

Ah. That's a common enough story.

General advice for the men reading: taking interest in and engaging with the interests and activities of your female partners is important. If you can't generate it organically, then you better learn to fake it.

I can hear the objection already. Faking it is dishonest, she will see through it, and being caught faking is worse than never having tried. I half agree, in the sense that "fake" is probably the wrong word. What I actually mean is something closer to "build a habit."

Look at a person who sets a weekly reminder to call his mother. I wouldn't say he loves her less than the person who simply remembers on his own. The reminder is what love looks like in a brain that is bad at remembering things. The effort is the thing being measured, and is not much worse for being intentionally generated.

I've seen this before - a lot of women will become deeply dissatisfied if you're not doing this. You can be well off, handsome, good in bed, etc etc, but they'll feel that something is missing.

The gap gets filled by small things. Remembering a birthday without being reminded. Asking how her friend's surgery went. Flowers on a Tuesday for no reason, except that she appreciates flowers. Remarking on the fact that she got a haircut. None of these is individually important, which is precisely why they work as a signal. The only reason to do something that does not matter is that you were thinking about the person it does not matter to.

I've gotten better at all of that, with time and intentional effort. I've had exes complain I sometimes appeared checked out, or that I didn't get them flowers. Once that was done and dusted, I set about improving. I'm buying a bouquet today.

That is not to say that the stereotypically male side of a relationship isn't important: being a provider, making her feel safe, taking care of things. These all matter greatly. They are necessary, but in many cases, might not be sufficient.

I find that it's helpful to attach a reference image and ask it to copy the art style closely, on ChatGPT or Gemini. Much more effective than verbally describing the style. You can use multiple different references, in case you don't want it to crib too closely.

Funny timing: I restarted oral semaglutide yesterday. I think you made the right call.

I'd lost a few kilos the traditional way, which in my case meant eating less, running myself into the ground at work, and taking moderate doses of prescription stimulants. Then it plateaued. For months. Still in the overweight range by the charts. After contemplating it on and off for a good while, I bit the bullet.

I skipped the titration schedule, same as last time. Mother didn't raise no pussy, but she did raise an impatient gentleman. Day one brought mild queasiness. Day two has been fine. The appetite effect is subtle so far, and seems to work mostly by early satiety, so I eat less per meal without any change in how often I think about food. It'll take several days to reach steady state, but I feel it anyway.

(Getting this through the NHS is close to impossible unless you're roughly truck-shaped , and it has to be prescribed within a Tier 3 or 4 specialist service, not by your GP. I happened to have plenty left over from a trip to India)

Do I need it? No. Do I have preferences about my own body that the word "need" fails to capture? Yes. That's true for most people, I just happen to have a degree adjacent to the topic.

What I'd want your wife to hear is about my mother:

She has diabetes and obesity, and her liver was paying for both. The kind of situation where nothing hurts until it's already quite bad. For years I carried a low-grade background dread that I'd lose her within a decade or two. I talked her into starting semaglutide. Her liver turned around.

She still has plenty of weight to lose, but I'm less terrified of losing her.

Tell your wife that. When someone you love becomes healthier and is likelier to be around longer, the available emotions are relief and gratitude. Disappointment is a shite dessert.

I'm now trying to get my mother back to her endocrinologist to raise her dose again, or to switch to the injections. I'd like my father on it too. He isn't obese by the numbers, but he has the beer belly, minus most of the beer, since Indian fat distribution handles that part unassisted. He isn't listening to me. Parents rarely do. I'm glad mine occasionally listen without me having to go and poke them with a needle myself.

We live in an age of miracles. It seems a shame to leave them on the shelf. I've taken them out of the luggage at the least.

SHTF comes in various flavors. Some more easy to weather than others. A rucksack full of USD can help with many problems.

I also mentioned using it to buy durable goods.

It is a pain, which is why I have been paying for it for a year and have gone about half as many times as there are months.

I'd need to call and email them, and it would only kick in after the next billing cycle, with a month's notice. This has been effective at squeezing plenty of money out of me.

If.

It remains an open question, and I'm not as pessimistic as some.

No exercise other than running around at work. I still intend to cancel my gym membership as a lost cause.

I have other things I would love to talk about, but due to a catastrophic failure of OPSEC, I can't. They know where to find me. Hello.

Otherwise, I continue being the best I've ever been, really. Long time coming.

I would have signed up for cryonics, before I was middle aged. Not much point in that now. I will reconsider only if things seem to peter out.

I have accelerated my long-standing goal of marrying and having kids. In a slower world, I'd have been okay with waiting a few extra years.

I should be putting all or most of my savings in an index fund. I've been procrastinating on that.

I am more open to risky medical treatments, to a degree, because the longterm damage is more likely to be fixable.

At a recent nadir of my depression, I reminded myself that I want to see how things end, or begin, really. That we'll find a cure for treatment resistant depression, if existing interventions fail. That I just needed to live long enough to see that through.

Well, I got better anyway. Mostly because of my own actions rather than anything any other shrink did for me. If that doesn't last, I can look forward to a technological fix in a very reasonable amount of time.

None of this is really life-changing. Which is something I've always noted when people argue that believing in an imminent techno-singularity requires drastic changes in behavior or outlook, therefore this discredits the belief in the first place. Beyond retarded as an argument, but also false when you consider I've been expecting this for a while, it's priced in, and I've had a pretty normal life anyway.