@self_made_human's banner p

self_made_human

amaratvaṃ prāpnuhi, athavā yatamāno mṛtyum āpnuhi

16 followers   follows 0 users  
joined 2022 September 05 05:31:00 UTC

I'm a transhumanist doctor. In a better world, I wouldn't need to add that as a qualifier to plain old "doctor". It would be taken as granted for someone in the profession of saving lives.

At any rate, I intend to live forever or die trying. See you at Heat Death!

Friends:

A friend to everyone is a friend to no one.


				

User ID: 454

self_made_human

amaratvaṃ prāpnuhi, athavā yatamāno mṛtyum āpnuhi

16 followers   follows 0 users   joined 2022 September 05 05:31:00 UTC

					

I'm a transhumanist doctor. In a better world, I wouldn't need to add that as a qualifier to plain old "doctor". It would be taken as granted for someone in the profession of saving lives.

At any rate, I intend to live forever or die trying. See you at Heat Death!

Friends:

A friend to everyone is a friend to no one.


					

User ID: 454

Lo and behold, after your kind blessings, I dug through a pile of belongings in the back of my closet, and found two pristine boxes of Ritalin, just ripe for the taking. I knew there had to be some of the fuckers lying around around haha

I have a reasonable plan in mind for what I'd do with the $10 million. I'd probably pivot away from my branch of medicine and ingratiate myself into an Infectious Disease department, or just sign up for a masters in biology.* The biggest hurdle would be the not getting caught part, but there's an awful amount of Legitimate Biology you can do that helps the cause, and ways to launder bad intent. Just look at apologia for gain of function.

There's also certainly Knightian uncertainty involved, but there are bounds to how far you can go while pointing to unknown unknowns. I don't think I'd need $1 billion to do it, as I'm confident it couldn't be done $3.50 and a petri-dish.

And whatever the actual cost and intellectual horsepower + domain knowledge is, it only tends downwards, and fast!

*If you can't beat disease, join them

It kinda seems like we do live in a world where any attempt to kill everyone with a deadly virus would involving using AI to try to find ways to develop a vaccine or other treatment of some kind.

The downside to this is having to hope that whatever mitigation is in place is robust and effective enough to make a difference by the time the outbreak is detected! The odds of this aren't necessarily terrible, but you want it to have come to that?

It's ironic, though - the people who are most worried about unaligned AI are the people who are most likely to use future AI training content to spell out plausible ways AI could kill everyone on Earth, which means that granting unaligned agentic AI is a threat for the purposes of argument, increases the risks of unaligned agentic AI attempting to use a viral murder weapon regardless of whether or not that is actually reliable or effective.

Sorry, side tangent. I don't take the RISKS of UNALIGNED AI nearly as seriously as most of the people on this board, but I do sort of hope for the sake of hedging those people are considering implementing the unaligned AI deterrence plans I came up with after reflecting on it for 5 minutes instead of along with posting HERE IS HOW TO KILL EVERY SINGLE HUMAN BEING over and over again on the Internet :p

I expect hope than a misaligned AI competent enough to do this would be intelligent enough to come up with such an obvious plan, regardless of how often it was discussed in niche internet forums.

How would you stop it? The existing scrapes of internet text suffice. To censor it from the awareness of a model would require stripping out knowledge of loads of useful biology, as well as the obvious fact that diseases are a thing, and that they reliably kill people. Something that wants to kill people would find that connection as obvious as 2+2=4, even if you remove every mention of bioweapons from the training set. If it wasn't intelligent enough to do so, it was never a threat.

Everything I've said would be dead-simple, I haven't gone into any detail that a biology undergrad or a well-read nerd might not come up with. As far as I'm concerned, it's sufficient to demonstrate the plausibility of my arguments without empowering adversaries in any meaningful way. You won't catch me sharing a .txt file with the list of codons necessary for Super Anthrax to win an internet argument.

The hard part is what I was alluding to, when I mentioned that during the gene-editing, you could copy and paste sections of genomes from unrelated pathogens. Nature already does this, but to a limited extent (bacteria can share DNA, viral replication often incorporates bits of the host or previous viral DNA still lurking there).

I expect that a competent actor could merge properties like:

  1. Can spread through aerosols (influenza or rhinoviri)

  2. Avoids detection by the immune system, or has a minimal prodrome that looks like Generic Illness (early HIV infection)

  3. Massive lethality (HIV or a host of other diseases, not just restricted to viruses)

The design space pretty much contains anything that can code for proteins! There's no fundamental reason that a disease can't both be extremely lethal and have incubation periods long enough for it to be widespread. The only reason, as far as I can see, for why we don't have this is because nobody has been insane (and resourceful) enough to try. Holding the former constant, the resource requirement is dropping precipitously by the year. Anyone can order a gene editing kit off ebay, and the genetic code of many pathogens are available online. The thing that remains expensive is a proper BSL-4 lab, to ensure time to tinker without releasing a half-baked product. But with AI assistance, the odds of early failure are dropping rapidly. You might be able to do a one-off print of the Perfect Pathogen, and as long as you're willing to die, spread it widely.

You're just a Functionalist, exactly the sort of people the argument is supposed to criticize. Or you're missing the point.

My response is that there isn't a point to miss.

Searles is a Biological Realist, which is to say that he believes that processes of mind are real things that emerge from the biochemical processes of human beings and that language (and symbol manipulation in general) is a reflection of those processes, not the process in itself. He thinks thoughts are real things that exist outside of language.

That strikes me as the genuine opposite of what someone with a realistic understanding of biology would believe, but I guess people can call themselves whatever they like. It strikes me as unfalsifiable Cartesian Dualism or a close relative, and worth spending no more time rebutting with evidence than it was forwarded without evidence.

To wit, he argues that what the room is missing is "intentionality". It does not have the ability do to anything but react to input in ways that are predetermined by the design of the chinese manual, and insofar as any of its components are concerned (or the totality thereof) they are incapable of reflecting upon the ideas being manipulated.

What is so mysterious about this "intentionality"? Give the Room a prompt that requires it to reason about being a Chinese Room. Problem solved.

Your brain does "speak chinese" properly speaking because it is able to communicate intentional thoughts using that medium. The mere ability to hold conversation does not qualify to what Searles is trying to delineate.

What is the mechanism by which a thought is imbued with "intentionality"? Where, from a single neuron, to a brain lobe, to the whole human, does it arise?

I think it's far from clear that AI mitigates the issue more than it currently exacerbates. I'm in agreement that it's already technically possible, and we're only preserved by the modest sanity of nations and a lack of truly motivated and resource-imbued bad actors.

In a world with ubiquitous AI surveillance, environmental monitoring and lock-downs of the kind of biological equipment that modern labs can currently buy without issue, it would clearly be harder to cook up a world-ending pathogen.

We don't live in that world.

We currently reside in one where LLMs already possess the requisite knowledge to aid a human bad actor in following through with such a plan. There are jailbroken models that would provide the necessary know-how. You could even phrase it as benign questioning, a lot of advanced biotechnology is inherently dual-use, even GOF adherents claim it has benefits, though most would say it doesn't match the risks.

This is a huge problem for ending life on Earth; living is 100% fatal but humans keep having kids. If you set an incubation period that is too long, then people can just post live through it. I also think a long incubation period would dramatically raise the chances that your murdercritter mutates to a less harmful form.

In a globalized world, a long incubation period could merely be a matter of months. A bad actor could book a dozen intercontinental flights and start a chain reaction. You're correct that over time, a pathogen tends to mutate towards being less lethal towards its hosts, but this does not strike me as happening quickly enough to make a difference in an engineered strain. The Bubonic Plague ended largely because all susceptible humans died and the remaining 2/3rds of the population had some degree of innate and then acquired immunity.

Look at HIV, it's been around for half a century, but is no less lethal without medication than when it started out (as far as I'm aware).

Prions would not be the go-to. Too slow, both in terms of spread and time to kill. Good old viruses would be the first port of call.

Searle’s response to the Systems Reply is simple: in principle, he could internalize the entire system, memorizing all the instructions and the database, and doing all the calculations in his head. He could then leave the room and wander outdoors, perhaps even conversing in Chinese. But he still would have no way to attach “any meaning to the formal symbols”. The man would now be the entire system, yet he still would not understand Chinese. For example, he would not know the meaning of the Chinese word for hamburger. He still cannot get semantics from syntax.

Seems nonsensical to me. I fail to see how this person could have that inside their brain and fail to speak Chinese. How is that even physically possible?

So, take throwing a ball. The brain’s doing a ton of heavy lifting, solving inverse kinematics, adjusting muscle tension, factoring in distance and wind and all in real time, below the level of conscious awareness. You don’t explicitly think, “Okay, flex the biceps at 23.4 degrees, then release at t=0.72 seconds.” You just do it. The calculations happen in the background, and you’d be hard-pressed to explain the exact math or physics step-by-step. Yet, if someone said, “You can’t throw a ball because you don’t consciously understand the equations,” you’d rightly call that nonsense. You can throw the ball - your ability proves it, even if the “how” is opaque to your conscious mind.

If Searle were to attempt to rebutt this by saying, nah, you're just doing computations in your head without actually "knowing" how to throw a ball, then I'd call him a dense motherfucker and ask if he knows how the human brain works.

I'm not a strong domain expert in microbiology, but it strikes me as a not particularly insurmountable challenge to design a pathogen that would kill 99.99% of humans. I think it you gave me maybe $10 million and a way to act without drawing adverse attention, I'd be able to pull it off. (With lots of time reading textbooks or maybe an additional masters)

The primary constraint would be access to a BSL-4 lab, because otherwise the miscreants would probably be the first to die to a prototype of the desired strain.

We already have gain-of-function research, the bare minimum, serial passage isn't that difficult. With expertise roughly equivalent to a Master's student, or a handful, it would be easy enough to gene-edit a virus, cribbing sections from a variety of pathogens till you get one you desire. I see no reason in principle why you couldn't optimize for contagiousness, a long incubation period and massive lethality.

This is easy for most nation-states, but thankfully most of them aren't omnicidal. Very difficult for lone actors, moderately difficult if they have access to scientific labs and domain expertise. I think we've been outright lucky in that no organized group has really tried.

Just because there isn't an existing pathogen that kills all humans (and there isn't, because we're alive and talking), doesn't mean it isn't possible.

I am flabbergasted by people, including the person who came up with the Chinese Room thought experiment, Searle, not seeing what seems to me to be the obvious conclusion:

The room speaks Chinese.

(Is that a problem? No, not at all. I just didn't think you'd be Chinese)

No individual component of the room speaks Chinese, including the human, but that is no impediment. No single neuron in your brain speaks English, but we have zero qualms about saying the entire network, i.e your brain, does.

Well, it seems that despite showing up as proper greentext in the comment preview, the local parser doesn't like zero width spaces. Pretend there's a > as appropriate please.

Be me

Doctor with ADHD

Scrabble tooth and nail to get a refill of my ADHD prescription

Diagnosed and treated abroad, existing script not valid

Local GP takes pity on my bedraggled state and pulls strings so an appointment with a psychiatrist takes 3 months instead of 2 years

Show up to the appointment, after traveling 3 hours

Secure prescription for new drug (dexedrine, based on Scott's stimulant review)

Spend another 3 traveling back

Stop at pharmacy eager to get my meds, having run out of a 3 month supply of Ritalin stretched far too long

Be informed that my shrink has prescribed it as capsules instead of tablets. Said capsules are not a thing in the UK, for some reason.

No, this has absolutely zero effect on dosage or the dispersibility of the drug

It's a controlled substance, the pharmacist can't do me a solid and just provide the tablets instead

It's an old-fashioned written prescription, can't just ask to change it electronically. I suppress a strong desire to scribble over it to uh, amend the error.

Be fucked

Cherish the irony of possibly getting prescribed drugs by another doctor with ADHD

Ugh. I could really have used my damn meds, I'm resorting to going through my luggage in the hope that there's something leftover. A perk of having ADHD is that something probably is.

I'm not qualified to make car suggestions, since I have come to the Motte for recommendations on a secondhand car before. That being said, I am rather grateful that the market for secondhand cars is much saner in the UK, at least compared to the US. I don't know what on earth covid did to the market, such that prices still haven't returned to baseline 5 years later.

RLHF also does something I find particularly terrible, namely it destroys the internal calibration of a model.

Prior to RLHF, the base GPT-4 model was well-calibrated. It had a good grasp of its internal uncertainty, if it said it was 80% sure an answer was correct, it would prove to be correct 80% of the time. The adherence to the calibration charts was nearly linear. RLHF wrecked this, the model tended towards being overly certain even when its answer was wrong, while also being severely underconfident when it had decent odds of being correct.

I haven't heard of newer evaluations of this problem, and to a degree it does seem like mitigation was put in place, as current LLMs seem to be much better at evaluating their confidence in their answer.

Apparently Elon and company made some important advances in how to string together an unprecedented number of GPUs together into one cluster and so they were able to throw more compute at the problem.

I'd be interested to hear more about that, it's not something I've seen claimed before. I expect that when you're already running clusters of thousands of GPUs, going to tens or hundreds of thousands doesn't require too much effort.

It genuinely is impressive how xAI managed to extremely rapidly acquire and set up 100k H100s, and then add another 100k in 92 days. That's probably the one place where Elon's supervision paid dividends, he looked at the power issues in the way and cut the Gordian knot by having portable diesel generators be brought in to power the clusters until more permanent solutions were available.

Going from non-existent as competition to releasing a SOTA model in about less than a year is nigh-miraculous, even if it's a very temporary lead. I found Grok 2 to be a rather underwhelming model, so I'm pleasantly surprised that 3 did better, even if it's not a major leap ahead.

Right now, it looks like DeepSeek and XAI are ahead.

I wouldn't say DeepSeek is ahead. Their model didn't beat o1 pro, nor the upcoming o3. They did absolutely light a fire under the existing incumbent's asses by releasing a nearly as good model for the low, low price of free.

Grok 3 doesn't beat the yet unreleased o3 model that OAI is soon to launch.

It's only SOTA for models you can pay for use straight away, and even just an incremental increase over prior models. It is somewhat impressive that xAI was able to pull that off from a cold start, but it's not earth shattering news

OAI still has a slim lead, but in terms of technical chops, is well contested by Anthropic and DeepMind. DM has access to ~infinite money courtesy of Google, and while they've opted for releasing a reasoning model based off a slightly inferior Gemini Flash 2.0 instead of the Pro, it's still highly competent. I expect they're cooking up a bigger one, and don't feel overly pressured to release just yet.

It remains to be seen how Meta will react, but Llama 4 is certainly in the oven, and they'd be idiots not to pivot to a reasoning variant now that DeepSeek has stolen the open source crown.

Video games are notably different, because they're far more reactive and have regular balance patches if things get too stale. It seems to me that major sports are so centralized that you could get away with something along those lines if the people running them pushed for it. After all, even, I a sports-ignoramus, know that rule changes have happened over the years in baseball.

As for Chess? I'd love to see a 5D Chess with multiversal time travel tournament, or even real-time chess, where pieces can be moved as fast you can place them (with cooldowns per piece, so you can't just zoom about with the queen).

I'm not a big fan of sports, though I do think Reddit takes it too far in their performative rejection of such un-intellectual activity (they'd probably ask you to call it Hand-Egg instead of football).

My hot take would be that both kinds of football, as well as basketball, would be improved as sports if we introduced another ball into the equation. No, I'm not taking inspiration from that Chinese warlord who (apocryphally) saw a game of basketball and demanded to know if his country was so poor that they had to fight over a single ball, then followed this up by demanding each get one of their own. I would actually pay money to watch that happen.

These sports severely concentrate the action at one focal point. My impression is that while there's an attack on one end, the defenders are just chilling (they could be jockeying reactively, and probably are, but that's not much fun to watch). Double the ball, double the chaos and pace. I genuinely think soccer would be more fun if there was a chance that the goalkeeper had to contend with the possibility of two balls being fired his way, simultaneously or in rapid succession.

Oh, and halve the size of soccer fields. They seem way too big for the sport.

Thank you for attending my TedTalk. It had about as much effort put into it as the typical ones do these days.

You're right, I'll edit that.

That confidence is why I'd never use a yes/no question as a test; even if one gets it right I'd want to see a proof or at least a chain of reasoning to be sure it didn't get it right by accident.

I understand that mathematicians develop and use jargon for eminently sensible reasons. But they do make things difficult for outsiders, for example, I just screwed up while evaluating LLMs on a maths problem that I thought I remembered the answer to. When my cousin with the actual maths PhD was walking me through the explanation, it made perfect intuitive sense, but I'll be damned if I go through a topology 101 lesson to try and grokk the reasoning involved.

In medicine, and psychiatry, I think current LLMs are >99% correct in answering most queries. Quite often what I perceive is an error turns out to be a misunderstanding on my part. I'm not a senior enough psychiatrist to bust out the real monster topics, but I still expect they'd do a good job. Factual knowledge is more than half the battle.

Agreed. I'm happy to admit that post GPT-4, my ability to strongly evaluate LLMs has failed me.

At least in medicine, most of the difficulty lies in retaining the enormous amounts of knowledge required for a diagnosis, and fluid intelligence plays a smaller role in comparison. Not negligible, by any means, but the difference between an IQ 120 and 130 doctor in most scenarios will mostly hinge on whoever remembered more. Even GPT-4 scored 99th percentile on the USMLE. There was another study that followed it, that assessed it against several incredibly complicated paediatric cases, and it didn't beat a panel of doctors. Said doctors were professors or highly renowned specialists in their fields, a panel of average paediatricians or random medical professionals would have bombed it. Even then, they said that GPT-4 performed adequately, while it might not have come up with a perfect diagnosis and management plan, it didn't do anything stupid or dangerous. And GPT-4 is old. [1]

I don't think I could draft a question that I could answer and an LLM couldn't. Not easily, at least. I'd probably have to crack open a textbook, find an obscure disease, and then try to contrive multiple interactions on top of it. The sheer amount of "general knowledge" LLMs have is vastly superhuman. It's still possible to be a domain expert and exceed it in one aspect, but not to be a generalist who knows remotely as much as they do.

[1] My Google-fu fails me. I don't think I'm misremembering the gist of the study, but it turns out humans can be fallible and hallucinate too, not just LLMs.

Added to the list of works I promise to get around to reading, though I've already worked up a backlog from reccs here haha.

It's likely PEBKAK on my part. My cousin had explained the reasoning almost a year back (eons in LLM time) and I'd likely forgotten the finer qualifications and only remembered the yes or no bit.

I've replied to him. I think there's been error on my part, my cousin's explanation probably included an elaboration on the additional qualifications of the answer.

Most of the reasoning models seem to be saying yes (I didn't keep track of precise numbers), and if they said no, then @wlxd 's response is one they acknowledge as correct.

I'm going to pre-face this by saying I absolutely do not have the maths for this, or at least I've forgotten the explanation my cousin gave.

It's been quite a while since I first asked him, and I don't have him at hand. I don't recall if he pointed out if this holds true if and only if the initial Hausdorff space is also locally compact. I think he might have done so, but I can't be sure. In that case, the error would be mine, because I was only looking for a yes or no answer.

It's an interesting quandary I find myself in, given that I have authoritative sources on both sides as well as LLMs disagreeing with each other. I fed the initial question into the best LLMs I have access to, and if they said yes, then I submitted your rebuttal. They acknowledge that you are correct, though there is some quibbling in the reasoning traces I am not qualified to judge.

I have had mixed results asking reasoning models to answer. The ones I am most satisfied with is:

Final Answer: No. The one-point compactification of a Hausdorff space is Hausdorff if and only if the space is locally compact Hausdorff. Since there exist Hausdorff spaces that are not locally compact, the one-point compactification of such spaces are not Hausdorff. Therefore, the one-point compactification of a Hausdorff space is not necessarily Hausdorff.

Courtesy of Gemini 2.0 Flash Thinking.

ChatGPT with reasoning on:

Conclusion: The one-point compactification of a Hausdorff space is Hausdorff if and only if is locally compact. If is not locally compact, then there exists at least one point in that does not have a compact neighborhood, and consequently, the separation of that point from fails in .

Thus, the answer is: The one-point compactification of a Hausdorff space is Hausdorff if and only if the space is locally compact.

I can't really preserve the formatting with just markdown, so anything Latex would be missing. I'd be happy to share other responses in an offsite text repository, since I don't want to clutter up the thread.

My tentative conclusion is that both you and my cousin are correct, and even LLMs are (most of the time). My error was in expecting a yes or no answer due to my fallible memory.

I have next to no knowledge about baseball and am not entirely sure if this has any CW ramifications, but I guess I'll let you get away with a standalone post mostly as an acknowledgement of effort!

China is actually rather tame as super powers go. It has minor expansionist aspirations, especially in its backyard the South China Sea. Of course, there's Taiwan, but even that country thinks that it and the mainland are a single nation, they just disagree on who's the legitimate one. That would be akin to a counterfactual world where both Russia and Ukraine consider themselves to be the true inheritors of the USSR.

It is also particularly concerned with protecting its own very exposed supply chain and being self-sufficient in the eventuality of war shutting down maritime traffic.

China is defensive. They have no interest in spreading international communism or Xi Jinping Thought. Not even the communism as a fig-leaf over state capitalism that they actually endorse. They are agnostic to the internal politics and ideologies of foreign countries as long as they don't interfere with theirs. Third parties have to do very little to remain in their good books, free trade is usually sufficient.

I would expect that if by some miracle, Taiwan suddenly reunified with China, they had uncontested hegemony over a few islands, and the US went from a cold-war footing to neutrality, then the rest of the world would have little to fear from China. It might bicker with India over mountains and a few valleys, but that is a glorified border skirmish that would simmer indefinitely as nobody really wants to escalate first.

Of course, this is an implausible setting, and it is possible that such a China would then get expansionist tendencies, but that's not really what's been observed so far.

And most of China's woes are self-inflicted. If they didn't threaten Taiwan or throw its weight around with its neighbors, then the happy end of history that was the late 90s to the early 2000s probably would have persisted for much longer.

I'm not disagreeing with you, in fact I agree. I just want to explain why from China's perspective, it is a far more restrained and civil superpower than the USSR ever was. And they even have a point.

Why can't we all get along?