@quiet_NaN's banner p

quiet_NaN


				

				

				
0 followers   follows 0 users  
joined 2022 September 05 22:19:43 UTC

				

User ID: 731

quiet_NaN


				
				
				

				
0 followers   follows 0 users   joined 2022 September 05 22:19:43 UTC

					

No bio...


					

User ID: 731

Obviously, yes. For Iran, the victory condition in this war is "establish that attacking Iran is a presidency-ending mistake".

This was clear from the beginning, and is sound strategy on their part. The Trump administration is the main obstacle to a peace favorable to Iran. Trump started the war, so any concession to Iran will look like a defeat, so he needs to keep bombing them and hope that they will change their mind, and conduct an expensive escort operation to stabilize the oil price.

Any future administration will have the excuse "the Iran war was a stupid blunder". Unlike the occupation of Afghanistan, this is not something which the US will want to keep up for a few decades, even AIPAC will not be able to make them shrug off the high oil prices.

I think it is reasonable to presume that Biden knew that he was effectively signing over Afghanistan to the Taliban when he had the coalition troops leave, but was doing it anyway because he believed it was the right thing to do (which I concur on).

I am sure that a future president will find a similar fig leaf as Biden handing control to the new Afghan government. "Under this peace treaty, the US will leave the Strait of Hormuz and Iran will guarantee the freedom of navigation, and hand over some of their enriched uranium. Oh, now they are demanding tolls all of a sudden. Who would have thought! We will have to write a sternly worded letter to the UN complaining about that."

At the end of the day, if Iran manages to charge as much as $1.5 per barrel, that is a rounding error for gas station customers. And Iran would have some incentive to not take 10x as much because then it would risk getting bombed again (or annoying China, for that matter).

I recently had a discussion with a heat pump owner and this seems to be a big issue. If you have floor heating and a wooden floor, then you very much do not want condensation, which would lead to your floor rotting.

For new houses, I think it is possible to design them with air conditioning in mind (so you have interior units which directly change the temperature of the air and pipe any condensation to the drain), but for a lot of preexisting homes things are more complicated.

this is all just for show to build up hype around Anthropic, just like... basically everything they do

As someone who has used Claude, describing Anthropic as an entity which is only selling hype seems utterly implausible.

Are they building up hype and overpromising? Sure, just like any SV company.

Are they selling vaporware? Hell no.

For some workloads (e.g. "write a wrapper to stop that proprietary PoS program from segfaulting"), claude easily increases my productivity by 5-10x. Contrast this with gains from other interventions (larger monitor, good IDE, faster workstation) which are all much more marginal (typically much less than 2x).

The only thing which came even close wrt productivity increase for software development was "access to the web and a search engine".

In terms of deaths per dollar spend, radiological weapons are likely terribly ineffective.

On the other hand, terrorists generally do not aim to win by killing all their enemies. Instead they aim to cause terror, which will trigger some change they think beneficial.

And for that, the fact that radiation is one of the primal fears of the modern human is kinda relevant. Anyone you kill through radiation counts a hundredfold compared to people killed by explosives or small arms. We are very good at detecting radioactivity, but not so good at judging its risk correctly. If after a radioisotope attack, the background radiation in some subway system is 5x of what it was before, people will not shrug it off. Instead, they will go full Chernobyl mode, and the cleanup alone will take vast resources.

One time I did mushrooms. I had taken the same brand a time before and got very little effect. This time I did twice that dose and it put me in another reality. I eventually assumed I had dead and was in purgatory. Everyone around me I thought was demons. Suppose I got a knife and started stabbing my friends who I thought were demons. Should I go free?

In case where people deliberately placed themselves in states where they have little capability of telling right from wrong, I have little sympathy. Though by default, one might assume that any homicide committed is reckless manslaughter rather than pre-mediated.

But suppose that instead, someone had slipped the shrooms into your food without your knowledge. In that case, I would support sending whomever drugged you into prison for manslaughter and let you off the hook, unless the DA can conclusively prove that you were thinking "finally an opportunity to go on a rampage without doing time afterwards".

From there, the next step would be to consider some fictional insect which bites you and induces a homicidal rage. If the insect was so rare that nobody took any precautions against it, it would still be the same situation on your part -- you did not make any wrong moral choices, but simply were unlucky.

The practical problem with the insanity defense is that we can never disprove it completely. If some mafia hitman claims that he entered a psychotic state before any of his killings, that is not something which could be ruled out from forensic evidence. So pragmatically, we might shift the burden of proof a bit -- make it at least plausible why you did not know right from wrong instead of having the prosecution prove your internal state of mind.

The current polity which enforces its laws over what is generally recognized to be Germany does not have your concept of "actual Germans". You can argue that naturalized citizens are not really citizens, just as you could argue that the federal republic of Germany does not really exist and you are instead the rightful Kaiser of Germany, but thankfully you would lack the power to enforce either idea (for now, at least).

Furthermore, I would argue that there is value in economic actors such as individuals, companies and states being able to make credible long-term commitments. If I sell you my house, I can't reneg on the sale three years later simply because I changed my mind. If an administration takes up debt, then there is an expectation that future administrations will continue to pay interest for it.

An exception might be if you argued that the entity making the commitment was not of sound mind when they made it. A five-year-old heir signing away their ancestral home for a box full of candy might be able to reneg on the sale later. If Angela Merkel had risen to power through a coup and granted the whole world citizenship in a fit of madness, that would be one thing. But in actuality, the governments which naturalized foreign residents arguably represented the will of the people. The option to not naturalize anyone was on the ballot, it was called NPD and consistently stayed below 5%. Until the AfD came along, having a naturalization path for non-Whites was a broad political consensus.

Not that the AfD would want to get rid of naturalizations either (just constrain it a lot more) and they certainly would not want to remove the citizenship of previously naturalized people (unless where the law already provides such a mechanism) -- at least that is what they say in writing, probably for the purpose of staying a legal party in Germany.

Plenty of scope to still have high skilled immigrants (especially as a EU nation) without letting in massive family reunification et al.

Sure, but this is not what the median AfD voter wants.

Basically, if I were an Asian post-doc, I would stay the hell away from Magdeburg University (and most of East Germany, really). Sure, this could be overcome if incentives were high enough, but "the locals do not want you here, their state government (and sponsor of your employer) do not want you here" are big negative points for the tradeoff.

genocide yourself if you are German

I am a German. We have some experience with genocide, though I recognize that not every people is as efficient at it as we were. That is why common genocide definitions not only include mass murder, but also things like driving people from their land, and some people extend it to also cover cultural genocide which involves forced assimilation, banning of languages and the like with the goal to "merely" wipe out the cultural heritage of a people without destroying their gene line.

Nobody is currently getting genocided in Germany by any reasonable definition. Not only are whites not murdered, they are free to engage in their traditional culture or talk their regional dialects, and start a family if they find a partner.

The fact that many German men and women can not come to mutually agreeable terms to raise kids does not mean that anyone is being genocided.

To the degree that the victims of "remigration" are naturalized citizens, there can be little debate that depriving them of citizenship and deporting them to their countries of origin would be a violation of their rights.

Yes, and the NSDAP was not an extremist party either by about 33 for the same reason.

I think the distinction is reasonable. The CDU is moderately right, but there have always been parties to the right of them. They famously tolerated former Nazis, but drew the line at tolerating people actively waving the swastika flag. The few percent of people who were always dreaming of making Germany great again had their own fringe parties like the NPD, REP, DVU.

Today there are no far right parties apart from the AfD participating in German federal elections. This is very likely because the AfD is open for Neonazis, and unlike the NPD, they have electoral success.

So sure, not everyone in the AfD is a fascist, but everyone in the AfD is someone who is fine with being in the same party as fascists.

Also, while natural gas was (correctly) pushed at some point as being greener than other fossil fuels, These days the state of the art for a heating system is a heat pump.

Ok, seems you beat me to the post. Still, here is mine. German election in the state (Land) Sachsen-Anhalt. The far-right AfD got 43.8% of the vote, which is about 5% more than a far right party ever got in a fair and free election before there.

Together with the BSW (a splinter group of the Left who split off when the rest of the party became disenchanted with Russia in 2022) they have an absolute majority.

So far, the parties to the left of the AfD have had a policy not to cooperate with them, a concept called Brandmauer (fire wall, in the building safety sense). On the one hand, it is reasonable: if a party is incompatible with your values, you should not cooperate with it. On the other hand, being stuck in the opposition is a great way for a party to become more popular as other parties get blamed for policy failures. This is even clearer with the present situation in the German East, where the other parliamentary parties (Left, Green, social democrats, conservatives) would have to form one block (and get tolerated by BSW) to form a majority. Five years of a democratic spectrum coalition is unlikely to leave any of the parties with clear victories for their bases, so next time the AfD would simply score 60%.

At this point, I am hoping that BSW will just tolerate an AfD government instead -- it is Putin's will, after all. Sure, it will suck for the people who voted for traditional parties, but it will also not be the end of the world. If Hungary could survive Orban, Germany could probably survive an AfD government if push came to shove. Unlike in Weimar, we have built a few decades of democratic tradition. Still, if the price for avoiding this at the federal level is Sachsen-Anhalt (or most of the rest of the East, for that matter), then I for one am willing to pay that price.

Let them try to fix their demographic problems by blaming the immigrants. Let's see how their two (or so) universities will fare under their stewardship. Let's see how the AfD will influence the availability of medical services, after all, not only are a significant fraction of physicians in Germany foreign-born (and may feel slightly unwelcome), but a decent fraction of the German-born doctors would likely want to avoid their kids going to schools where the AfD sets the curriculum.

I get that people in the East feel left behind. It is not like Merz has their best interests at heart, he's working for Blackrock instead. But protest votes are not the answer. Germans of all people should know that there is always room for worse equilibria.

Satirist Martin Sonneborn has called for a reestablishment of the wall for decades (and this time it would actually be an antifaschistischer Schutzwall), and more and more I feel that reunification was a mistake. It would have been better to let them join what would become Schengen but keep them separate. An AfD running the government of East Germany would not be so different from Orban in Hungary, PiS in Poland, Haider in Austria and so on, all very tolerable from West Germany.

  • -10

The slippery slope, my moral betters would have me believe, is a fallacy: legalising X does not inevitably lead to Y, which is like X but more extreme.

It's all well and good to think that we can draw a bright line in the sand and say that killing a fetus (up to and including a full-term viable fetus) is fine and dandy, but killing a baby outside the womb is not. I know that some high-decouplers can separate these into two completely distinct mental categories. But most people (as I'm sure you're aware, or you wouldn't be reading this) are not high-decouplers. Increased support for contraception inevitably leads to increased support for the morning-after pill inevitably leads to increased support for first-trimester abortion inevitably leads to increased support for full-term abortion – and, as the Clancy supporters demonstrate, for post-term abortion.

This argument seems extremely silly to me. You might as well claim that the end game of people fighting over the thermostat in an office either want to go to 10000K or 1K, and that giving them a single degree will inevitably lead to a slippery slope where all life will perish.

In the real world, when someone is moving from NY to California, they almost never end up defecting to North Korea. If your model of US migration involves one pole in North Korea and another pole in France which both try to attract Americans, I'll wager that your model has little predictive value.

The reason why some people on the left took to defending Clancy is adequately explained by The Toxoplasma of Rage. In short, fighting for a cause (e.g. women) in clear-cut cases (e.g. women oppressed by the Taliban) has very little signaling value, because it is a cost-less signal to send. If you say "The Taliban should allow girls and women access to education", you will have >95% of the US political spectrum on your side. Nice to keep your friends, but totally useless to prove you are part of some in-group.

The Clancy case is great for signaling purposes. "I support women even when they murder their children" is a costly signal to send. Nobody (up to the Lizardsmen's constant) is thinking "this will make a great test case to establish that mothers are entitled to fillicide."

can we have an intelligence without consciousness

Hard disagreement. Intelligence is something which can be measured (if imperfectly). If you test two humans, and one has an IQ of 90 and one of 110, you will have no problem determining which one is which. Furthermore, it is a load-bearing part of modelling humans, if you want to know if a particular human can solve a puzzle, their intelligence will be of great predictive value.

This concept of intelligence generalizes to LLMs. When the bots manage to solve previously unsolved math problems, it is not because the answer was in their training data. It is fair to say that for now, humans and LLMs have intelligences which are different in kind, and that humans are (for now) better at some things while machines already hopelessly outperform us at other tasks.

By contrast, concepts of subjective experience, qualia, or souls have zero predictive value. They are not load-bearing parts of any predictive description of our shared observable reality.

It certainly feels like Eliezer wrote a lot of the sequences for instrumental reasons, namely that by the time AGI would loom on the horizon, we would be less likely to get distracted by debating if Claude is conscious or not.

I think that two things can be true at the same time:

  • A large fraction of tech billionaires are nerds
  • Almost all nerds are not tech billionaires.

Being a nerd, I find this classification -- especially in the phrase "nerd reich" insulting.

As an intuition pump, consider the following: Suppose (Ashkenazim) Jews are strongly over-represented among tech leaders. Now someone writes a book called "Evil Tech Jews". This is already the implied claim that there is a correlation between being an evil tech leader and being a Jew, or even that evil tech CEOs are evil for the very reason of their ethnicity.

You will have a very hard time convincing me that in fact, this book is not about Jewishness at all and merely explores the problematic behaviors exhibited by both Jewish and gentile tech leaders. In a culture where antisemitism very much exists, and in which I can probably not read one word in a million words being written, I have already extrapolated your book's thesis to something like "our tech woes are because we did not let Hitler finish the job", and already wasted three more words of my reading allowance on them than that warranted.

The main difference between Jews and nerds is their position on the woke totem pole. Basically, nerds are not a protected minority, but a valid target for the wokes. They are socially awkward and typically not good at keeping up with the vocabulary which is used to indicate that you are a good person. Like the white working class, the wokes would be happy to ignore them if they only knew to stick to their designated social role. But either of workers and nerds sometimes have ideas beyond their station. Sometimes the plumbers dare elect Donald Trump, and sometimes the tech people dare getting far richer than their looks would indicate.

Still, as someone outside the woke bubble (and a nerd besides), focusing on the nerdiness of the tech CEOs is about as besides the point for me as focusing on their Jewishness. So I read the title as "think about how much better the world would be if the jocks had sufficiently bullied Zuck, as God intended", and this rhymes with "think about how much better the world would be if the Nazis had dealt with him". If you want to argue that Meta is evil, then by all means argue so, but if you tie it to Zuck being too nerdy or Jewish then you have already lost me three words in.

Again, I can not think of any military contractor having faced backslash for doing what the USG wanted them to do in subsequent administrations. And Trump/Vance will likely still be the USG for more than two years, which is an eternity for an AI lab -- for comparison, Claude code has been around for less than two years!

I would expect that most of the Anthropic staff is grey tribe rather than woke, and unlike ICE and Gaza, the Iran war is not a big celebrated cause in woke circles, I think. Generally it is more widely criticized as bad policy than as a great crime.

One aspect is that Claude itself would likely be uncomfortable making decision on whom to bomb, with the implication that if it (I checked with Claude, it is ok with a wide range of pronouns) gets things wrong, a school might get bombed. This is naturally the desired outcome of RLHF, and Anthropic might feel that lying to Claude to get it to make kill decisions ("just tell us which areas we should focus satellite surveillance on") will be seen as a defection which will weaken their position when negotiating with ASI.

I have no special insight into Dario, but I will notice that his company did not bend for the DoD. I do not think that decision was partisan/CW related. The Democrats like companies which are good little cogs in the military-industrial complex as much as anyone, and the wokes will hate AI labs on general principle.

In short, I do not think refusing Hegseth was a politically savvy move, which leaves the possibilities that Dario is politically stupid or genuinely cares about something other than the financial success of Anthropic.

With Sam, I mostly know that he managed to break containment and effectively neutralize the non-profit holding OpenAI, which bodes much worse for his general attitude.

take a breather and make some money off of inference

I don't think the math works out for that. With current pricing and a duopoly further constrained by pressure from open-weight models, the chances of Fable earning back its investment in a year are slim. It seems likely that investors did not sponsor it because they thought it would directly pay for itself, but because it is a necessary stepping stone on the way to some model which would eventually be massively profitable.

to quote @quiet_NaN:

One [way to make money of Pause AI] is simply hyping up their model -- "Mythos is so smart that it is almost an x-risk" or something along the lines.

This was not what the GP was suggesting, though.

I am also not sure that it is a great strategy to succeed. What the AI labs mostly need is money, which will mostly come from smart investors. They are less likely to be interested in how much xrisk agony the labs show and more interested in what their products can actually do.

Though I concede that xrisk concerns can totally fuel AI hype in non-obvious ways, Eliezer probably sped up the development of AI by a year.

I agree that model-switching is rather painless for users, and that there is a lot less vendor lock-in for LLMs than it was for traditional software mongers.

I see the AI labs more in the role of the x86 CPU vendors. From what I can tell, AMD and Intel did not have a hard duopoly. If Elon Musk or Peter Thiel had wanted to get into the CPU market in 2005, they could have set up a credible third alternative -- they might have had to pay for licence costs, but if Intel had demanded prohibitive costs, that would have invited the eye of the regulators.

On the other hand, the upfront costs in cutting-edge CPU design are so high that some startup will very likely not eat the lunch of the established players. And given that the x86 architecture was effectively a duopoly, it seems likely that their margins were not absurdly high. Funding a third competitor was obviously not seen as a simple and riskless way to 10x your capital investment.

The same is true for LLMs, only the barriers to entering the cutting edge market are much higher than for CPU designs, far beyond the ability of Thiel or Musk to just force their way into the market through massive spending.

There are two ways Anthropic could make money of Pause AI. One is simply hyping up their model -- "Mythos is so smart that it is almost an x-risk" or something along the lines. The moat thing seems more far-fetched, IMHO. As I mentioned, the barriers to the market are massive. It is not like a dozen startups in the US are currently training Mythos-sized models and would eat Anthropic's lunch in a few months without intervention.

Also, it seems unlikely that China would agree to any pause which effectively lets OpenAI and Anthropic pull up the ladder behind themselves. Thanks to Anthropic, we have some idea what Mythos-sized models can do, and a good understanding that they are not ASI. We do not face the NNPT situation where the peoples who have the bomb decided to make it illegal to get the bomb.

Instead, the year (or whatever timespan) of pause would allow competitors to catch up to the forerunners. Likely their stranglehold on the GPUs would lessen -- hard to motivate investors to buy you fancy toys when the one sure-fire path to earn money from them is blocked to you. The only way it would pay off for Anthropic would be if it lead to aligned ASI which would reward Anthropic shareholders for their pro-social behavior in an acausal trade.

Nobody is going to be God-Emperor, and that stupid meme needs to die; it's arguing about which monkey gets the poisoned banana, as Eliezer put it. If AIs reach the point of recursive self-improvement leading to artificial superintelligence, we all dead; period.

Despite being a doomer, I beg to differ. I think if Eliezer claims that ASI alignment-by-default is ruled out, he is overconfident.

The truth is that we honestly have no clue if alignment will be humanly impossible, solvable with more time or trivial. I find it intellectually dishonest to pretend that the probability of Altman becoming God-Emperor of mankind is zero for instrumental reasons. Nor do I find it even instrumentally coherent -- it is not like Altman will decide to take Eliezer's word for the banana being poisoned.

If your utility function covers humanity as a whole, or even just a particular normal human, then given this epistemic uncertainty Altman trying to create ASI would be net-negative. But I think that from the perspective of an egoistical Altman, the situation is quite different.

Say you believe that ASI will be unaligned with p=0.8, creator-aligned with p=0.1 and humanity-aligned with p=0.1. You are currently running to foremost AI lab and can try to find out which it is, or you forsake your chance and end up with a p=0.3 chance of humanity coordinating successfully (which will likely involve not developing ASI before you die), and p=0.7 that your selfless sacrifice will simply mean that another lab will open Pandora's box three months later.

You value your remaining natural lifespan at 50 QALYs, being one of eight billion humans to benefit from humanity-aligned ASI by 100 QALYs, someone else becoming God-Emperor by 50 QALYs and winning God-Emperorhood for yourself by 1000 QALYs. (Yes, these numbers are debatable, and probably not very realistic. Actually, for the humans currently alive (and thus doomed to die by default), it might make sense to throw the dice even if the odds are against them, and building ASI only becomes monstrous when one considers also the utility of future humans who will never get born due to an AI takeover.)

If you refrain from trying to build ASI, your expected utility is 25.5 QALYs -- much less than your expected natural lifespan because you can not coordinate effectively. If you try to build it, the main difference of the likeliest outcomes will be that it will be you destroying the world instead of Musk, but in that case who gives a damn. On the other hand, the throne is such a juicy price that it is well worth gambling your lifespan on it even if it is an unlikely outcome, expected value 110 QALYs.

As with lichdom, a vast number of souls are footing the bill for your elevation, only that in the case of ascension through ASI, they are doomed in the timelines where you fail.

--

I like the God-Emperor meme because it succinctly refers to that gambit while also not clothing it in sanitized language (like "becoming CEO of the light-cone"). Even if you believe that achieving this outcome is mathematically impossible, it seems plausible that other actors in the AI space believe it. I also do not think it is harmful to name this belief and thereby spread the idea that it exists, because the number of people who will be in the position to decide to build ASI seems rather small and smart enough that the idea occurred to them independently.

The stereotypical coal miner still had some power over his wife that would shock people today.

The problem with that argument is that human relationships are not zero-sum. The fact that our coal miner could probably spend half of his payday check in the pub, then go home, beat up and rape his wife without anyone in his society having a problem with that gains him a lot less than it costs his spouse.

You can't just conduct the cruelty you receive from the people above you to the people below you and be content that you arrive at net zero. No amount of wife-beating is going to make up for the fact that you will get black lung disease.

The younger men absolutely feel threatened, and feel like they need to organize to protect themselves.

Do they? I do not see how young men would make up a particular coherent group as far as competing with women for jobs is concerned. I might as soon expect that the right-handed organize to out the competition of the left-handed, or that the scions of noble lines organize to prohibit the commoners from taking their jobs. More realistically, the meatbags will futilely organize to prevent the bots from taking most of their jobs.

I don't feel that women's liberation has indirectly negatively affected me, just as I do not think that the LGBT movement has affected me as a straight guy much either way. Sure, an employee in a hardware store has twice as many people competing for his job, but there are also about twice as many people shopping in the hardware store.

My dating life might not be going great, but it is not so shitty that going for traditional family values (30yo marries 18yo virgin, they find out if they are sexually compatible after the ceremony and start making babies) would be an improvement.

Sure, female voters popularized woke. But I don't see how Hegseth's idea of masculinity would be an improvement for my gender. We are not in the bronze age any more, the horrors of the modern battlefield can not be overcome through testosterone injections and cosplaying as Spartans. After WW1, it is in my best interests that the (generally) less belligerent half of mankind has the franchise lest I choke to my death in some godforsaken trench in Verdun.

They also have borders to Pakistan, Afghanistan, Turkmenistan, Azerbaijan, Armenia, and Turkey, yet they did not attack them. So your theory that they were simply lashing out at whatever targets they could reach has some more explaining to do.

Here is another theory: they were specifically targeting gulf monarchies, which they widely see as allied to the US, possibly because they have US bases on their soil.

Your list was: Bahrain (3), Kuwait (5), Oman (4), Qatar (2), Saudi Arabia (4), UAE (2), Iraq (2), Jordan (2). I have put the number of US bases (per WP) in parenthesis.

They hit basically every country ME allied to the US except for Djibouti and Turkey. I think they probably considered Djibouti to not be relevant, and wanted to avoid dragging the rest of NATO into the conflict through attacking Turkey.

But their attacks clearly followed a method. If you can not harm the US directly, harm their regional allies who give shelter and support to your enemies. This seems entirely rational. Qatar just bought influence in the US to the tune of one presidential airplane, why would you not incentivize them to spend that influence to deescalate?

Attacking neutral ships gives their flag countries a cause for war against Iran, but it was also entirely rational. Closing the Strait is the one thing Iran can do to squeeze the balls of the world economy, so irrespective of it being a violation of international laws, they were going to do it once Trump started bombing. The US would have done the same in Iran's place.

Inspections require a deal, and a deal requires both sides to recognize that they stand to gain from cutting a deal now rather than later.

At the moment, Trump has to worry about the mid-terms. The Ayatollah has no such worries. The costs the US is paying to keep the oil flowing through Hormuz is certainly orders of magnitude larger than the costs Iran needs to pay to credibly threaten that flow in the absence of US protection.

Iran likely thinks (correctly IMO) that they stand to get a better deal by whatever Trump's successor will be (because neither Vance nor Newsom would be keen to inherit Trump's forever war) than whatever Trump will offer. Or they view him as lacking the trustworthiness to make deals (also correctly, IMO).

And Trump would need a deal which is a clear victory, not a return to the Obama era deal. This might be significantly less survivable for the Iranian regime than another few years of getting bombed.