@sarker's banner p

sarker

competency crisis actor

0 followers   follows 0 users  
joined 2022 September 05 16:50:08 UTC

Suddenly I cannot remember the color of your eyes

Or the things we said as we stood together for the last time


				

User ID: 636

sarker

competency crisis actor

0 followers   follows 0 users   joined 2022 September 05 16:50:08 UTC

					

Suddenly I cannot remember the color of your eyes

Or the things we said as we stood together for the last time


					

User ID: 636

I'm saying even if we can only build a computer program that is approximately as smart as the smartest human ever

You are still assuming the conclusion. We have not built a computer program that is as capable as even a sub-median human in all domains, as far as I can tell, unless there is a program that can tie a shoelace and correctly tell me if I should drive to the car wash.

I don't mean this as a gotcha. LLMs are prone to certain cognitive biases that humans are not, and vice versa, and they are highly useful in many fields. But it's clear that the capabilities frontier is not uniform, far from it.

So what I'd ask you, as a full counter to my arguments, what upper limit or barrier is going to appear BEFORE we get to the point we've built something smarter than our whole species?

I don't know. All I know is that the current paradigm relies on massive amounts of artificially generated example problems with answers and I don't believe that all of human knowledge is amenable to such treatment. So far I have not seen any reason to believe that actually general, rather than spiky, superintelligence is imminent. And the imminence is, again, really the key question that's motivating all this.

Left-aligned organizations don't fear that, and they have gotten away with fedposting

Perhaps I missed it, but I didn't see that in your post, unless we're counting death celebration as fedposting now.

The moderators here have included far less overt advocacy than "His killer committed a just act." as fedposting.

Do you have an example?

But LLMs are getting freakishly good at things they haven't been specifically trained on. Their intelligence does generalize.

Such as?

Perhaps we only need to RL them in a few more domains to clinch the rest of generalized superintelligence. E.g. you can have them pilot robots and put them in virtual environments and RL fast them there, or real environments like an academy (a warehouse) a bit less fast.

There's been impressive seeming advances in robotics, though I'm not keeping up too closely. I don't see the connection between operating a warehouse and superintelligence though. Certainly the humans operating the warehouse are not superintelligent.

We should, in principle, be able to build a simulated Von Neumann that is ~as smart as he was.

This is basically assuming the conclusion though. Even granting this for the sake of argument, it doesn't mean that we'll be able to build such a simulation in the next 10 years rather than in ten thousand.

I don't think there's strong evidence against these but I don't think there's strong evidence for these either. Certainly LLMs are not more efficient than the human brain.

The conceit is that there is no such task, and so its only a matter of time, and adding capabilities to existing models, that the human capabilities are exceeded on all fronts.

Could be. But this isn't an argument for short timelines, which is implicitly what we're discussing here.

If the resulting entity is able to do self-improvement, it by definition will do so faster and more efficiently than humanity can track.

Only if, with self-improvement, it actually improves things that aren't suitable for RL environments with massive amounts of data. So far we are very much in the "lumpy capabilities" regime.

I don't really understand what you are trying to say here.

First you say that fedposting is allowed only against figures on the right without lawfare. Then you provide a long post with examples of people saying kirk deserved to be shot and then say that no discord channels were shut down for this sort of behavior.

However, it's quite clear that saying that someone deserved to die is not fedposting. So the connection is unclear to me.

I don't get it. Is fedposting against the right allowed on this forum?

In fact he did not coauthor "plan a".

Maybe someone here can help me with this.

What is the bull case, beyond drawing lines on a graph, for AI achieving superhuman, or even human, performance on tasks that are not quickly verifiable?

AI is quite clearly superhuman at self-contained programming problems. I haven't tried Fable, but I suspect that superhuman open ended software engineering is not far away, though I suspect that humans will have a role in architecture and problem setting as opposed to problem solving for some time more. I expect hardware work will also quickly go down this path, at least to some extent, and really anything that can be RLVR'd. That's enough to account for a huge portion of white collar work and carries serious cyber security risks. Both of those will have serious consequences, politically and militarily.

I am not convinced that AI is improving at anything like this rate for things that can't be RLVR'd, I.e. stuff where you can't generate enormous amounts of useful training data with an answer key. Radiologists continue to do just fine for themselves despite repeated promises of doom. I'm sure someone will chime in to say that the radiologists are there for liability reasons, but it's not as if they are now just hitting thumbs up/thumbs down on AI decisions all day.

Partly this is a sample efficiency question - there simply might not be enough data for them to learn this stuff to human level, and architectural advances that improve sample efficiency may lead to huge gains in quality. But it's not clear to me why people expect this to happen.

Indeed, you can run inference on the ground. Exactly my point.

Indeed. It's quite clear that you can compute in space. My contention is that it will not be cheaper than terrestrial computing (contra Elon), large satellites (100+ MW range) will be infeasible (given the technology under discussion), and small satellites will not be useful.

I am indeed aware of that. There's advantages to having the compute collocated, which is why StarCloud is doing it that way.

Of course you can make the radiator smaller by making the satellite smaller. But you lose any economies of scale by having a big cluster of compute, which is presumably why Starcloud is targeting a massive DC.

My point is not that you cannot run a computer in space, obviously. My point is that small DCs are unlikely to be useful and large DCs are unlikely to be feasible.

It matters because it deflates the context-free appeal to "omg 2000 square meters". Ok. 2000 square meters is just 40 * 50 meters. Is this supposed to be a lot?

I hope I didn't mislead anyone into believing that 2000 square meters is a megastructure. Nevertheless, most people have never seen an Ascend 950 so I don't think that helps contextualize anything for anyone. 2000 sq m is fairly large for a space radiator - the ISS has only about 400 sq m.

Or you can simply launch a little higher. No matter how you cut it, it's all ultimately about mass.

Perhaps. And yet, Starcloud plans to operate in LEO. I assume they aren't totally retarded and have thought through the choice of orbit. It's difficult to have a discussion about this when you ignore the details from the actual proposals in favor of advocating for stuff they aren't doing when it's convenient. Either the people working on this are smart and have chosen the best parameters for this, or they are stupid to the point that the internet peanut gallery can do better and therefore aren't going to succeed. You must pick one.

Neither solar panels nor radiators lose function quickly from random point damage.

If you're pumping coolant through a tube that's open to vacuum, you're going to have some problems.

Since you dislike X, I'll cite it again. NVIDIA CEO JENSEN HUANG: 1GW AI FACTORY ON NVIDIA ARCHITECTURE COULD COST NEARLY $100 BILLION

I don't really understand what drives a man to repost second hand all caps claims. I'm not even saying that he didn't say this, but surely you must understand that this is simply not convincing to anyone?

I guess popular reporting can create the impression that Americans are actually standing up tens of gigawatts of capacity without problem, like so much coal plants in China. This is not, in fact, happening.

Space based DCs also fail the "not currently happening" test, so this part is a wash.

Numbers presented without showing the math can be dismissed just as readily.

As explained, it's a simple application of the Stefan-Boltzmann law.

2000 sq m is for a small DC. StarCloud proposes a radiator of nearly 8 sq km.

Ascend 950 SuperPod has an area of 1000 square meters for the actual scale-up compute unit that works as one GPU.

Uh, okay. Manhattan has an area of 20 square miles. What's the relevance to space radiators?

«Redwire Q-Rad Deployable Radiator (commercial, TRL 5-6): 3.5–4.9 kg/m² areal density. Source: Redwire radiator datasheet lists; brackets our StarThink V1 assumption as plausible near-term path.» Let's say 4. This is just 8 fucking tons. This is peanuts. At $100/kg it'd be merely $800000 for delivery, 8% of Starship capacity, or four more big Starlinks. 1 megawatt of compute costs… let's see, a modern-ish GPU that draws 1 kW in a rack can go for $20K at least, and actually we'll see prices creep towards $50K. Well there you have it, $20 million as the floor (and GPUs are just ≈40% of BOM). 1 megawatt is 8760 MWh/year. Google tells me wholesale electricity in the US is like $45. Almost $400K a year of free power. None of this matters of course, when inference margins are >80% even with hardware depreciation, and all that matters is deploying as fast as possible, as much as possible.

Hmm. What is StarThink?

I think it's quite clear that mass is not the concern I raised wrt the size of the radiators, which is why my post did not say anything about mass. Huge radiators cause drag and are vulnerable to micrometeorites. Redundant cooling loops can mitigate micrometeorites, but then you need bigger radiators.

But since you brought it up - the radiator you posted is solid state, SpaceX says they will use circulating liquid radiators, same for starcloud. I expect this is because circulating liquid radiators scale more than passive radiators like the one you are looking at. Just a guess on my part, though.

Now, StarCloud says each data center will be 5GW. They are cagey about how exactly they will dissipate 5GW, but with a simple water/glycol loop we are looking at 50,000 kg/s of flow which is massive. All those pumps will of course also need to be cooled.

On top of that, the radiators need to be filled with coolant. Back of the envelope math, again for a simple coolant loop, suggests perhaps 100,000 tons of coolant in the radiator, so we're looking at $10B just to get the coolant up there across hundreds of launches and nothing else. They do not go into the math of this in their whitepaper, probably because single phase liquid coolant is totally infeasible.

You don't know the relevant numbers in any of the involved verticals, and for some reason (unfathomable to me) you want to believe that the numbers support your (quixotic but perplexingly popular) case against compute in space. They don't.

Tedious bluster. Please save it for Twitter.

It's puzzling to respond to a report with numbers worked out with an appeal to authority and a "it's not an issue". Puzzling, but perhaps typical of this discourse.

Please show the math.

The economic case for asteroid mining is also dubious as far as I can tell.

Near-future space development will be all about communications, GPS, and surveillance — perhaps with a bit of weaponization thrown in to deal with the surveillance.

Indeed, and I have seen people discuss that a niche for space datacenters might be processing satellite data up there rather than beaming it down (for latency and availability reasons). Perhaps, presumably you wouldn't AI-scale DCs for that so it might be more feasible.

the space compute idea will genuinely work too, given political and logistic problems with terrestial datacenters in the US – and the objections to it are more motivated thinking, not solid engineering or bottom-line costs analysis

You won't see this because you've blocked me, but this isn't true and several people have tried to do the math. Here's the most recent. To sum up, cooling even a 1MW space datacenter (tiny by terrestrial standards) would require a radiator of 2000 square meters. The article doesn't discuss solar panel sizing, but using star cloud's numbers of 400 W/sqm we're talking about 2500 sq m before we consider redundancy. And that's just power and cooling for a single MW. In fact, it seems to me that it's the space DC boosters who refuse to engage on this and show their work.

There's nothing "wrong" with it per se, but most people don't want to do it and historically speaking most people have never wanted to do it and have generally not done it in times and places of low infant mortality.

No man is an island,

Entire of itself;

Every man is a piece of the continent,

A part of the main.

If a clod be washed away by the sea,

Europe is the less,

As well as if a promontory were:

As well as if a manor of thy friend's

Or of thine own were.

Any man's death diminishes me,

Because I am involved in mankind.

And therefore never send to know for whom the bell tolls;

It tolls for thee.

— John Donne, "pre-WWII"

The kind of sex that avoids the possibility of conception either sucks, or you've got your wife on a hormone regimen.

Non hormonal IUDs exist, and so does cycle timing.

In my marriage we disagreed on the timing of children. As a result we have some regrets that we resist lingering on, but I'm now convinced it probably shouldn't have been our choice to make. Who should want to accept the burden of a choice like that?

Unless you want to have 7+ children, your options are:

  1. Contraception

  2. No sex

  3. Marry your wife shortly before menopause

In the first two cases you are still stuck with the burden of deciding when to have kids.

He might. Of course, he might also get along with a future Democratic admin, as he did in the past.

the implosion of the Democratic Party as a nationally competitive entity. The national party is losing the fundraising race badly

The immolation of the Democratic Party and the rise of Zohran Mamdani Thought would be a development not necessarily in Elon's favor.

The Dems next top prospect for President is apparently caught up in a corruption probe. Their bench is critically thin.

A two year long wiretap campaign that hasn't led to anything on Newsom. At this point if you aren't being investigated by the Justice Department you are simply not a viable presidential candidate.

HAKUTO‑R Mission 1

I mean, it landed, but I thought we were discussing soft landings rather than impacting the surface at a high rate of speed.

HAKUTO‑R Mission 2 (Resilience)

Same deal.

Counting only successful landings we're at 3600 kg. Chandrayaan-3 had a launch mass of 3900 kg, so SpaceX is only exceeding Japan.

I admit I was mistaken about 0, but copy pasting AI slop in response doesn't inspire confidence.