@faul_sname's banner p

faul_sname

Fuck around once, find out once. Do it again, now it's science.

1 follower   follows 1 user  
joined 2022 September 06 20:44:12 UTC

				

User ID: 884

faul_sname

Fuck around once, find out once. Do it again, now it's science.

1 follower   follows 1 user   joined 2022 September 06 20:44:12 UTC

					

No bio...


					

User ID: 884

Lefties hate Trump for Jan 6

Lefties hated Trump long before Jan 6. Jan 6 was just an opportunity for them to say "see I told you so".

Lol P/E of 644.

But it's a hyper-growth company bro, surely they'll be able to pivot to making money once they've captured the full market bro.

I think the problem is that "good job" doesn't mean "not messing up" in the context of these compliance-as-a-service or security-blanket-as-a-service companies. Instead, "good job" is "implement as many features as possible to a level where it's not literally fraud to claim your product has thay feature, and then have a longer checklist of supported features in your product than the competition has so the MBA types choose your product".

CrowdStrike's stock price is only down by about 10% today on one of the highest-impact and highest-profile incidents of this type I've seen. I'm pretty sure their culture of "ship it even if it's janky and broken" has netted them more than a 10% increase in net revenue, so it's probably net positive to have that kind of culture.

This seems to me like a fairly usual level of competence from a bolt-on-security-as-a-product or compliance-as-a-service company. Examples:

  • CVE-2016-2208: buffer overflow in Symantec Antivirus "This is a remote code execution vulnerability. Because Symantec use a filter driver to intercept all system I/O, just emailing a file to a victim or sending them a link is enough to exploit it. [...] On Windows, this results in kernel memory corruption, as the scan engine is loaded into the kernel (wtf!!!), making this a remote ring0 memory corruption vulnerability - this is about as bad as it can possibly get". Basically "send an email with an attachment to pwn someone's computer. They don’t have to open the attachment, as long as they have Norton Antivirus (or anything that uses the Symantec Antivirus Engine) installed".
  • CVE-2020-12271: "A SQL injection issue was found in SFOS 17.0, 17.1, 17.5, and 18.0 before 2020-04-25 on Sophos XG Firewall devices, as exploited in the wild in April 2020. [...] A successful attack may have caused remote code execution that exfiltrated usernames and hashed passwords for the local device admin(s), portal admins, and user accounts used for remote access"
  • Okta data breach a couple months back: "For several weeks beginning in late September 2023, intruders had access to [Okta's] customer support case management system. That access allowed the hackers to steal authentication tokens from some Okta customers, which the attackers could then use to make changes to customer accounts, such as adding or modifying authorized users."

It's not that it's amateur hour specifically at CrowdStrike. It's the whole industry.

Yes, it has an input parser

Specifically OpenCLIP. As far as I can tell the text encoder is nearly a bog-standard GPT-style transformer. The transformer in question is used very differently than the GPT-style next token sampling loop, but architecturally the TextTransformer it's quite similar to e.g. gpt-2.

Still, my understanding is that the secret sauce of stable diffusion is that it embeds the image and the text into tensors of the same shape, and then tries to "denoise" the image in such a way that the embedding of the "denoised" image is closer to the embedding of the text.

The UNet is the bit that generates the pictures, but the text transformer is the bit which determines which picture is generated. Without using a text transformer, CLIP and thus stable diffusion would not work nearly as well for generating images from text. And I expect that further advancements which improve how well instructions are followed by image generation models will come mainly from figuring out how to use larger language transformers and a higher dimensional shared embedding space.

Stable diffusion contains a text transformer. Language models alone don't generate pictures but they're a necessary part of the text-to-image pipeline.

Also some LLMs can use tools, so an LLM using an image generation tool is in a sense generating a picture. It's not like humans regularly create pictures without using any tools.

One of the main use cases I have is "take this algorithm described in this paper and implement it using numpy" or "render a heatmap" where it's pretty trivial to check that the code reads as doing the same thing as the paper. But it is nice to skip the innumerable finicky "wait was it numpy.linalg.eigenvalues() or numpy.linalg.eigvals()" gotchas - LLMs are pretty good at writing idiomatic code. And for the types of things I'm doing, the code is going to be pasted straight into a jupyter notebook, where it will either work or fail in an obvious way.

If you're trying to get it to solve a novel problem with poor feedback you're going to have a bad time, but for speeding up the sorts of finicky and annoying tasks where people experienced with the toolchain have just memorized the footguns and don't even notice them anymore but you have to keep retrying because you're not super familiar with the toolchain, LLMs are great.

Also you can ask "are there any obvious bugs or inefficiencies in this code". Usually the answer is garbage but sometimes it catches something real. Again, it's a case where the benefit of the LLM getting it right is noticeable and the downside if it gets it wrong is near zero.

I don't think men working on oil rigs or container ships have a ton of positive interactions with women for the weeks or months they are away from civilization, and I'm not aware of a high rate of transness in those groups.

Could be cultural though.

Imagine [primitive and modern people sincerely trying to kill each other]. Does the technology differential between these two scenarios change the fundamental nature of what they're doing?

"Fundamental" is a slippery word but I'm going to go with "no". However, if we switch from "primitive/modern people trying to kill each other" to "one primitive/modern nation-states trying to conquer another and take their stuff", I think that the modern world in which nuclear weapons and reliable second-strike capabilities exist is fundamentally different than the primitive one in which those things don't exist. In the ancient world, the conquered could salt their own fields to prevent the conquerer from benefiting from their conquest, but it is only in the modern world that "I refuse to be conquered, instead we will all die in a fire together" is an option.

Similarly, how has technology changed the fundamental nature of being rich or poor, of love or hate, of joy or sorrow, ecstasy or despair, contentment, yearning, frustration, misery, or any of the other highs or lows of the human condition?

Lows aren't as low or as frequent, highs are mostly as high as before. I don't know if the "fundamental nature" has changed but the changes are large and important and I think to a certain extent arguing about whether things are "fundamental" comes down to word games.

My wife and I went through something similar to the situation you've described, and I likewise am pretty sure that without medical technology neither she nor our firstborn would be alive. On the other hand, I am quite sure that they and I will die, and I do not know when. What has actually changed?

In the end we all die. But our children will live first. If you don't value that I'm not sure what to say.

But hasn't this always been true? "Abundance", and for that matter "poverty", seem to me to be entirely relative. [...] When I read about the King of Carthage surrendering to the Romans, and his Queen cursing him and choosing to burn alive with her children, this again is not mysterious to me, because there doesn't seem to be a disconnect between their evident thinking and my own.

There's a minimal level of abundance below which people can't survive. In the industrialized parts of the modern world, we experience abundance that is so hilariously far above that threshold that it's easy to forget that the threshold exists. But for most people who lived throughout most of human history, that threshold was extremely salient to their lives some nontrivial fraction of the time.

It is informative that your example compares the experience of the ruling family of one of the world's mightiest states at the time against some internet rando. That's not to say the comparison doesn't work -- it works just fine. But I expect you'd find your experiences less reflective of those of a typical farmer at that time than they are of that time's royalty.

It seems to me that the problems of the modern world consist entirely of it being peopled with humans, and that these humans do not seem to have changed in any way across all of recorded history.

This is true now, but if you went back to Europe during the Plague it would have been laughably wrong. We've beaten back most of the non-human problems. The human problems remain, because we're still here and we're still the same hairless apes with pretensions we've always been.

Will murder stop? Will theft even stop?

Nope. But smallpox did stop, and malaria will stop, and polio and starvation and iodine deficiency are mere shadows of the specters they were in centuries past. Our homes are cool in the summer and warm in the winter. We're having this conversation over the internet, a magical network which allows most people in the world to talk to most other people in the world whenever they want to, synchronously or asynchronously depending on their preferences. If we decided that the mere projections of each others' words through rocks we tricked into thinking was insufficient, we could each get into an airplane and meet up at some arbitrary city somewhere in the world at this time tomorrow, probably for less money than we each make in a month.

Yet the idea of a beggar is still relevant, isn't it?

In the first world, beggars largely do not starve.

You point to the lowering of infant mortality, it seems to me that when one set of sorrows decreases, they are replaced by a new set seamlessly

It sure seems to me that when non-human-generated sorrows decrease, they're just gone. Disease does not fight back. Scarcity does not fight back.

It does not seem obvious to me that people now are fundamentally happier than bronze-age peasants four thousand years ago

Would you trade places with a bronze-age peasant from four thousand years ago? Would you expect them to trade places with you?

Controversial opinion. It's pathetic to care about votes. They are just numbers on a screen.

I'm sorry, but I had to downvote this comment because I disagreed with it and did not like it. If it makes you feel better, though, my downvote is just a number on a screen.

The metric I use internally is how many responses and sub responses my comments get

You might already be aware, but "number of child comments" is in fact a metric that is tracked on the motte -- it's what it means when you view someone's comments and choose the somewhat-confusingly-named "comments" sort order.

My (not extremely reliable) memory from my childhood is that teachers were highly regarded throughout early elementary school, though that respect was greatly diminished by the end of elementary school and nonexistent by middle school.

Do you believe that Progress is possible? Do you believe that technological developments (either hard tech or social tech) have rendered our lives and our experience is fundamentally different in some deep sense from that of, say, bronze-age Chaldeans?

Yes.

I'll give an example. A few months ago, my wife and I welcomed our first born child. The birth did not go smoothly, and without medical intervention I would likely have lost my wife, my daughter, or both. Fortunately, we live in a time and place with access to modern medicine, and both my wife and my daughter are recovered and healthy. I expect them to remain healthy for the next several decades.

By my best estimate, the childhood mortality Bronze Age Chaldeans was 30-50%, largely during infancy. A significant fraction of parents would bury their own children.

That's not to say our modern world is perfect. Obesity is high. Attention spans are low. Children grow up hearing that they can be anything they want to be, anything at all, and then run head-first into reality at some point. People believe that they can have all the things they want in life, and, by trying to pursue too many different goals, frequently end up achieving none of them.

And yet.

We do not, as a rule, bury our children.

Do you believe that future developments could deliver this sort of progress, such that moral or ethical considerations fundamentally change between populations on two different levels of progression?

Yes. If you look at the list of problems about the modern world, you'll notice that they are problems stemming from abundance and choice. Sometimes, when people have lots of resources, they spend them destructively. Sometimes, when people have many choices, they choose poorly.

And so developments which led to more abundance, and to more choice, would deliver more progress. Enough progress and the differences start to look pretty fundamental. At the extreme end something like "a cure for senescence" would qualify, although I expect something much more modest like "cheap batteries with 10x the energy density of the modern state of the art" would also do the trick.

If you were hoping for a more philosophical take on Progress, I expect you'll be disappointed. But that's because I don't think progressive culture is downstream of progressive ideology so much as it's downstream of material abundance. To the extent that I have an ideological position here it's "abundance is good, choice is good, there are downsides to both but I don’t think we're anywhere near the point that having more abundance and choice is net harmful rather than net helpful".

While I sometimes entertain goofy social arrangements to solve this problem — could you livestream Dad working on excel spreadsheets at daycare to get kids organically playing at number problems?

N=1 but my dad was a programmer and some of my earliest memories are of him writing cool little simulations and letting me play with changing numbers in them to see how the results changed. And some types of programming still feel like play to me now.

So I suspect the answer is "yes" (at least as long as the spreadsheet manipulator appeared high status, but I expect that wouldn't be a problem because "the person everyone is paying attention to" is pretty strongly correlated with status).

Yeah, yeah, so it would cost some money, give me your Paypal, and I'll be happy to chip in.

Patreon link is right here. Currently it pulls in $212 / month.

Well written.

I could say that for Blues, the problem is that your math might be wrong, and that for Reds, the problem is that you think you're in control, that your accounting of the variables actually correspond to reality in some meaningful way such that you can do math with them. I could say that Reds have a fundamental belief that death is deeply natural and that Good Deaths exist, and Blues, to a first approximation, view death itself as a pure negative and see death, at best, as a lesser evil in exigent circumstances.

And saying any of those things, I would expect Blues to disagree vociferously on all counts and throw out all sorts of reasons why I was wrong and uncharitable.

I have pretty blue tendencies, and this seems like a pretty good and fair summary of my views, rather than something I would vociferously disagree with.

Definitely some wisdom in the "yeah but all those calculations are actually bullshit" reminder though. All models are wrong, some are useful, many are harmful if you forget the ways in which they are wrong.

I'm trying to fill a position at work right now. A sys admin role. I want to ask that gas mileage question during technical interviews but I'm afraid the people who will get it right will be so insulted that they can't believe I'm asking this

... switch out the variable names? E.g. "Every time the server reboots, it has to pull down a 450MB file over a 30MBPS connection before it can start serving requests. The server drops any requests that come in before it finishes booting. Assuming the system gets 3 requests per second, how many requests are dropped every time the server reboots?"

There's so much work to do that we need smart people for and so few smart people.

There are 8 billion people. Half of those people have above-median intelligence. While the number of very smart people, as a fraction, seems very small, the absolute number of such people is mind-bogglingly large.

That suggests one approach might be to try to get a large group of IQ>130 people together in one location for the purposes of advancing the state of knowledge of the universe, maybe in a small city that is specifically focused on supporting those people. Since it's a city dedicated to the study of the universe, I propose calling it a "universe city".

You can go to your custom CSS settings and add

@media (max-width:480px) {
    p {
        font-size: 16px;
    }
}

which will bump the font size from 14px to 16px on mobile devices (technically "narrow screens" not "mobile devices" but that's just how it is in web dev) only (cc @George_E_Hale).

As long as Ginger does not benefit specifically by doing things which are intended to cause people to falsely believe that Scarlett did the thing rather than her, I think Ginger is fine.

And does this describe anyone anywhere at all?

Yeah, it describes you. You just said it did, and you obviously wouldn't lie on the internet as flamebait.

I mean is it crazy that you can't build a car, slap a Rolls Royce logo on it, and sell the car? It's not a "being a notable person" issue, it's a "having a personal brand" issue.

you obviously can't stop some man eerily similar to you from acting in a hardcore pornography

You can't, but my understanding is that if you are a notable person, and if the producer of the pornography chose to use someone with your likeness because of the value that your personal brand adds, and if you have not given your permission, and if they are in one of the 35 states with prior case law about such things, you might have a pretty strong case. Though IANAL so TINLA.

No one thing Sam Altman has done sticks out as evil

The non-disparagement agreements tied to an NDA on the topic of said non-disparagement agreement, tied to retaining your equity weird not-quite-equity compensation, with no mention of said clause at hiring time, seems surprisingly pretty clear-cut

Countries have tried economic incentives and mostly failed or slowed the decline

Have they tried economic incentives that are at least a 2 digit percentage of the opportunity cost of having additional children?

Stressed working women raise less healthy, less intelligent children who are more likely to have behavioral problems

I presume by this you mean "mothers being stressed causes their children to be less healthy and less intelligent" rather than "those women who are likely to have less intelligent, less healthy children are also more likely to be stressed". Do you have a source and an estimate of the effect size? Based on the sorts of things I've seen (example), the effects exist but are usually quite small. For example, the highest effect size I found in that study was r=0.16 for maternal exposure to a natural disaster, which explains about 2.5% of the variance in outcomes -- and most of that effect size came from a single n=20 study about an ice storm, so I expect the effect size in practice is even smaller than that.

Intelligent working women give up on producing more offspring who are also intelligent

I expect this is almost the entire effect in practice.

It would be far more economically valuable in toto and longterm if women focused on their biological role of mothers, wives, and homemakers.

From a purely economic viewpoint I doubt that. I think the opportunity cost of being a homemaker is genuinely higher now than it used to be. Also the benefits are both distributed across society, and the benefits of choosing the homemaker route are not as legible as they could be to the women making that decision.

Yes. If you use OA's you don't have to build your own scaffolding though.

You'd want to get completions from an LLM that's been fine tuned on conversational transcripts with timestamps and explicit markings for when the speaker changes. It should be possible to generate the dataset to fine tune on from podcast transcripts in a mostly automated fashion. Something along the lines of this. Getting the quality high enough and the latency low enough is likely to be a challenge.