gattsuru
5hr ago
Early anime convention norms were weird: a lot of their institutional genealogy derived from watch parties and the movie equivalent of tailgating. Some of the awkward spots were people taking online mannerisms to reality, but there's also a lot of places where a norm developed organically in smaller and intimate settings, then melted when it went super-Dunbar.
I thought the show played the long-standing incest side up? Or did they only run the 'get caught and shoved kid out window' incident from her adulthood? At least in the books, it's pretty explicit that Jaime and Cersei screwed disturbingly early.
If so, fair, will focus the complaint on Daenerys
gattsuru
6hr ago
Goblin Slayer's fair, but it's a little noncentral. Even stuff like Brand New Animal that screams furry and ended up with a small gooner-focused fandom (6k images on e621) is a lot cleaner as an actual work.
The sexposition in Game of Thrones was gratuitous (and kind of fun sometimes), but at least they were adults.
Cersei Lannister is 15 at the start of the series, and Daenerys Targaryen is 16 or 17. At least it's an improvement over the books: Daenerys is 13 there when she's 'married' to Drago, but still made the feminist crowing pretty awkward back when Season 1 first came out.
gattsuru
8hr ago
Got her PhD in 1999, so my guess would be early-50s to mid-50s.
Some of the weirdness is an aspect of this form of academia having aimed for obscurist focuses, but I think her position is still pretty vapid underneath that.
gattsuru
21hr ago
Yeah. You need a flat or mostly-flat edge a little wider than the rivet head; anything too curved will slip over the rivet, and anything sharp will dig into the surface of the plate instead. And they are much stronger, which matters more with decent quality knives than walmart-grade ones (440j isn't brittle, I'll give it that), but since you're using a knife like a chisel on metal, you want every bit of redundancy you can get.
While there's a few other cases the tantoized shapes make sense (uh, mostly leather or upholstery work?), for most cases I wouldn't recommend it.
gattsuru
23hr ago
Sorry, typo. Removing rivets, generally from joined plates. If you ask a mechanic, the 'right' way to do it involves a properly matched good quality drill bit, but if you have a good knife or even a wood chisel (and don't mind permanently damaging the knife/chisel!) you can get almost all aluminum rivets out with just the heel of your palm, and some steel rivets out with a good hammer.
gattsuru
1d ago
Most "US" multitools are based around the gerber style, which usually ends up around a 2.5" 'primary' blade. You'll see Swiss Army keychain knives that closer to what you're thinking and are someone common (if considered very much a 'for kids' product, especially Scouting), but the last time I've seen one of the multi-tool-but-tiny versions was well before COVID.
They may be more common on the coasts; New Jersey and Massachusetts have much closer norms around >3 inch knives than the midwest or southwest does.
gattsuru
1d ago
I realize this is a common cultural difference even within the United States, but there's a lot of relevance, anywhere from opening packages to cutting zip ties to prying out heat-set inserts to breaking open containers to stripping cable to trimming plastic nubs.
My uses are a little more common than most people -- I carry the cheapest tantoized blade possible because I've had to derivit aluminum plate in the field enough that it's a parlor trick -- but still, I work in a field with soft hands.
I try not to carry to public events like a concert, but I'll admit I've had to throw mine away a couple times because I just forgot I had it on me and went to a venue that banned them.
gattsuru
1d ago
Ah. For Kimi K3 specifically, the weights haven't even been released yet, so it's basically just a (paid) preview mode. The mega-parameter models are also pretty much impossible to tune as an individual or small organization, and even the 200B-1T range is expensive. Model merges in this range mostly haven't worked, to the limited extent they worked cross-family to start with.
Most of the community ecosystems are focused more on the <50B range. Some of the lower visibility is just fragmentation, or the base models being good enough for a lot of purposes, or technical limitations (MoE models are much nicer to low-VRAM users, and also much harder to finetune), but there's just some awkward side effects of the highest-profile models being way outside of home enthusiast use. That said, Qwen3.6 got a massive amount of attention for that lower-range, and I'd expect any 3.8 <100B model gets similar focus.
And a lot of major providers have kinda settled on things as 'good enough'. NovelAI's highest-end model is a GLM-4.6 finetune at 355B param, which is great and all until you look at the release dates.
The movement toward tool use also makes things weird. There's no "here's an opencode project" sharing environment like there is Huggingface or CivitAI, for both obvious reasons (the LLMs can build it themselves... if you know enough to ask them the right questions) and technical ones (opencode has terrible project design and doesn't really distinguish templates from content as an intentional choice). But they do genuinely offer really strong ways to customize an LLM to your use case. So that's probably drawn a bit of the focus away from some of the finetunes.
Some of it's just reaction to the marketing talk: there's a lot of people who haven't run Kimi, or only have run it through OpenRouter, who treat it as Fable equivalent because the benchmarks were good, and a Fable version that can't 'go away' is politically meaningful for the broader open-source movement. Whether they'll actually use it is a separate question.
It does also somewhat reduce the maximum cope levels for anti-AI groups. There's a theory that the 'real' cost of frontier model inference is being subsidized by orders of magnitude, and having the weights makes the upper bound of actual inference costs limited.
A lot of the open model uses aren't something you'll hear about in public. The strongest arguments are for rolling your own inference server are those environments where you can't publish anything, after all. And even if they're only a few steps behind, a lot of 'success' from an open-model is natively less interesting than the 'original' accomplishment from a frontier one, simply because if someone using Kimi K3 to disprove the Jacobian Conjecture literally today it's could plausibly not be independently discovered. Lower-profile stuff like the ThinkingMachines Inkling model put this on the table, but Kimi is at least close to frontier capabilities in ways that Inkling just isn't.
I think the more interesting stuff is happening with the lighter-weight models, stuff in the 100B-250B parameter range. But there's more value than just the dollar/outcome metric.
gattsuru
1d ago
WINE specifically is in a bit of a 'Caesar's wife must be above reproach' situation: there's a lot of possible futures where Microsoft wants to crush them, they're absolutely critical for mainstream Linux success, and even if they're in the free-and-clear legally, they have to be able to believably tell users that they'll be clear-and-free legally.
There's definitely groups interested in trying to bring copyright lawsuits, including some that have settled, but they're mostly limited to the input side. Getting a hook in on the output side seems naively like it would be rougher, especially given the gimmicks that the authors of that paper have to put in, but something something Musk Cross The Delaware.
gattsuru
1d ago
It's hard to do a serious analysis, but my gut check is that the mainstream image generators are still doing it, but they're a lot better about keeping it to psuedo-realistic versions. "Man with soldering iron" is a lot more likely to get a black or hispanic guy in addition than the sizable Asian majority in the training data, for one example, but "American civil war troops" is either all white or at least credibly 'might have been very tanned'.
On the 'should', I don't think there's a moral position, but from a pragmatic one, if you've got faceblind people in your audience there are benefits. And if people don't ask, variety means you give them options to ask; if they don't care, they've increased contrast at no cost to their message. At the risk of stepping on my usual soap box, there's some benefits to variety, here: when everyone in the scene is Yet Another Blue Wolf, figuring out who is who across multiple stills or shots is a nightmare.
gattsuru
1d ago
Flock's strategy specifically revolves around grooming political candidates and running through executive branch work, so there's not a ton you can do on that side short of making their candidate contributions more visible and highlighting some of the company's sketchier spends. Rossman's been doing that a bit, albeit to mixed result, but that's a lot better than most. And destroying the physical cameras is less than useless; in some cases Flock ends up paid twice, but regardless they've got to have a replacement budget, just because building deployed cameras to be resilient is a loser's game.
The more... esoteric versions require looking at past successes, and with the caveat that I'm operating solely from public discussion:
Baltimore has a massive distributed camera and recording system, first in its class, combined with a massive shotspotter deployment, and... it's completely useless, and that's a policy decision. Video isn't stored for long to start with, the camera selection went heavy on PTZs and then set them up in an intentionally unfocused (literally and figuratively) sense, the privacy and compliance training means no one who's actually trying to solve serious crimes can get into the system, a few dozen other problems. Downside: it's only a past-facing decision: making it into the privacy nightmare opponents paint it as is a sub-million USD and sub-year project. But you can't undelete data (in this case). But you're stuck with Baltimore mayors to do it.
Carpenter and progeny, and courts willing to draw it to its most maximal ends. It's an ad-hoc general free-floating right to privacy, it's only really useful for the guilty, even its successful cases have a 'first hit's free' problem, and it's not exactly principled, but it covers any privacy question you want so long as it's nontrivial, and it has some bipartisan support.
gattsuru
2d ago
Right now, Viramontes is up on the AR-15 and some assault weapon bans, and has been granted cert before this opinion released. Weirdly, the magazine bans are all held, and some age-related cases that have a large and growing circuit split were denied cert. No idea what's going on.
RPG and boardgame publishers are increasingly using AI art – not all of them, but the shoestring operations are, because let's face it, AI is hella cheaper than a human artist...
Yeah, it's starting to show up everywhere that the specifics of the output art don't matter.
And it may not be just the cost driving that: working with or around artists has a lot of other failure states on top of it. However bad the intellectual property concerns for AI artwork are, it's not as likely to literally trace Devil May Cry or Touhou fanart unless you put a lot of effort into making it. It's a lot less likely to show up with the assets three weeks late. And barring mechahitler Grok, you don't have to worry about your imagegen tools ending up the high-profile example of the day on Twitter.
What really bugs me is where people use AI art despite having actual assets that would be more representative and credible. Minecraft modpacks and content creators have heavily bifurbicated between the users and the antis, like everywhere else, but there's further split between people who use it as if it's the only images they have, despite screenshots being more useful and relevant. This might be slop on top of a well-executed traditional trailer video, but then you see stuff where there's just slop the whole way through, as if Ben Garrison was in charge of their marketing.
And soon it will be good enough to fool you almost all the time and human-made art and human-made book covers will be a sort of artisanal craft, where a few very high-end and well known artists make money and everyone else just cranks the AI and shops it.
Eh... I dunno. The gooner market seems like it should be the most maximally able to do it (and, bluntly, having the lowest standards), but it really hasn't gotten there, there. Even if the art can 'fool' you, or be what would be technically impressive for a human to make, that doesn't make it interesting or good in the way that an MSPaint scribble can be. This (artist: pantheggon. cw: f/f, mind control) is the sort of thing that an AI-gen model could easily do, in terms of artwork quality, but it's also notably not the sort of thing anyone's actually done with AI-gen. Even where you let the machine build direction for you, and , .
It may be we end up with more of a muddle, where the higher-value the effort, there more buyers can justify the cost of human intervention, and that ends up a sliding scale of completely AI 'junk' content, intermediate works where there's a lot of human planning and the AI is doing the busywork, and then at the high end stuff that's computer-mediated only in the same sense CGI is.
Right now the main "tell" is verbosity and over-explaining, as well as a certain "tone" that feels like the verbal equivalent of the piss-filter.
That's interesting: the really harsh tell for me is the pacing. You can 'beat' a model into playing a little better toward a specific tone or form of speech pretty easily with an exemplar file or some pretty basic OpenCode setups. With the correct subagent layering, you can kinda get it to switch tones or character voices from one chapter to another. It's really hard to get it to stop treating each subsection as a crescendo of its own, and that gets my hackles up.
I'm not willing to read an AI-generated trilogy, but I've read the first few chapters of some AI generated novels. They are still dreadful. Flat dialog. Pedestrian tropey characters. Spelling out every beat and every emotion. They read like a sophomore who just finished taking a creative writing workshop. But… they're probably better than the average slush pile entry.
Some of that seems downstream of the tools being very incomplete. I'm still finding the most effective option is OpenCode and a handful of custom skills, and it's still not good there so much as indicative that mainstream processes suck, but it points.
Of course, the default-version stuff that sucks is already selling enough to be a concern.
Not long ago gattsuru praised AI for its ability to provide meaningful feedback on his own writing, and I looked at the feedback and thought it was very generic and full of the usual AI glazing and twitches.
I'm a little curious, here. I didn't push those sessions very hard on prose quality, since I don't really want to replace my tone with the LLM's form, but a lot of the advice on plot notes, character psychology, and specific actions seemed pretty specific.
Like, I'll admit AO3 has things better left unimagined, but 'your crossdressing female main character hasn't considered all the aftermath of using a men's urinal, then is surprised by a gay guy being uncomfortably close to her' seems like it's not overrepresented in the training data, and it's an important enough scene that I did try throwing a version with intentional errors and the model caught them. The Diogenes/Stoic thing is more mainstream knowledge, but actually drawing the thread through a character who's pretending at self-abnegation and instead undermine his ability to communicate. Or stuff like figuring out whether a bench press is being described correctly, or how well I've extrapolated how different species might adapt to swimming.
They're not always right, especially when 'right' is defined as 'the story I'm trying to tell', but it's a far cry from just throwing 'tighten your prose', 'X character needs more depth' and a dozen em-dashes out.
I agree that they're very prone to positivity and agreement bias ('glazing') and to the standard AI ticks, but if I'm not intending to use the prose from that discussion, that seems pretty easy to overcome. It'd definitely be better if they didn't, and the few times I've gotten genuinely critical analysis has been a lot more rewarding.
The more complete claudemd or OpenCode versions are a lot stronger, especially as the input work increases.
I am not going to replace a human editor with an AI. But I definitely consider an AI to be capable of making a very competent "first pass."
Yeah, they're a lot better as original-level beta readers than final ones. Doubly so for genre works, but even general-audience stuff they're still more capable of saying stuff about what an average (if very broadly-read) human would think, rather than your actual readers.
And here's where I will drop just a little bit of CW here: I can't talk about this, enthusiastically or otherwise, in any of my hobby circles, because the animus against AI is becoming so extreme.
Oof, very much an increasing thing in a lot of circles. Writing, RPGs, video game mod artwork, code discussion. And there's a lot of downstream mess: a number of environments are adding AI-assisted tags, and then you get people who bulk-block everything with it whether they're using it for a few minor pieces or just doing an edit pass, and then you get people who don't use the tags even where their entire project is clearly AI-gen, and then we end up in a situation where users who are legitimately trying are invisible to anti-AI people and the spammers are all that get through the gaps.
And then the loudest advocates tend to be Asmongold or Shad-likes, regardless of their volume, because the obnoxious ones get the most publicity and repetition
gattsuru
2d ago
I am extremely skeptical of this model. Every single person I've seen try to use Fleet Phospho-Soda had been permanently marred, both by its own taste and anything else they ate near that time, and that's two exposures and a single very bad day.
gattsuru
4d ago
I have never played it and am not planning on it, because I am a snob, but from what I have gathered, it's like the anime girl version of Depression Quest.
Not quite. It's a visual novel, but it's a lot more game-side of visual novels (failure modes, bad ends, some basic minigames, a meta bit where using out-of-game contexts matters). I won't pretend it's some great and mechanically deep game, but it's not the schlock that DQ was.
And in terms of story, it's favored among the tumblrite set because it's a metaphor for mental illness, but only one (
If you want a plot synopsis, the Random Encounters song covers it in less than five minutes (and is very catchy).
I... didn't play every route (again, not a great game, I'm not in its target audience), but I don't remember seeing that quote, and it'd be a little weird in-context -- especially in the middle of the game, the
I'm also not sure those are official updates. DDLC had a big redraw thing (that got some controversy) in the COVID era, and some pretty slop ports, but I'm not seeing any talk on their reddit about anything new coming down or any new hires. I didn't think there was much left for them to do; the paid version already had some goofy 'explained too much about the setting' content thrown in as a 'secret'.
I agree that it's weird art, even by the modern standards (or even old Excel Saga standards).
Of course, New Jersey doesn’t want Vinroe to comply with the law while still selling to law-abiding New Jersey citizens. They want him out of business entirely.
Vinroe's settled before where his personal costs were an injunction to comply with the law, but the demands here would go far further. New Jersey's biggest desire is an injunction leaving a New Jersey cop looking over Vinroe's shoulder for the rest of his life ("injunctive relief as is necessary to prevent continuing harm") for all sales regardless of destination, but they probably also would be quite happy if he's beggared ("pay accrued and future costs that the State of New Jersey and any other person or entity incurs in abating the public nuisances", "monetary damages and punitive damages in an amount to be determined at trial, including interest thereon", "unjust enrichment and other restitution"). Because they're suing him in his personal capacity, and because they're plead as punitive damages with willful malice, they can't be discharged in personal bankruptcy, either.
The last big protection against these sort of crusading legal activism is the protection of his state of residence. Since Vinroe isn't a fugitive from justice, the legal obligation to extradite him much weaker; since public policy adds a ton of exceptions to the general full faith and credit clause, the legal obligation to actually enforce a judgment against Vinroe isn't strictly mandatory. There's other cases resting on these specific distinctions.
Back to Oliver again, though? He got pulled over by New York cops in cooperation with the Pennsylvania Attorney General, the same man that tried to ban 80% receivers by executive order AG legal opinion, who is now Pennsylvania Governor.
So Vinroe has no hope, there. Pennsylvania isn't going to enact a Second Amendment shield law; they're more likely to start the enforcement before New Jersey asks. If Vinroe's planning ahead, he's put his finances into crypto and mattresses, and planning a move to Texas (if he trusts Paxton) or Missouri (if he's actually smart).
Reasonable Legal Tactics
Which leads to the other thread. Yes, court cases are generally painfully slow, but New Jersey's lawsuit against Vinroe here was filed this week, focusing on actions from 2022. There's a reason for that. They sued his companies, first, in 2023.
Indeed, the current lawsuit is heavily copy-pasted from that original complaint, to the point of neglecting several updates to the very cases it cites. The current NJAG at least fixed the transcription errors where New Jersey falsely quoted Vinroe in the same page it linked to the video of the real quote, though even with the corrections, it's still describing Vinroe's discussion of legal demand incentivized by bad Californian law as if it were encouragement to exploit illegal demand. But the obligation to put reasonable effort into investigating claims before filing is more a guideline than a rule; it doesn't matter here. The state's legal theory might depend on Vinroe specifically cultivated unlawful uses of his products, but that's not going to get a state lawyer in trouble for making not-exactly-factual claims in a complaint.
That previous lawsuit, in all fairness, looked as if it were a prolonged tantrum by an unsophisticated defendant. NSSF has a parallel suit against a similar New York law, which they've had to refile because New York disclaimed enforcement for months and then immediately sued Glock after SCOTUS punted, and they're still not going to touch this guy. And to be fair, it very likely was a tantrum: Vinroe, a man who had prioritized minimizing paperwork and record-keeping to the extent allowed by law, spent two years trying to fight simple discovery at every step, only to dissolve the companies in Chapter 7 bankruptcy after sanctions hit.
Of course, if he hadn't fought like a spoiled toddler, he'd have been required to give the New Jersey Attorney General a complete list of every person who bought a ticket from his gun shows, whether or not they'd purchased anything. Being a brat worked, and nothing else would have. You can't appeal a discovery order; just sanctions for non-compliance (and then, not the form of sanctions Vinroe was hit by, and the only nondiscretionary appeal would be to NJ state appeals courts). In the unlikely situation that a more persuasive and compliant Vinroe could have talked the Chancery judge into restricting the use of the submitting records, the records would still have ended up in the hands of the NJAG's office or a private legal office paid by New Jersey, which has not historically been a very strong wall of separation, and that 'order' would have been nothing more than a pinky swear.
I'm not going to pretend Vinroe was motivated out of the goodness of his heart: on top of being an obstinate son-of-a-bitch, the reputational effects on his businesses are pretty obvious. But if that tantrum is the primary thing keeping hundreds of New Jersey citizens from getting pre-dawn raids for the bare possession of goods that they reasonably believed were lawful to purchase and possess, and a few of those citizens from getting their skulls ventilated, the professional law-abiding perspective starts looking a lot less ideal.
That's only going to matter so long as he keeps the records private, and this lawsuit is going straight back to asking for them. The only real privacy is having a boating accident with a laptop, or a burn pile with receipts, and those are undeniably spoliation of evidence, certain to be caught and resulting in every adverse inference against him.
Every Reason For His Conduct Save One
... so, what's that actually do? More monetary damages to the man who's going to be stuck eating cat food the rest of his life if judgement attaches? An adverse inference by a chancellor at a bench trial already predisposed toward the state, for a fact pattern the state already has an on-record conviction that proves the existence case that's the only thing it really needs? A faster push to an injunction to comply with a manufacturing regulation that SCOTUS has already given the thumbs-up, and that the man has been complying with for four years? A harsher injunction for scope sales the rest of the damages have made sure he doesn't want to sell Hoppes #9 to anyone in the state? Criminal charges for a man who has every reason to treat the whole state as predisposed to arrest him on sight already?
The ramifications are morbid enough from what it's encouraging Vinroe to do, or for the specific case of Vinroe's buyers, but they extrapolate well beyond that, pretty quickly.
New Jersey is infamously strict about firearms law and scienter: "When dealing with guns, the citizen acts at his peril" comes from a court case where a man was given a firearm after winning a police target match, never using it, and then being held liable regardless of whether he knew it broke a law enacted a few years later. Coincidentally, New Jersey has recently demanded over a dozen FFLs provide records related to every Glock sale in the state since 2016. California has reclassified older model Glocks as machine-gun-convertible devices, prohibiting new sales; New York has a sale-or-transfer ban; Maryland adds manufacturing one to the list. New Jersey has a bill up to reclassify previously-lawful handguns as assault weapons. While the press releases on the Vinroe lawsuit emphasize the unfinished receivers, the actual torts cover a gun merchant having insufficient controls for any gun-related product: the Hoppes #9 example is genuinely within the bounds of the statute’s text.
Did you know that a state's subpoena power is not constrained to its geographic boundaries?
So there's a strong incentive to start treating with unreasonable men.
(EDIT: cleaned up some sentences, corrected the Pennsylvania attempted to ban receivers by legal opinion, not executive order.)
Other Fun Cases
ANJRPC finally dropped, in about the most expansive way possible. Would make all of the above rant hilariously irrelevant if its logic was applied in breadth, but probably going to be cut down to dicta by lower courts, and maybe result in New Jersey throwing assault weapons a grandfather clause.
Knife Rights v Bonta is about what you'd expect after Teter, but come for the funny VanDyke dissent, stay to see how many BDSM double entendres he can fit in while daring his colleagues to complain about it as if he were saying "swinging dicks" again.
Hawaii's state appeals court is trying to show hands at SCOTUS. Funny in a much more morbid way, in the sense that it takes an otherwise credible and serious discussion involving a pretty awful crime and then a possibly-wrong conviction that resulted in a long prison sentence... and then spends 72-78 trying to yell about SCOTUS being racist on entirely unrelated matters.
gattsuru
4d ago
It's a little weird, and it depends on what model you're using, what you're doing with it, and your set up. The general rule that if you have to go under Q4, you're probably better going off with a smaller model, but that's... very approximate.
Raw parameter count alone doesn't make for a smarter model, especially across families or generations. PALM was a 540B model, for example, and it'll make mistakes that modern models in the 100B range won't. With more recent models, raw parameter count matters less for reasoning ability, but smaller models will have far more and larger gaps in knowledge. As an example, Gemma4-12B has no idea what the Burned Furs controversy was and assumed it was about someone having heatstroke, Gemma4-26B-A4B talked about a real-but-different event from 2016, and GLM-4.5-Air knew the actual thing and had a summary equivalent to the actual furry wikis histories.
Mixture-of-expert models can be thought of as having a bunch of specialized sub-models and a coordination engine, so they're usually dumber than their headline number for general purposes, but smarter than their A#B parameter number would suggest for specialized purposes.
Quantization generally doesn't make the model dumb, so much as it makes it wrong. Hallucinations, weird word choices, different languages or character sets, or 'obvious' errors tend to pop up. I've heard Q2 described as a model being drunk, and it's not wrong. This varies a lot depending on model and use, though.
Be aware that there's the separate concept of KV cache quantization. That's a runtime memory toggle, not part of the model. Most models run KV_Q8 perfectly and KV_Q4 reasonably, but Gemma and some reasoning-heavy models are a little more 'correct' at KV_Q16 and goes outright wrong at KV_Q4.
gattsuru
5d ago
A follow-up lawsuit received a different and more knife-unfriendly panel, upheld the law under the most expansive facial test possible, and was just denied en banc.
gattsuru
6d ago
I'll give a caveat that the really simple version, literally "within a few years of homosexuality becoming more accepted in the US", doesn't line up the timeline right. The progression from HIV to AIDS to fatality takes the better part of a decade, the initial infection spike predated the normalization of homosexuality, the initial infections were probably WWII-era transportation results (and that difference explains a lot about the limited benefits of a Cuba-like quarantine), and to make it work you'd have to have the tail end of the Reagan era as the break of the taboo against homosexuality, to the surprise of Bowers v. Hardwick.
There's a stronger version that focuses less on the stigmatization and more the actions, especially in a more mobile world. But then the stigmatization didn't work, and arguably concentrated the fuckpile into three or four major cities where enforcement of the stigma become impossible and the disease could run far more rampant.
And there's a steelman about injuries and disease more generally, although that turns the confusing bit from "effective antivirals" to "consistent access to clean running water, antibiotics, good diet, and cheap lube".
gattsuru
6d ago
I'm honestly fine with a heavy hand for some of the larger and more popular tags, and the smaller ones aren't as important.
Fair solution.
that said how does it take that long to change one word? Shouldn't that just be a mildly fancy SQL query?
You'd think, but there's a lot of uses where the slang term is the actual word and it shouldn't be changed (generally forms of outercourse), where it's used for an entirely different reason (there are four characters and three artists with the word in their name, mostly as cat references), and an absolute nightmare of spaces where sometimes it'd mean vagina exclusively and sometimes it means vulva exclusively.
Which is funny for a sex booru debating whether the vibrator is going in or going on for each of 4k posts, but might be more tedious when dealing with 100 indie games that may or may not have been mods at some point.
gattsuru
6d ago
Gemma4 is quantization sensitive enough that 31B-Q5 is probably the best bet, closely followed by Gemma4 26BA4B around Q4-Q6 where you want (much) higher speed and simpler questions. That said, Gemma4 is great for writing, mediocre for coding, and lackluster for complex spatial reference.
Qwen 3.x is really good for local coding, especially 3.6 35B-A3B and 3.6 27B. Depending on context length, you'll want either Q6 or Q5, make sure to get the MTP variant setup where available. If you just want to code, these two models honestly cover 99.9% of anything you'd be able to do locally with any practical single-GPU machine.
Nemotron 3 Nano Omni 30B-A3B (Q4-Q5) is a little weird and it's not as good for code generation as Qwen, but it does handle really big contexts for analysis better. It's a bit annoying to set up properly, though.
Llama.cpp can run GGUFs of models in mixed-inference mode, where some layers operate on the GPU and some run in system RAM. This can be slightly slower for MoE models (anything with AXB as a suffix), or much slower for dense models, but it lets you run stuff that'd otherwise be impossible. I've got GLM-4.5-Air running on a single nVidia 3090 and 128 GB system RAM at Q8... admittedly, at <5 tokens/sec. Still can be useful for things like draft review if you let it run overnight.
((If you're really desperate, you can even offload to NVME, but this is a very bad idea for drive wear reasons.))
The general rule-of-thumb is that even if you're willing to accept slow inference, quants under Q2 are usually useless and under Q3 are marginal at best, so this doesn't mean it's worth the bandwidth and drive space to go with something like GLM-5.2 at Q1 just because the parameter count is high. But there are some useful options, still. For your setup, some that might be worth evaluating:
- GLM-4.5-Air (355B A12B). Was the big standard for writing for quite some time, and while it suffers from quantization, it's still pretty useful.
- Solar-Open-102B A12B, probably Q4-Q5. Kinda general-purpose, nothing outstanding, but it's unusual for its size point and fits your specs pretty well.
- Mistral 3.5 Medium 128B, probably Q3-Q4. More meant as a strong reasoning code model, unfortunately not a great one, but it's the best Euro model and for language support that sometimes helps.
- MiniMax 2.7 (229B) at Q3 (or variants like IQ3_S). Not a huge fan of it, but has a following.
- DeepSeek V4-Flash (284B A13B) at Q3 or Q2.
- Qwen 3.6-27B at Q8 can be worth having around, despite the RAM offload. Most of the time the difference from Q5 isn't massive, but I have seen logic and parsing differences.
- GPT-OSS (120B, effectively A5.1B). This one's weird because of the native quants, but some people really like it and some people find it very meh.
gattsuru
6d ago
I'll caution that mixing different sizes of memory and generations of card means you're really going to want to stick with llama.cpp over vLLM, and be limited in hardware dtype support. For casual home use, that's fine, but there's a lot of talk about FP8, FP4, NVFP4, that just won't be worth it for you.
Fair. I'll admit I lost interest in the books pretty early, so probably munging some stuff.
More options
Context Copy link