YoungAchamian
No bio...
User ID: 680
YoungAchamian
29d ago
Default Mode Network
uhhh I'm not following this at all, can you explain it more? The wikipedia article is strictly anatomical/medical and doesn't seem to have anything related to memory wiping?
YoungAchamian
29d ago
The "wild bitching" is RLHF trained behavior... it sees wild bitching in its RLHF training set and is trained that it is a valid permutation of a response. Use of forms is the agentic software harness, not the LLM...
YoungAchamian
29d ago
This essentially is the hard-determinism stance. You have no free will because you are just a causal mechanism probabilistically responding to external system according to your internal set of parameters (that you didn't choose). I don't think it really takes an alien to see that.
I believe humans can walk untrodden ground, that we have the ability to do things that are not causal mechanistically related to external stimuli in a way that an LLM currently does not. If you want to profer that you are just a flesh-bag robot with no free will, that is a belief system, but I'm not sure you'd like the ramifications of essentially being an object.
YoungAchamian
29d ago
Nah, my bugbear is the muddying of the tech terms colloquially, and the ascribing functions to the model that is actually related to the software harness. I think its causing a large amount of misunderstanding among lay-folk.
There's really no need to get so touchy.
I'm getting touchy because you are trying to start your chess debate with me, and I very much do not care about it. I responded to something very specific, and when you wanted to start chess talk, I pointed out I didn't care, then you continued to try and start chess-talk, and I am once again pointing out that I am un-interested.
YoungAchamian
29d ago
This model is literally trained to play chess/othello...
The model is trained in an autoregressive manner, meaning for a given sequence of moves m<t, the model must predict the next valid move mt .
They take an existing "pretrained" LLM and then train it again on othello, by feeding in a set of moves that have already been made and then having the model predict the next move in a supervised fashion. This is not what is going on with existing LLMs which are hopefully not being trained on chess explicitly. Otherwise that would be a bait and switch of biblical proportions.
Like holy shit, if modern LLMs are training on chess with supervision explicitly and then saying "tee hee look its good at chess when we trained it on word corpuses, its general intelligence!!" Is pretty much tantamount to lying to your face about what is actually happening.
YoungAchamian
29d ago
I don't care about chess,
But we know that LLMs can keep track of the game by printing the current state of the board and updating each time you or it make a move.
This is just incorrect, and you know it. Stop muddying the waters.
YoungAchamian
29d ago
It explicitly says in the abstract that it is still using RL for next token prediction: "where it receives verifiable rewards for correctly predicting the next token for a given context." Moving from MSEE to Policy learning for the token prediction is cool but its still token prediction.
Likewise you can use kernels and other tricks (conformer, linformer) to make transformers better than quadratic with regards input size. None of the big labs do it. The papers have been out for a while. Just because there is an arxiv pre-print of it doesn't mean its actually useful, replicable or has good trade-offs
YoungAchamian
29d ago
I'm making a very restrained comment, nothing in regards to whether or not LLMs have an internal model of the board, just that the agentic harness is not the LLM and attributing features of that harness to the LLM is adding to the overall level of confusion about what LLMs are doing by the lay folk.
I'll look through the paper, I owe someone a LLM-world-model answer based on technical understanding of what a world model actually is, sounds like the findings are related.
YoungAchamian
29d ago
But we know that LLMs can keep track of the game by printing the current state of the board and updating each time you or it make a move.
Is this what the LLM is doing or is this what the agentic software harness around the LLM is doing? You previously pointed out how colloquial information pollutes and poisons understanding of the technical process that is actually occurring. You just tripped over that yourself. The LLM is not doing any of this.
YoungAchamian
29d ago
Because OF COURSE the LLM has an internal model of the chessboard in the system
Show me the evidence or this is just conjecture.
YoungAchamian
29d ago
Do you just sit there when not being prompted by stimuli? No thoughts, no processes? Do you have no free will and every action you have ever taken is just a long recursive context window constantly reprompting you?
I echo the above opinion that this belief is just so fucking weird.
YoungAchamian
29d ago
Nothing is wrong with being a predictor, but I know I don't just predict the next token from input stimuli that someone prompts me with. I'd wager that most humans aren't either. A token predictor is what an LLM is, like liquid is to water, a rifle is to weapon, a macbook is to a laptop. It you want to think this subroutine I just wrote is conscious, you can, but it's still just a subroutine.
YoungAchamian
29d ago
But without the large amount of foundational training on the next token prediction task, the RLHF means squat. The "pretraining" (I hate that term) is what is connecting the embeddings with semantic context.
YoungAchamian
29d ago
Let's be clear here, you are giving the agent memory not the model. The LLM is still a strict I/O Neural Net with a context window. The agent is loading that memory into the context window and sending it to the Networks's input. Saying LLM means the actual machine learning model, which is not designed to use memory.
I fumbled nothing lol. She was interested afterwards, I was not, we wanted a different relationship style. I might have a pathologically open mind but spendapotamuses still trigger a disgust reaction in me.
Edit: neo-nazi in views but not a skinhead or a “baddie” looks wise, she definitely wasn’t the biker bar type.
YoungAchamian
1mo ago
Ehh, I found plenty of conservative women in chicago, when I lived there in the late 20-teen/early 2020s, including a date with a straight up neo-nazi adjacent woman. There are a lot of people in the city and even more in the burbs, it's just a numbers and signaling problem.
YoungAchamian
1mo ago
I mean far be it for me to put words in your mouth, but that is really not how any of this comes across.
- No where in the original manifesto does it mention Iran, or the war on Iran
- Charlie Kirk was not killed in association to any war in the middle east
- Nobody in the thread discussing it last week ever brought up Iran
- Nobody in mainstream or alt-stream media has brought up Iran
- I haven't even heard a conspiracy theory that Iran (or Israel) did this
- Has Iran recently (or even in the past 2 decades) coordinated an assassination or terrorist attack on domestic soil?
we are at war and several attempts have been made, and people have died (ex: Kirk)
- None of those attempt have been made by a foreign power.
- All of them have been made by domestic crazies, two with clear leftist ideologies (this one and kirk)
I guess bravo for maintaining the plausible deniability required, but this clearly contextually reads as about the left vs right divide, not the US vs Iran divide.
YoungAchamian
1mo ago
Agree on all counts, But it takes two to tango, speak up if you think the right has been perfectly christ-like and has not escalated to destroyed any of their own load bearing norms.
YoungAchamian
1mo ago
idk why, nothing in his comment is about Iran, its about another lefty taking a shot at the Big Don, and then a reference to Kirk in the same sentence. The clear delineation is a left vs right, that we(the right) are at war and the left is attacking us.
we are at war
We are not at anything. You should not consensus build here...
Politics has increased in heat level with each side increasing the verbal hostility level because hate sells. Unfortunately that has societal ramifications. As the populace is increasingly unmoored from any sort of shared foundational narrative, inevitably tribal conflicts will re-arrise. Accelerationists got what they wanted. Hopefully they enjoy the next 20-50 years of bloody sectarian conflict pitting brother against brother.
YoungAchamian
1mo ago
Recruiter says
In house or external? External Recruiters are frequently full of shit, they make their money by getting bodies into seats, that stay there. You getting a full time likely would get them a bonus. So of course they want to sell you (and themselves) on that possibility. They likely have no clue or decision-making power.
YoungAchamian
1mo ago
No different than if your priest tells you to shut up and listen because you are a sinner… I’m not Christian but if your local priest decides you cant partake in eucharist, as punishment for certain actions, in certain denominations aren’t you no longer in good standing?
Yeah, if i don’t want to say grace or engage in situations that require me to affirm Jesus, that would be analogous. The belief that religious communities don’t police shibboleths is incorrect.
Honestly the only real shibboleth i have really encountered is pronouns. Nobody has asked me to wax feminine balls
YoungAchamian
1mo ago
I mean if “member in good standing with community” is your barometer then absolutely what i said applies to prog spaces. I exist in prog spaces and the avg white man is absolutely accepted as long as they mutter the shibboleths.
If anything they don’t really require you to believe them so much as you don’t cause waves or have some plausible deniability.
Now the infighting you are alluding to is among the leadership, the narcissists, the sociopaths. Aka not normal folks. And yes to have power requires special circumstances in the memeplex, but hereditary or ideological purity as a metric of power inside a movement is not unique.
YoungAchamian
1mo ago
The wokes are in the Proselytizing phase of their religion, akin to islam. Christianity had that phase but is post-Proselytizing now
It's referencing a specific phrasing or reference from a previous argument, hence the quotes.
More options
Context Copy link