site banner

Pyscho-Pass S01E01 - S01E03: The Social Credit System

The recent conversation on anime inspired me to write this review of the best one I've seen so far, not just in terms of Anime, but truly one of the best written stories I've ever seen. I often thought of it as prophetic, but looking back on it for the Nth time, I think a lot the phenomena and trends it talks about were already underway, they just didn't seem so prominent at the time, and so made a good premise for a fanciful sci-fi show.

Spoilers ahoy, although I'm not going to go beat by beat for each and every episode.


Psycho-Pass is set in a post-cyberpunk future, where Japan developed technology capable of looking into our very souls. Thanks to remote brain scans and big data analysis, a hyper-advanced computer system (often referred to by name as the Sybil System) can guide everything, from individual lives to the sociaty as a collective, towards it's optimal path. Various components of the scan form the titular Psycho-Pass (as in: passport) which determines your standing in society. We mostly see the world through the eyes of Akane Tsunemori, a young police inspector, fresh out of the academy. The first 3 episodes are a sort of "tutorial level" for her, where she learns the ropes of police work, and we get to see the basic mechanics of the Psycho-Pass, and how it affects people.

We meet Akane as she's running late for her first assignment: a normie white collar worker got flagged by a street scanner doing a "hue check" - a low resolution vibe check that gets translated into color for readability. The suspect has been determined to be doing a bit too much wrongthink, and was directed by a drone to go to therapy. Not only did he refuse to comply, he grabbed a passerby, took her for a hostage, and ran off to a ghetto full of the homeless and other undesireables. All of this is explained to us by Akane's work partner, inspector Nobuchika Ginoza. Just as he's done with the briefing, they a see a police van arrive, and the rest of the supporting cast disembarks:

The people you're about to meet cannot be considered humans like us.
Their Crime Coefficients all exceed the safety limit. They are people of bankrupt character.
Normally, they would be completely isolated as latent criminals, but they're allowed into the outside world for the sole purpose of flushing out criminals just like themselves.
They're hunting dogs. They're beasts used to hunt beasts. They're what we call “Enforcers”.
They will be your subordinates.

The Crime Coefficient is another component of the Psycho-Pass that measures an individual's propensity towards crime. It's a high resolution measure, that requires specialized hardware, and significantly more compute than a basic Hue Check, so they are not done routinely. Instead, law enforcement are the only ones handling such scanners, which conveniently come attached to a gun called a Dominator, which make the police work rather simple:

  • Anyone with a Crime Coefficient below 100 is considered a law-abiding citizen, and is not a subject for any enforcement action. The trigger locks automatically when the gun is aimed at them.
  • Values between 100 and 300 mean that the suspect is considered a "latent criminal", and they should be taken into custody. The gun fires in "paralyzer mode" to help facilitate this.
  • Above 300 the suspect is subject to a summary execution, and the Dominator switches to "eliminator mode".
  • Independently from the Crime Coefficient, there's also a "decomposer mode", which is activated when law enforcement are facing a significant threat, and really need to blast something to kingdom come.

Perhaps I should have said it's the judicial system's work that has been simplified, rather than that of the police, since the police still have to apprehend (and/or execute) criminals, while the entirety of the due process has been replaced with a Crime Coefficient scan. The system is responsive in some ways, but appears very rigid in others. On one hand, we do see update based on incoming data. When they first try to arrest the suspect, it turns out he took stimulants that countered the paralyzer. That act of defiance cost him is life, as the system responded by authorizing his execution. Similarly the hostage moves up and down the scale. First, the trauma of the entire ordeal makes her Crime Coefficient go up to the point where she's considered a latent criminal, and will placed under arrest. Then, upon witnessing the execution (which is done in a particularly gruesome way for no apparent, or explained in-universe, reason) and thinking she's next, she makes a break for it, which causes the Coefficient to go even higher, now authorizing her to be executed as well. Finally, as the resident naive newbie (and young woman), Akane insists on showing her mercy, successfully talks her down from going out in a blaze of glory, and thus the system updates once more, this time downward, and she's merely arrested.

On the other hand, everyone, with the exception of Akane, is acting like once you pass a certain threshold, your life is over. Before he's killed, the kidnapper has a little "what's the punishment for being late?" monologue explaining his actions:

Up until today, I did everything by the book. I spent my whole life walking on eggshells, trying my hardest not to upset or bother anyone.
And yet, I get flagged by one little detector and boom! They already treat me like I'm a criminal.
This is it for me.
Now that it's come to this, it's all over. I'll never be able to get a job, get married, or anything else.
Well, fine then. I've restrained myself all this time. So now, I'll just do whatever I want. I'll take whatever I want. I'll kill anyone I don't like!

You might think maybe he's just an unstable man, failing to see that the system isn't as rigid as he claims, and his life was never over, but even the hostage thinks she's boned, when she's shown her Psycho-Pass. What's more Akane's decision to go easy on the hostage is portrayed as extremely unorthodox. Everyone treats her like she's crazy, and her actions can only be justified by being naive and inexperienced. She spends a good deal of the second episode fighting doubts about her decision, and trying to justify it in the case report*. Luckily for her the hostage ends up improving after being given therapy in custody, but that outcome is implied to be so rare, that the unorthodox nature of her actions are seen as a plausible explanation for it, so she gets to claim it as a justification.

*) You might be thinking "huh, it's a rather ruthless society, if you have to justify not killing a suspect", but "the decision" in question was less about showing mercy to the hostage, and more about shooting one of the enforcers (in paralyser mode) in order to prevent him from carrying out the execution (only has himself to blame, that's what he told her to do). There's also the "blaze of glory" aspect of the situation, where Akane would be putting herself and her subordinates in danger, if things didn't go her way.

The rigidity isn't even limited to the Crime Coefficient. After the kidnapper has been dealt with, the following day Akane meets up with her friends for coffee, and in the course of the conversation it turns out that in the Psycho-Pass universe, Akane has a super-power - the power of choice. One of the blessings of the Sybil System is it's ability predict how well suited each individual is for a given job, and Akane was found to have (top!) aptitude for jobs at all thirteen ministries and agencies, and six companies. Faced with so much choice, she also faces doubts like "what is my purpose in life?" which everyone else finds extremely annoying. One of her friends does manual labor, and the other is an IT worker, and neither has any prospect of ever doing anything else in their lives. Later on she also has lunch with one of the enforcers - Shusei Kagari - who's situation is even more dire. Enforcers are nothing but convicts with aptitude for police work, and Kagari was declared a latent criminal when he was still a child. His only choice in life was to either rot in prison, or work for the Public Safety Bureau in return for better living conditions, and a sliver of freedom (enforcers can even leave the PSB compund as long as they're accompanied by an inspector).

Another one of Akane's "superpowers" that's briefly mentioned, is that her Psycho-Pass tends be good. Why that is, is initially a matter of some speculation, and finally spelled out in the later episodes, but it seems to boil down to her stoic life philosophy. In any case, she seems to be unaffected even by events that would mess other people right up, while everyone else, who isn't already a latent criminal, goes through life stressing out trying to manage their "Hue". The third episode, possibly the first mission outside of the "tutorial level" explores that - and how it can go horribly wrong - a bit more. Akane's division is assigned to investigate suspicious deaths in a drone factory. Originally all ruled accidental, their mere frequency raised suspicions. No direct evidence of foul play is found, but the investigation reveals disturbing dynamics between the workers. For security reasons the entire factory is completely cut off from the interwebs, and they have to make do with what they have around for entertainment, which is not a lot. So, as is perhaps not uncommon in male-heavy environments, the workers as a group tend to periodically pick a victim and bully the shit out of him to blow off some steam. The director of the factory is aware of this, and allows it, as it's good for collective morale. When any particular worker gets bullied too much, and their Hue gets too messed up, he rotates him out and lets another schmuck take his place. However, no one's been rotated out in quite a while, as the most recent designated whipping boy's Hue seems to periodically recover on it's own... and the times of the recovery are curiously aligned with the times of his coworkers' deaths. Plot twist! Turns out the whipping boy has been blowing off some steam of his own.


One of the fascinating aspects of the show is the blurry line between what is meant to be a statement about the impact of technology on society, and what is an allegory for how society already operates. In interviews the show's creators often hint at most of it being the latter, and it makes sense. Psycho-Pass was written in 2014, AI was still a distant dream, and many technologically mediated social trends it talks about were still in their infancy, if they even can be said to have come about at all. Information revealed in later episodes even makes it clear that the Sybil System isn't exactly an AI in-universe, and shouldn't be interpreted to be about the impact of technology on society, at least not exclusively. We'll cross that bridge when we get there, but for now, since the story is leaning in the AI direction, and since so much progress has been made in the field IRL, it's hard not to dwell on it a little bit.

I've had my fair share of rants about Rationalists and how they get AI wrong, Psycho-Pass is how I think you get it right. Stop worrying about agentic superhuman conscious intelligences, and start worrying about systems for mass surveilence and control. Worry less about existential risks coming from misalignment, and more about existential crises people will face when you sucked all humanity out of their daily lives. Remote brainscans might seem fanciful, but between SocMeds, smart watches, and smartphones, do we even need to scan brains to get something like the Sybil System? China already has their Social Credit System that doesn't seem all that different from Sybil, Europe seems like it would like to have one as well, along with a uniquely identifying digital identity, or a (state manged) digital currency And in case we do need to scan brains to get something like the Psycho-Pass, well it's not entirely out of the question. Every time I rewatch the show I end up thinking it's scary how relevant it is.

The conversation between Akane and her friends always makes me smile, because I had one eerily similar to it ages ago, with an old friend of mine facing a similar choice dillema, who ended up pining for a Sybil System to come into existence! "Wouldn't it be great", she said, "if there was a machine that could tell you what job you'd be good at, and would enjoy doing?". It's another thing that I think we're more likely to get than an AGI, and it's a good question if we really want it. The idea that people prefer to have a "human element" in a system instead of everything being decided by a machine has been a trope in sci-fi for a while, but despite being the resident Luddite, I'm starting to wonder if this is true. We're not even that far up the AI tech-tree, and I'm already hearing "but ChatGPT said..." as an argument enough times to make me want to pull my hair out. On the other hand, I'm pretty sure that it's healthier for people have such a human element, as demonstrated by the growing collective unhappiness, the more exposed to technology we become.


Other than all the food for thought, the show has some great character development. Since these are the introductory episodes there's not much to write home about yet, but here's the general run-down.

Akane is still inexperienced and is constantly wrecked with doubts, but over the course of the show we see her grow in skill and confidence. A fairly common trope in anime, but depressingly rare in western storytelling, and it ivariably makes me shake my head to think how much drama about Mary Sues we could have been spared if Hollywood copied a few notes from Japan.

Although I haven't mentioned his name yet, the other main protagonist of the show is enforcer Shinya Kogami, the poor bloke that got shot by Akane in episode 1. He's one of these dark and broody types with a quest for vengence, and set up as the counterpart for the story's main villain (to be disclosed). Though the thing I find interesting about him is his skepticism, if not quiet resentment, of the Sybil System, and how he chooses to process it (in contrast to the currently undisclosed villain).

Inspector Ginoza is dark and broody in his own way, and seemingly disdainful of the enforcers (he's the one that delivered the little speech about them not being entirely human), but it turns out his motivations are understandable, and his intentions relatively noble. We get to see some of the setup for his arc in episode 3, as Akane discovers there's some tension between him, and enforcer Tomomi Masaoka, which is apparently a touchy subject for both. It has a very moving resolution by the end of the show, but that's another bridge we'll cross when we get there. As for Masaoka, he's an "old dog" detective, with his own interesting backstory of how he became a latent criminal.

I already mentioned enforcer Kagari, he's more aloof and tends act like a goofball most of the time, but has these nice moments of depth, like his conversation with Akane that I mentioned above.

The final enforcer of the team is Yayoi Kunizuka who... well, doesn't really do that much, but gets a pretty good backstory episode later on. And last but not least is analyst Shion Karanomori a somewhat manic superhacker that supports the team back from HQ.

To be continued...

20
Jump in the discussion.

No email address required.

So, I think I'm missing something. (I've not watched this show, for reference.) How do you maintain a set-up like the one in the factory when the color vibe check should reveal "Yup, you assholes are all guilty of pre-crime harassment and conspiracy to commit harassment, everyone to jail, every politician that says 'No, this is an economically-vital piece of infrastructure.' also to jail.", and so on?

Or, alternatively, can you hang around and do the same kind of murder-provoking harassment to everyone in society without having a crime index, and since you don't have a crime index, you actually doing it can't be a crime?

Conversely, if the system spits out that a latent criminal has changed their psychology enough that they are no longer likely to commit crimes (as you'd expect them to do after having good, meaningful work inside a system) doesn't that mean that they graduate pretty quickly, and everyone saying "No, they're scum, we've collectively agreed that they're the non-metaphorical underclass we agree to look down upon" is intending to commit crimes against actual-citizens and thus gets immediately vibe-checked and shot?

I feel like either there is a lot being elided here. A society as described can't be both a functional pre-crime enforcement state and a metaphor for modern society, because shooting people with criminal nature and intent regardless of their social status, connections, or cleverness in concealing their actual crimes would wipe out huge swathes of the people we consider movers and shakers in modern society.

So, I'm going to guess that there is a reveal that the Psycho-Pass is fundamentally bullshit, with vast quantities of either false positives or false negatives, because just what I've heard in the first three episode descriptions, it does not sound like the system works as described.

I haven't watched the show either, but...

The color vibe checks as described don't seem to be detailed enough to reveal "guilty of pre-crime harassment". My impression given the setup of the factory episode it's very imprecise, and runs more off of "how much do you feel like you're blending in with the herd, doing the Normal Thing as you understand it, right now?" A full psycho-pass scan might pick up on it, but those aren't standard. So in the factory, all the harassment is just... what the people there do. None of it is any big deal, it's all just workplace joshing, the only person with an incentive to rebel is the one at the butt of the joke, and he's getting to comfort himself with "anyone would have got back at them, and now I don't have to deal with that asshole any more so things will get better."

And if you're one of the outcasts who got dumped in the Bad Person Pool, then whatever got you there in the first place is likely still there, and you'll have either "I am a weirdo who got dumped in the ghetto so clearly I actually am a deviant who can't hack it by normal society standards" or "Those dicks stuck me in the garbage, but actually it's them who are all garbage, fuck society's rules" as personality attractors.

A society as described can't be both a functional pre-crime enforcement state and a metaphor for modern society, because shooting people with criminal nature and intent regardless of their social status, connections, or cleverness in concealing their actual crimes would wipe out huge swathes of the people we consider movers and shakers in modern society.

If the System were newly introduced, sure. But in the setting it's supposed to have been around for a while, and any aspiring movers and shakers who had "criminal nature and intent" have already been screened out. There may have been upheaval at the time, but right at the depicted moment there wouldn't be. Just like in modern society, aspiring movers and shakers who are too vocal about, say, "there are serious double standards about how we treat denigration of men and denigration of women" get sidelined.

But that's not what the series is promising, then. An actual pre-crime analysis system should look at everyone who is willing to go "Yup, I have free societal rein to hate on this person, we've all agreed that they're the designated victim." and note that whoops, the law doesn't say you're allowed to abuse your social lessers according to a nebulous and ever-shifting social pecking order, you're all criminals. An accurate oracle will predict that you are likely to commit a crime; if they don't peg as latent criminals, either criminal harassment isn't a crime in this society (which I strongly doubt is shown), or there are explicit and complicated legal codes allowing it in specific circumstances (which again I doubt is shown)...or, what I think is likely, the show (and/or the Sibyl system) are equivocating between what the actual law is and how the actual law gets enforced. Like, is discrimination against people who once-ever pinged into latent criminal legal and mandated, or social consequence? You can't appeal the court of public opinion if you're accused of a crime in a shame-based culture...but you can go "Predliciton towards illegal discrimination and targeted harassment! The Law says that this man is now innocent and if you disagree, that means you're likely to be a criminal yourself! Jail for all of you! Oh, you think that you can get away with changing the law so we're not allowed to imprison millions of people for going along with society's most-common actual beliefs? That's evading the police, like with drugs! Death for millions of you!"

Of course, this assumes that the Sybil system is honest, which I don't think it was ever meant to be. An actual pre-crime system means that the letter of the law is vital to the story, and that we need an actual indicator of how stable crime index scores generally are and what going from sub-100 to 300 to back to sub-100 means. (Can the cops walk into City Hall and shoot at random government officials, since if the act of being mock-executed makes their crime index go up it means they were latent criminals all along? Are there even government officials any more, or is it just the will of the computer system and its physical agents?)

So before I go any farther, I want to say that I agree with you that the series is probably going to do something about the Sybil system's reliability/methods/consequences/origin, if only because you wouldn't make a show with that as the premise unless you were going to explore it. And especially not with that kind of fallout in the first three episodes. That said...

An actual pre-crime analysis system should look at everyone who is willing to go "Yup, I have free societal rein to hate on this person, we've all agreed that they're the designated victim." and note that whoops, the law doesn't say you're allowed to abuse your social lessers according to a nebulous and ever-shifting social pecking order, you're all criminals.

Why?

I mean, certainly there are some systems that would. But it could just as easily be that in a society that is already going all-in the precrime analysis, that the predilection for ostracism is seen as too small an issue to be worth putting into that analysis. It'd be like putting a preference for popping gum in the cinema in the weighting.

Or that that kind of attitude is so common that if you were to start significantly dinging people up for it you wouldn't have enough people left to run a society.

Or that the crime analysis puts all its focus on antisocial, society-destabilizing crimes, and the ostracism is considered a pro-social, society-building behavior, binding everyone involved to the project of continuation except the person getting the brunt of it (in which case good thing we have these anti-society types).

Why?

Because that's not what the law is, as we here and now define the law. Like, you could also have a pre-crime society with a totalitarian dictator where it was the written law and the whole of the law that what he says goes...but that's not pre-crime, that's just the dictator with extra steps. Likewise, society outsourcing its ability to designate people to pick on to an AI system is something, I guess, but that's not the law (again, as we understand the law.) That's just, I dunno, racism with extra steps? Classism, maybe? Or...ah, life in your choice of post-revolutionary totalitarian shithole, where anyone who commits a public impiety (or is just the least conspicuously pious when the bloodlust gets up) gets stoned or gulaged, and everyone who's not in the clergy or Party knows that they're on thin ice and need to police themselves accordingly.

I am not a sociologist who's studied Japan specifically, but one facet I've heard repeatedly is that lots of aspects of society are stultifying, with unwritten rules and expected codes of behavior, and avoidance of direct conflict. And turning those unwritten codes of behavior into something that is being parsed by a theoretically-objective system feels like a cleaner metaphor. The guy playing his speakers on full blast in the crowded train? And who absolutely refuses to take a hint or read the room, in that or any other similar situation? What's his crime index like, if he does actually care about the law-as-written, and the law-as-written expected people to get with the program due to social pressure?

Either you formalize the social codes, and you should have the cops sternly warn the manager in episode two for not sticking to the recommended duration and quantity of Accepted Workplace Bullying as defined in Psycho-punk OSHA (since if they've got algorithms for prediction and they're not just magic bullshit, there should be a huge amount of regulations and research about what makes the mean person more or less likely to crime). But the point is that there was no rule saying it was that guy's turn in the barrel and that he can sue to demand Victim Overtime instead of poking back (or alternately, him cheerfully pointing out that he's got a rock-bottom score himself because taking very-precise actions that just happen to result in his co-workers dying in hilarious industrial accidents isn't technically illegal any more than their harassment is).

Now, you can absolutely have a Sybil system that looks only at "Is this person going along with society?" And, if you're in a place that has a clown-shows justice system like Japan, then specifically using the term 'criminal' for someone who's gotten the cyberpunk equivalent of a K9's flag is probably making a point. But that's not fulfilling the promise of an actual pre-crime system that can actually predict crimes and thus eliminate them before the crime actually happens and the harm is caused.

Although, now that I think about it, maybe another point of the anime is that it's meant to be obvious that the pre-crime is bullshit, because the society has the need for the Enforcer janissary class. But hey, maybe we'll see that the system is actually generally correct and the Enforcers get up to shady shit, and that giving them guns is actually a really bad idea when one clever-dick improvises a wi-fi jammer and then they all rise up and start beating the real cops to death with clubs and numerical superiority.

Because that's not what the law is, as we here and now define the law.

Bolded the bit that is, I think, the crux of the disagreement we are having.

...you could also have a pre-crime society with a totalitarian dictator where it was the written law and the whole of the law that what he says goes...but that's not pre-crime, that's just the dictator with extra steps.

That is the dictator with extra steps. It is also pre-crime. There is no requirement that the crimes being so preempted are things that you agree should be crimes, nor that all things you think should be preempted be counted among the things that the system actually does preempt.

It seems to me that anything like the Sibyl system, if it really existed, would itself have immense pressures on the nature of laws in its society. Perhaps the show plans to explore that.

If the law as written says that harassment is illegal, but society accepts it, it doesn't really make sense to have the system be both about the law as written, and a metaphor for society. These meanings are in tension with each other.

What makes you think the system in the show, as described by the OP, is about "law as written"?