@Spez1alEd's banner p

Spez1alEd


				

				

				
0 followers   follows 0 users  
joined 2022 September 13 23:09:15 UTC

				

User ID: 1184

Spez1alEd


				
				
				

				
0 followers   follows 0 users   joined 2022 September 13 23:09:15 UTC

					

No bio...


					

User ID: 1184

I don't think Rationalists would be worried about AI alignment if they thought that more intelligent = more better in every relevant way.

Isn't that exactly why they are worried about AI alignment? They don't necessarily consider intelligence to confer moral superiority, but many do consider it to be among the most important qualities in determining how competent/powerful an agent is. That's exactly why it's scary to think of what would happen if an extremely intelligent, hence powerful, agent that didn't share any of humanity's core values were to emerge.

If you care about the weak is it not better to do all you can to strengthen them, rather than to accommodate their weakness and encourage them to value it and make it part of their identity? Down that road lie self-destructive ideas like fat acceptance, or the opposition of some deaf people to a cure for their condition. Such ideas don't represent genuine compassion for those who are struggling but seek to keep them disempowered and dependent, while simultaneously assuaging the guilt of those stronger than them.

To be honest I'm sceptical that it's ever a good idea to rely on the goodwill of the strong to protect the weak. Following the Black Death in Europe, the resulting labour shortage left the remaining workers in a far better negotiating position than they had been in before, and using their additional leverage they were able to force the hand of their lords to grant them better conditions and relax some of the restrictions they'd had imposed on them as part of serfdom. This never would've occurred had their position not been strengthened (even if through an act of God rather than cultivation of personal virtue, in this case), no matter how many clerics might've appealed to the lords' sense of Christian charity.

I think it's the same today, relying on the benevolence of those in power is simply not a reliable way to win concessions compared to using leverage to force their hand. Of course, in some cases we can't strengthen people and so accommodating them is all we can do, but it should always be our second option after seeking to empower them.