Does anyone else find being an embedded / naturalistic agent disturbing?
Like, I could be injected with a chemical that would cause my cells to make new proteins, which could alter my brain.
It could change the algorithm that this body is running.
Which, from a computational theory of identity, is to say that you could inject me with a chemical that would delete ME, and replace me with someone else.
That's horrifying. It feels like one of the things that "shouldn't be allowed".
Not that I can just be annihilated by having my head crushed (bad enough), but that it is possible for me to be taken over from the inside, by some kind of brain-controlling parasite.
In particular his analogy of a calculator (for a computational view of the self) is great.
"The point is to realize that both The Physics Explanation and The Math Explanation are true, and in _fact the entire purpose of the calculator is to make them coincide_."
This points directly at the source of the horror that I've expressed in the other thread.
Being physically implemented, all change has to be physically implemented.
But some change is the result of the system taking inputs, responding to them, reflecting on itself, and changing the way that it operates, often it quite radical ways.
Today, I was contemplating becoming rich enough that I could be confident that I wouldn't be able to spend all of that money on X-risk related projects, and I could give a chunk to Give Directly, every year, or every month.
(This wouldn't be the important, world-saving, money. It would be what I have LEFT OVER from that, which I could give away to help people have better lives.)
Thinking about that, I started to feel a kind of happiness and optimism and...brightness, that I haven't felt since I was first getting involved in EA, back in 2015.