I'm trying to figure out how to express that non-contradiction.
It's something like, my conscious mind and unconscious mind are working together, for the same things? And it's all part of the process of "me".
My conscious verbal mind is definitely not a just a PR center. And I know that, because I can hear, or generate, arguments and considerations that are compelling, that actually cause me to change my actions.
And noticing that, I can tease out which things _I_ care about, by noticing which arguments and considerations feel compelling.
More concretely:
I definitely do a thing that I tag as "telling stories", which often feels like composing an argument, as if to someone else, to justify myself.
But I can also back up and consider which situations, if they obtained, would cause me to feel or act differently.
Like if I notice that I'm "telling stories", about how doing X is _justified_ (usually to some particular person that I'm imagining), I'll flag this and keep going.
"Telling stories" isn't bad! I just want to know that I'm doing it.
But eventually, I'll become curious about why I care about the thing I'm arguing for.
I'll start offering myself hypothetical scenarios, varying the situation along different axes, and seeing how I feel about each one. I check which situations would cause me to act differently.
And thereby I can uncover my true cruxes.
Not what's the best argument for X, but why do I actually want X / why do I think that X is a good idea.
And then, knowing that, my conscious mind starts planing, taking my true reasons for X into account.
Instead of just justifying X, I can maybe find better or easier solutions that achieve my true motivation for X.
Or in this post I give another example of an introspective methodology.
In the second example in particular, I gain some insight into what is motivating my planning, so I get to plan BETTER.
There's some attitude of, whatever my motivation for doing something, those are MY motivations, and I own them, and then figure out how to best hit them.
Sometimes my true motivations are at odds with other things that I care about, or ways that I want to be. In which case, I own those too.
This is the flip side of not berating yourself: sometimes the processes or heuristics you're running can stand to be improved. But it almost doesn't compute to be fundamentally bad, since whatever you choose stems (modulo bugs) from what you value.
If you own everything that has motive force within you, then you aren't a verbal loop attached to and rationalizing a mysterious, semi-aligned, decision process.
Instead, you're a coherent thing that desires and thinks and plans and acts.
But this depends on self-honesty. You have to admit to yourself, and allow yourself to be aware of what you want and believe.
And that takes courage, and the self-trust that whatever is true, about you or the world, you'll find a way to deal with it.
(Which, incidentally, is tied to with being honest to other people, at least for me. The habits of stretching the truth or giving white lies to others, carry over in my relationship with myself.)
Whatever is there, if I own it, I can serve it, and my other needs, better.
I don't want to suggest that I'm perfect at this. As I said, it takes courage and skill, and I would be willing to bet that there are parts of me that I am denying or ignoring.
But my fundamental default attitude is that it’s all me, and I will be the better for embracing it.
So I'm not just my verbal loop, and I'm not just my urges. I'm the whole reflective system.
In particular his analogy of a calculator (for a computational view of the self) is great.
"The point is to realize that both The Physics Explanation and The Math Explanation are true, and in _fact the entire purpose of the calculator is to make them coincide_."
This points directly at the source of the horror that I've expressed in the other thread.
Being physically implemented, all change has to be physically implemented.
But some change is the result of the system taking inputs, responding to them, reflecting on itself, and changing the way that it operates, often it quite radical ways.
Does anyone else find being an embedded / naturalistic agent disturbing?
Like, I could be injected with a chemical that would cause my cells to make new proteins, which could alter my brain.
It could change the algorithm that this body is running.
Which, from a computational theory of identity, is to say that you could inject me with a chemical that would delete ME, and replace me with someone else.
That's horrifying. It feels like one of the things that "shouldn't be allowed".
Today, I was contemplating becoming rich enough that I could be confident that I wouldn't be able to spend all of that money on X-risk related projects, and I could give a chunk to Give Directly, every year, or every month.
(This wouldn't be the important, world-saving, money. It would be what I have LEFT OVER from that, which I could give away to help people have better lives.)
Thinking about that, I started to feel a kind of happiness and optimism and...brightness, that I haven't felt since I was first getting involved in EA, back in 2015.