Suppose the time eventually came (and I acknowledge that this is still a long time away) when an AI is able to faithfully mimic your every response. In other words, your personal AI passes the Turing test with flying colors.
And then, in this far off future, you opt to designate that AI as your proxy. Whenever you are unavailable, you can trust your AI to step in and give the response that you would have given.
In time, people just take this arrangement for granted. As Abraham Lincoln once said “A difference that makes no difference is no difference.”
But then one day you die, and in your will you have designated your AI as your legal proxy in perpetuum. What happens then?
Do you legally live on forever? Do the courts step in and declare that you have overstepped?
By then I suspect that the courts may be filled with the AI proxies of jurists long deceased — or perhaps AIs that consist of well crafted amalgams of the finest legal minds from various historical eras. So those future courts might very well be biased in your favor.
Something to think about.