Just curious, but doesn't this mean that this system is easy to bypass? Just because you don't ask about their family doesn't mean they are not going to share it. Just saying something like "enjoying the summer so far?" As a conversation starter could trigger a "oh yeah, spending it with my 5 kids" response.
And someone who already knows that a discrimination case could be made can just easily put his religion or family or whatever into whatever response they feel like even if it doesn't make sense for the question.
It just seems easy too easy for someone to be able to do this just because they said something. Or does it only apply if you ask?
I hear you, it's the same reason why I still have google maps in my e/OS phone, to see my history and give me more restaurants I can try.
But the compromise in my case and what everyone in this thread also knows is that the data you share will not only be yours.
I think no one here is against a powerful AI assistant that will help is with personal stuff and keeping track of everything, but having to share all your life with someone else is a huge fuck no. They would know way more than even your life partner.
If there was something mostly offline that we could use I think we'd be all up for it.