fervent wagon
The ruling on hermaphrodites/intersex people is usually on a case by case basis (which would require a visual inspection) but in your case you'd be understood as a woman, especially since you dont have 2 parts, have the shape of a woman, and have birthed children.
I would suggest reading up on this or consulting people of knowledge, there are quite a few ahadith and scholarly works about your situation.
As for the people talking? There isn't much one can do about that, you could share your knowledge with them, but alas, Allah is the only one who will ever see you for who you really are. Just have faith in Him, and ask someone knowledgeable on this matter what you could do about it. This is something is out of your immediate control, so don't listen to what the people say, and remember, Allah does not burden a soul with that which is more than what it can bear
Asalam o Alaikum
quaint wind