If chemicals acting on the brain can create different realities, what happens when two brains have different structures? There's no question that their realities will be different. Brain damage, strokes, prefrontal lobotomies, and head injuries can change what's important to a person. They can even change one's personality from aggressive to meek or from kind to grumpy.
But it's not as if we all start out with the same brain structure. Males' and females' brains are different by nature. Think about this. What if the communication center is bigger in one brain than in the other? What if the emotional memory center is bigger in one than in the other? What if one brain develops a greater ability to read cues in people than does the other? In this case, you would have a person whose reality dictated that communication, connection, emotional sensitivity, and responsiveness were the primary values. This person would prize these qualities above all others and be baffled by a person with a brain that didn't grasp the importance of these qualities. In essence, you would have someone with a female brain.
We, meaning doctors and scientists, used to think that gender was culturally created for humans but not for animals. When I was in medical school in the 1970s and '80s, it had already been discovered that male and female animal brains started developing differently in utero, suggesting that impulses such as mating and bearing and rearing young are hardwired into the animal brain. But we were taught that for humans sex differences mostly came from how one's parents raised one as a boy or a girl. Now we know that's not completely true, and if we go back to where it all started, the picture becomes abundantly clear.