As an EE, I take a tiny capacitor and store one bit inside it. If it’s charged, then it’s 1. If not, then it’s 0. I then take millions of these capacitors to store millions of bits worth of information.
The brain is made up of trillions of neurons. Surely neurons aren’t binary :)