At the time of birth, a baby’s brain has roughly 100 billion neurons, but it began with nearly twice as many as an embryo. Starting in the third semester, the brain eliminates unnecessary neurons via a process known as apoptosis.