The only natural disaster that concrete and brick houses are better at dealing with are fires.
With tornadoes most damage is done by winds so strong that they dismantle concrete, brick, or stone either directly or by throwing debris into them only slightly more slowly than they do wood. You can make a tornado bunker that is above ground with 4 foot thick walls and steel reinforcement. Homes do not do that, even in places that they make concrete homes.
Hurricanes tend to do most of their damage with flooding. Concrete and Bricks flood and mold just as easily as wood. When they are washed away the ground itself is washed away so they break just as easily too. For the extremely powerful hurricanes we have the same wind issues as tornadoes.
For earthquakes the concrete and brick homes are far worse than wood. They are too rigid unless very expensive tech and building practices are used and so they just crumble when an earthquake happens as they cannot flex.
And finally they are 3-10 times more expensive than wooden homes. Chances of you actually losing your home in your lifetime are low, and you get insurance to protect against it. So it is far better for most to spend what money they have to build a larger nicer home.
Also, drywall is not a structural weight bearing material. It is the interior finishing of the wall. Wood is the structural component and wood/fiberglass is the outdoor wall slat.