I don't think that's really a fair assessment. From my observation, and my own opinion. When people say they don't care what celebrities say, they don't want hear them preaching to us. Things like, their political views, environmental stuff, the economy... Not many want to hear about the environment or the cost of groceries from people flying around on private jets making millions.
Zegler insulted millions upon millions of people with a hateful comment. Did she apologize? Sure. But she specifically targeted an extremely large group of people. Of course there was going to be a very large backlash. Sure it's her opinion but come on, she walked up to the line and then took a running jump past it. So yea, people are going to talk about it.