You're conflating rights with privileges. You're comparing apples to oranges.
Privileges are granted to us after birth. Rights preexist our birth.
As courts have ruled long ago, operating a motor vehicle (or an airplane or heavy machinery or ...) is a privilege. We were not born with a right to drive a car. As such, the government can place restrictions on this, such as mandating driver's licenses and seat belts.
Conversely, the Founding Fathers believed that rights are not given by the government. Rights predate the existence of government. Rights come from God. Quoting a famous passage from the Declaration of Independence:
We hold these truths to be self-evident, that all men are created equal, that they are endowed by their Creator with certain unalienable Rights, that among these are Life, Liberty and the pursuit of Happiness.
Still, as codified by the Supreme Court, all rights have limits. As such, the government can place
reasonable limits on our rights. The famous example is yelling "fire" in a crowded theater.
If we step back from the two entrenched camps, we can ask our ourselves at what point are governments placing reasonable limits our our rights, and at what point have they crossed the line?
One side argues, "the government can't tell me what I can do." Well, yes they can. As I just described, they can tell you what you can and cannot do if it's a privilege. They also can place reasonable (as defined by the Supreme Court) limitations on your rights.
The other side argues, "500,000 Americans have died." Yes they have. Yet in the recent past, we've had over 60,000 annual deaths from influenza. Did the government issue (for example) mask mandates because of these 60,000 deaths? Did they have the legal right to?
If 50 million American had died from COVID, there still would be some saying the government is trampling on our rights. Now that COVID has become so political, I'm sure there will be some who insist we should (for example) wear masks forever. Sound inconceivable? A year ago, Dr. Fauci stated that we should never shake hands again. Dr. Fauci suggested ending a century's old tradition because of one pandemic.
What's clear (at least to me) is that there is a point where the government
does step over the line. Are we going to be required to wear masks indoors when the number of COVID deaths drops below the historical average of influenza death (36,000 per year)? Are we going to be allowed to shake hands again? At what point does the government step over the line and violate our pre-existing rights?