Gun "rights" people are weird.
Kinda like the Texas abortion bill that would treat a woman who gets an abortion as a murderer. Vile as it is, at least it's logically consistent.
As far as guns go, the right to keep and bear arms is in the Bill of Rights. None of the other rights in the Bill of Rights is limited, except as absolutely necessary, and then the courts are super-strict in scrutinizing limitations.
Freedom of speech? How do lose freedom of speech? The answer is "you don't."
Saying a convicted felon can't own a gun is like saying a convicted felon has no freedom of speech, or religion, or no right to be free from unreasonable searches and seizures, or no right to a fair trial.