They can take the man's gun, with probable cause a crime has been committed, just like they can seize drugs from a drug dealer.
The fact that the item to be seized is a firearm has no impact on the 4th Amendment's requirements nor operation.
And I support the Constitution.