They can take the man's gun, with probable cause a crime has been committed, just like they can seize drugs from a drug dealer.

The fact that the item to be seized is a firearm has no impact on the 4th Amendment's requirements nor operation.

And I support the Constitution.