Paul Morris was remanded in custody at Walsall Magistrates' Court on Tuesday.
He is accused of possessing a shotgun without a certificate as well as five charges relating to ammunition.
The 47-year-old, of Station Street, Bloxwich, was arrested on Friday in an operation that led to the evacuation of two nearby homes and part of a police station.
They said the homes were evacuated during a search of his property "on the orders of army bomb disposal experts".
Mr Morris is due to appear at Wolverhampton Crown Court on 19 February.
The full charges are possessing a shotgun without a certificate; possessing prohibited armour piercing ammunition, hollow-point ammunition, expanding ammunition and possessing ammunition for a firearm without a certificate.
A man charged with possessing a shotgun and military-style ammunition has appeared in court.