Multiple functional-material-filled nitrile butadiene rubber/chloroprene rubber (NBR/CR) acoustic composites were extensively studied and prepared. According to the orthogonal test table L25 (56), 25 groups of samples were prepared by using a low-temperature one-time rubber mixing process. With tensile strength, average transmission loss, and damping peak as indexes, the influence degree of different factors and levels on the properties of acoustic composites was quantitatively discussed and analyzed. The matrix weight analysis was employed to optimize the material formula of rubber composites, and the corresponding influence weight was given. Results showed that the acoustic composite with blending ratio of 70/30 for NBR/CR matrix had preferable mechanical and acoustic properties; adding mica powder (MP) and montmorillonite (MMT) in matrix contributed to improve all above three indexes owing to their specific lamellar structures; hollow glass beads (HGB) had a positive influence on improving acoustic property due to its hollow microcavities, however, it had a negative impact on damping property because of the smooth spherical surfaces. Accordingly, the optimal formulation was found to be NBR/CR blending ratio of 70/30, MP of 10 phr (per hundred rubber), HGB of 4 phr, and MMT of 10 phr.