(1) Background: Alexithymia and impulsivity appear to represent risk factors for violence perpetration, while mixed results are present with respect to victimization experience. In light of this, the purpose of this study was to compare the roles of both alexithymia and impulsivity among three different samples of men: men who experienced partner victimization (IPVV); male intimate partner violence perpetrators (IPVP); and men from the general population (CG). (2) Methods: Participants were recruited from specialized centers in Italy. A profile analysis was conducted. (3) Results: The results showed that IPVV presented alexithymia and impulsivity comparable to the CG. Furthermore, differences were found between victims and perpetrators in terms of impulsivity and alexithymia. The IPVP group had higher levels of both impulsivity and alexithymia in comparison to IPVV. Moreover, the perpetrators exhibited significantly higher levels of alexithymia compared to the CG. However, despite the medium Cohen’s d (d= 0.441) resulting from the analyses, IPVP’s level of impulsivity was not statistically different from the CG. (4) Conclusion: Alexithymia and impulsivity appear to play a key role in violent behaviors and should be the focus of psychological interventions with perpetrators.