BackgroundAn increased focus on quality and patient safety has led to the evolution of hospitalists. The number of hospitalists covering ward and outpatient care is on the rise in Japan. However, it is unclear what roles hospital workers themselves consider important in their practice. Therefore, this study investigated what hospitalists and non-hospitalist generalists in Japan consider important for the practice of their specialty.MethodsThis was an observational study that included Japanese hospitalists (1) currently working in a general medicine (GM) or general internal medicine department and (2) working at a hospital. Using originally developed questionnaire items, we surveyed the items important to hospitalists and non-hospitalist generalists.ResultsThere were 971 participants (733 hospitalists, 238 non-hospitalist) in the study. The response rate was 26.1%. Both hospitalists and non-hospitalists ranked evidence-based medicine as the most important for their practice. In addition, hospitalists ranked diagnostic reasoning and inpatient medical management as the second and third most important roles for their practice, while non-hospitalists ranked inpatient medical management and elderly care as second and third.ConclusionsThis is the first study investigating the roles Japanese hospitalists consider important and comparing those to that of non-hospitalist generalists. Many of the items that hospitalists considered important were those that hospitalists in Japan are working on within and outside academic societies. We found that diagnostic medicine and quality and safety are areas that are likely to see further evolution as hospitalists specifically emphasized on them. In the future, we expect to see suggestions and research for further enhancing the items that hospital workers value and emphasise upon.Supplementary InformationThe online version contains supplementary material available at 10.1186/s12875-023-02090-w.