Modern physics encompasses theoretical and experimental research divided in subfields with specific features. For instance, high energy physics (HEP) attracts significant funding and has distinct organizational structures, i.e., large laboratories and cross-institutional collaborations. Expensive equipment and large experiments create a specific work atmosphere and human relations. While the gender misbalance is characteristic for STEM, early-career researchers are inherently dependent on their supervisors. This raises the question of how satisfied researchers with working in physics are and how different subgroups – female (...) and early-career researchers – perceive their work environment. We empirically investigated job satisfaction and satisfaction with the academic system among physicists (N=123) working in large laboratories, universities, and independent institutes. The scale for measuring the satisfaction with the academic system in physics yielded three factors: experience of research autonomy, opportunities to use one's knowledge, and appreciation of the research by the general public. The results show that physicists are less satisfied with the academic system than with their work environment. Moreover, female scientists and junior researchers experience their jobs more negatively. The results emphasize the need for improving work and research conditions for underprivileged groups in physics. Interestingly, no significant effect was found between different types of academic institutions and general job satisfaction. Finally, physicists felt that their work has not been well understood by the public. (shrink)