This paper examines two alleged limitations in the use of formal languages: on the one hand, the trade-offs between expressive and inferential power, and on the other, the phenomenon of system imprisonment. After reconceptualizing the issue, we consider the role played by modality in the understanding of certain aspects of mathematical structures and argue for its centrality.