The main focus of the paper is the role of listeners’ emotion-relevant characteristics and musical expertise in the granularity of affective responses to music. Another objective of the study is to test the consistency of the granularity of affect that is perceived in music and/or experienced in response to it. In Experiment 1, 91 musicians and nonmusicians listened to musical excerpts and grouped them according to the similarity of the affects they experienced while listening. Finer grouping granularity was found in (...) musicians and high rumination scorers. Male musicians with above-median scores in rumination produced a larger number of clusters than the other male participants. Experiment 2 that engaged 23 participants demonstrated moderate consistency with which listeners grouped affects that they perceived in music and affects they experienced while listening to music. The study suggests that affective responses to music are subject to individual differences in musical expertise and rumination. Affects perceived in music and felt in response to it seem to be categorized with reference to the common principles. However, the cues that are used in such instances of categorization seem to be different. The paper encourages further research on the importance of listeners’ personal characteristics for the affective responses to music. (shrink)