Number processing abilities are important for academic and personal development. The course of initial specialization of ventral occipito-temporal cortex sensitivity to visual number processing is crucial for the acquisition of numeric and arithmetic skills. We examined the visual N1, the electrophysiological correlate of vOTC activation across five time points in kindergarten, middle and end of first grade, second grade, and fifth grade. A combination of cross-sectional and longitudinal EEG data of a total of 62 children at varying familial risk for (...) dyslexia were available to form groups of 23, 22, 27, 27, and 42 participants for each of the five time points. The children performed a target detection task which included visual presentation of single digits, false fonts, and letters to derive measures for coarse and fine digit sensitive processing across development. The N1 amplitude analyses indicated coarse and fine sensitivity characterized by a stronger N1 to digits than false fonts across all five time points, and stronger N1 to digits than letters at all but the second time point. In addition, lower arithmetic skills were associated with stronger coarse N1 digit sensitivity over the left hemisphere in second grade, possibly reflecting allocation of more attentional resources or stronger reliance on the verbal system in children with poorer arithmetic skills. To summarize, our results show persistent visual N1 sensitivity to digits that is already present early on in pre-school and remains stable until fifth grade. This pattern of digit sensitivity development clearly differs from the relatively sharp rise and fall of the visual N1 sensitivity to words or letters between kindergarten and middle of elementary school and suggests unique developmental trajectories for visual processing of written characters that are relevant to numeracy and literacy. (shrink)