Developmental dyscalculia is a learning disability that affects the acquisition of knowledge about numbers and arithmetic. It is widely assumed that numeracy is rooted on the “number sense”, a core ability to grasp numerical quantities that humans share with other animals and deploy spontaneously at birth. To probe the links between number sense and dyscalculia, we used a psychophysical test to measure the Weber fraction for the numerosity of sets of dots, hereafter called number acuity. We show that number acuity improves with age in typically developing children. In dyscalculics, numerical acuity is severely impaired, with 10-year-old dyscalculics scoring at the level of 5-year-old normally developing children. Moreover, the severity of the number acuity impairment predicts the defective performance on tasks involving the manipulation of symbolic numbers. These results establish for the first time a clear association between dyscalculia and impaired “number sense”, and they may open up new horizons for the early diagnosis and rehabilitation of mathematical learning deficits.