Over population

This refers to the population size where there are more people than resources can sustain resulting in fall in average output as the population grows.

Or

it the population size where output per person falls as the population increases.