Unlike score, points of damage does not include popping pigs or completing levels with Birds remaining. Damage points are only earned by smashing blocks of stone, wood and glass etc. Each normal block you destroy will earn you 300 points, but you'll be destroying hundreds and hundreds of these without thinking about it throughout your games.
You should earn this somewhere in the middle of the first Naboo Invasion.