Most stamps are acquired from the stamp vendor. She follows you around the game setting up shop in the park, in her father's outdoor gear store and in the town in the valley. A handful of stamps are acquired from boss fights and 3 are acquired from the bobbing for apples minigame. The last stamp is acquired from the boss battle immediately before the final boss battle.
Stamps are the only thing to spend your candy on, so go nuts.