My advice is break everything you can trees, barrels, stone pillars etc. as you playthrough the game even multiple times. (as you play each quest at least 3 times)
You only need each type of item in the game broken once as the achievement seems to unlock early. The achievement will unlock when you break your last type in the "Sealed Temple". The Chest and Pile of leaves should be all you need. If not replay Sealed Temple before going back to older stages.