World 2 is actually the first world.
You do not need to collect all the puzzle pieces to earn this achievement. Simply reach the end of stage 2-4.
For information on puzzle pieces in this world, check these solutions:
The Solved World 2 achievement in Braid worth 17 pointsFit together all the world 2 puzzle pieces and align the puzzle in its frame.