Light bits can be identified by ethereal white domes that appear and make a sound cue as you walk near them. Shine your lantern on them for a few seconds (make sure you have enough gems as fuel) and they will break, releasing a light bit.
One early bit can be found to the far right of the Northern Shore along the cliff face, accessed from the far left of Floor 2.