The first secret cave you can find is in the side of the monument on Ybiza. But first, you need to progress far enough in the game to purchase the running ability from Axl's shop on Touryst Island. Now, you can run through the cracked wall to enter the secret cave.
Here is a video guide with English commentary!