All Credit to Kitty Skies guide:
To be able to access the Graveyard, you'll need to have gained all runes. (The Spider Rune is used to scale the wall to access this place)
After you beat Conjunctivius in the insufferable graveyard, instead of jumping down to Slumbering Sanctuary, there's actually a wall you can scale upwards. It's above the platform of the Slumbering Sanctuary Portal.
Prisoners Quarters -> Toxic Sewers -> Ancient Sewers -> Insufferable Crypt -> Graveyard