To use the survival knife you first have to find your backpack and then you need to sneak up behind a mercenary while crouching and press/spam the
button to silently kill them.
For those that prefer a video guide I show this Achievement in my Walkthrough at 3:20 minutes into the video.