This achievement can't be missed because it is story related. In the last room of the game, you need to use your Oculus to go in the past and grab the key from the red hooded guy.
Walkthrough of Secret Library (Last Chapter):Full walkthrough of the game: