In order to unlock this quest you must have lost at least 50 fruit by dying on the thorns.
Once that's accomplished go to the waterfall and head down to the slug gardeners area. Dive down (you'll need the divefish) and you find the secret cave.
You'll be asked to collect the souls, head to the gorilla statue to collect them. Go back to the secret cave and that's it.
Video guide: