The cave is the only way, once you enter the cave there should be 2 or 3 cave entrances to go further into the cave. Do trial and error as once you choose another entrance into a cave, another 2 or 3 cave entrances appear. You'll meet some dead ends along the way but eventually you should be able to go to the epic boss if the elite boss has been beaten, otherwise, it's bordered off.