Basically, when a bond has higher energy, it means that you need to put much more effort into breaking it. That means that the bond is really happy the way it is and so therefore, very stable (and unreactive).
Think of potential energy as food. Lets say, our body digest all foods, but its easier to digest an apple, but its harder to digest nutella. This would be because its really easy to break the bonds of apple molecules, but its harder to break bonds of nutella. Therefore, we can say that apples have lower bond energy, and nutella has higher bond energy. Since its easier to break apart the apple, I'm going to get more potential energy out of eating an apple, than eating nutella, because my body has to put in more effort to break those really highly stable nutella bonds (with high bond energy), as opposed to the less stable, lower bond energy apple bonds.
I hope this helps!! :)