The next time you try to explain why you work at your current place of employ, don’t start talking about promotions or transfers or ease of commute. Those things are boring and might reveal more than you intend.
Instead, simply respond: “I was needed here.”
If you can simultaneously look heroic, even better. Instead of unintentionally alluding to your own personal work dramas or providing too much information, this evokes images of capes and Bat Signals. Especially effective when talking to comic book readers who might appreciate a heroic response even more.