I never really listened to the lyrics carefully until recently. I realized right away that it must be "caught in the act" but "Caught in a yak" was funnier. Especially because he sounds very distressed about it. Being caught in a yak sounds just about traumatizing enough to warrant his annoyance.