Hmm… It looks like this behaviour might be related to “look_at” in some way. It may be that, to get the behaviour that you’re looking for, an explicit mathematical approach (something along the lines of what I described here) might be called for.
(What I have there won’t work for all axes, I don’t think; there may be some work yet to be done to get it quite working properly.)