Believe it or not, this seems to have been the the real cause of the
performance regression. I guess all these non-local references were adding a
lot of PLTs which end up triggering a bad lookup behavior.