Prevent Logo From Getting Larger on Safari/Chrome on Mac

I have the header set to “Small fixed Header”. The logo transitions from real size to shrunked size just fine when I scroll down. However, when I scroll up to the very top of the page using Chrome or Safari on a mac, and the browser does its “rubberband” type of effect, the logo responds by getting even larger. Is there a way to prevent the logo from getting any larger than it’s regular size?