Using anchor links under large lazy load masonry gallery

Hello,
I have been working on this for hours and am hoping you can help me.
On this page:
https://www.thomashenthorne.com/2395-sobre-vista-road-sonoma-ca/

There are quick links at the top to go to different sections using anchor links (I have also tried code blocks BTW) to color sections. The links that go to the sections below the large masonry gallery with 70 plus photos set to lazy load do not work on the first click, they overshoot the target. If you go to the top of the page and try them again, they work perfectly. I think the page is having a hard time calculating the position to load them correctly. If I turn off lazy loading, they work fine.

I have tried this css amongst others:

/* Fix anchor link overshoot caused by sticky header */
#gallery,
#highlights,
#floorplans {
    scroll-margin-top: 40px;
}

#map {
    scroll-margin-top: 60px;
}

and have tried color sections, no color sections, code blocks, setting color section of the large photo gallery to 100% height so it knows what to calculate, etc.

Thank you for your help,
Rob