Sure you can.

You can check if the link is a on the same domain as the local site.
If it is, then check the fragment.

Or even easier, check if the fragment contains slash or other “invalid” jQuery ID characters before checking if the element exists.