Exclude categories from meta problem

Hello, I’m currently using the following code to hide specific categories from displaying in the meta of my posts:

//* Remove categories from post meta
add_filter('get_the_terms', 'hide_categories_terms', 10, 3);
function hide_categories_terms($terms, $post_id, $taxonomy){
	$exclude = array(43, 44);

    if (!is_admin()) {
        foreach($terms as $key => $term){
            if(in_array($term->term_id, $exclude)) unset($terms[$key]);
        }
    }
    return $terms;
}

But I’ve realised this is causing issues when I edit and update posts as it takes the categories off completely. Any solutions to this?