wp-featherlight-disable-woocommerce.php

<?php
add_action( 'wp_enqueue_scripts', 'prefix_disable_wp_featherlight_woocommerce', 10 );
/**
 * Remove all required scripts and styles on WooCommerce pages.
 *
 * @since  0.1.0
 * @access public
 * @return void
 */
function prefix_disable_wp_featherlight_woocommerce() {
	if ( function_exists( 'is_woocommerce' ) && is_woocommerce() ) {
		add_filter( 'wp_featherlight_load_css', '__return_false' );
		add_filter( 'wp_featherlight_load_js',  '__return_false' );
	}
}

I know this is five years old, but this is helpful. Instead of disabling the filter hooks themselves, another thing to try is directly deregistering the handles:

add_action('wp_enqueue_scripts', function(){
	if ( function_exists('is_woocommerce') && is_woocommerce() ){
		wp_deregister_style('wp-featherlight');
		wp_deregister_script('wp-featherlight');
	}
});