Use the “Clear filters cache” button to force the reset of filters’ product counts and other internal cache records at any needed moment.
Please note that in cases of extreme database overload with caching transients, you may need to push the button multiple times.