Labels are available for the single-select filters and are basically just filter item name without any icon. They are minimally styled so that you could customize the appearance by applying your own CSS rules to suit your shop theme.
annasta Woocommerce Product Filters Support