It is currently not possible to delete properties via the small X (see screenshot) using a detailed privilege.

The deletion is currently bound to the technical privilege “product.deleter”, which cannot be found in the admin and can only be given via API/DB or the general deletion permission for products.

Using "Configure properties", you can also delete the properties via a detailed privilege, but it should also be possible to simply delete properties using the small X.