Implement a flag that indicates, if a custom field (set) is in use. Currently, if you would like to delete specific custom fields or a whole set, you don't really see, if they are still assigned in any of the 27 potential entities you can assign a custom field set to.

On top of that, we currently don't check if a custom field (set) is in use while deleting it.