Yes you can delete custom attributes(and other artifacts) permanently from RQM/ETM repository(some info still in database though), see the details here:
Dashboards and work items are no longer publicly available, so some links may be invalid. We now provide similar information through other means.
Learn more here.