I have found a workaround, took me like 3 minutes to change about 232 instances of a font.
I noticed that Adobe XD actually allows you to "replace font" if it doesn't exist, so being the kind of person that i am, i went to C://Windows/Fonts and deleted that font (faced an issue) then opened XD again, it said that X font isn't found, well good for me, i right clicked on the "font not found" message, and i clicked on replace, and boom, all gone.
I have found a workaround, took me like 3 minutes to change about 232 instances of a font.
I noticed that Adobe XD actually allows you to "replace font" if it doesn't exist, so being the kind of person that i am, i went to C://Windows/Fonts and deleted that font (faced an issue) then opened XD again, it said that X font isn't found, well good for me, i right clicked on the "font not found" message, and i clicked on replace, and boom, all gone.
The issue i faced was that the font was protected by the system, so i followed this quick how-to
https://www.wikihow.com/Delete-Protected-System-Fonts-in-Windows-7
and by step 4, i was clear.
I hope i helped, and until Adobe gives us a good way to change this, this may be the only way to work around it.
Have a good day/night!