Best feature in Indesign is to jump back to last used field using a keyboard shortcut. I think this should definitely be part of every application, including Adobe XD. That is:

Activate last-used field in panel --- Default: Opt+Cmd+`

This should be a great addition to all the Adobe Applications.