After I've added a symbol from the symbols panel it would be a real timesaver if XD automatically switched back to the layers panel when selecting another element. This would remove the need to navigate to the bottom right of the window and switch the view.

From my experiences, users tend to drag a new symbol to their artboard then manipulate it or another element, very rarely navigating back to get another symbol.