Is there a way to pan the canvas without losing the selection?

I realize I can drag the selection to the edge of the current view and the canvas will pan, but I would like to be able to hold a modifier key and pan at will, without losing selection.

Hi Ray, this is currently not a feature so I will convert this question to an Idea and feature request.