I noticed this problem an I’m not the only one: Mouse click outside of selection tries to drag the text
Seems like the problem is very old. Is there a solution for this? In ST2 it works. In ST3 I have to press an arrow in order to deselect after a CTRL+A action.