I ran into a similar issue. I was using Vintage, highlighting lines in visual mode (SHIFT-V). I was able to select a wrapped line progressing downward, but was unable to remove that undo that selection by pressing up.
Same workaround works - disabling word wrap fixes the issue.
Is there a way to submit bugs?