Is there any way when typing Ctrl + p to open specific file, opened in new pane ?
Only by switching to that pane before you summon the overlay.