That wasn't it, or at least there was no noticable effect whether I selected executable or not. BUT I figured out what it was.
In Control Center -> Appearance & Themes -> Launch Feedback I unticked Enable Taskbar Notification and changed Busy Cursor to No Busy Cursor.
Problem Solved.