Instead of clicking the down arrow and selecting "Reply" from the list, we can set that button as default.
While your email is open, click the gear icon in the upper-right corner. From that drop-down menu, type in the Search field "Reply Options." Click the result.
You should be in the "Reply Settings" menu. Now click the radio button to "Reply" and save.