The "Buy it Now" button is the unbranded version of Shopify's dynamic checkout buttons.
In order to hide the "buy it now" button in your theme and only have your "add to cart" button on the product page, head into Edit theme, and click on the gear icon on the top left of the theme editor.
Under Products tab, look for the "Show dynamic checkout button" setting and toggle the on/off button: