Yes. You can turn off Delivery Gateway in your Shopify store without uninstalling the app:
In the Shopify admin, open Apps > Delivery Gateway.
Go to App settings.
In the Application enablement block, uncheck Enable Delivery Gateway application.
Click Save.
To turn Delivery Gateway back on, check Enable Delivery Gateway application again and save. See also App settings.

