For on-premise software applications, what do you recommend? On premise server? A hosted server? AWS? Azure?

In short, it depends.  You should consider your number of end users, existing IT staff, risk tolerance, and available working capital.  We rarely recommend going directly to AWS / Azure because the value of a hosting provider is in their pre-established environment and experience in connecting and supporting your ERP and 3rd party applications.  Many times hosting providers are re-packaging AWS behind the scenes to leverage their infrastructure then offering you their services on top of that – which are oftentimes necessary.  Talk to us about your set of circumstances and we can quickly help point you in the right direction.