Cloud Demigration

Migrating away from clouds back to on-premise could be cheaper & more performant.

• clouds argue that ML machine learning
  infrastructure is too expensive & difficult to self-host. Also:
  • easily scale compute & storage
  • experts at efficiently maintaining & upgrading hardware
  • getting faster & more secure
• cloud cons:
  • real-time cloud inference still a challenge
  • hybrid (cloud + self-host) may be cheaper, e.g. co-location data centre, especially at scale (millions of dollars compute cost)
    • on-prem compute-heavy training, cloud serving
• on-prem pros (especially for smaller teams):
  • speed: removes cloud data transfer time
  • security: no need to trust clouds
  • availability: full control over hardware (not shared)
  • cutting-edge: don’t need to wait for cloud vendors to buy & make available latest hardware