Updates are not only about new features
WordPress core, plugin and theme releases often include security fixes alongside improvements and new functionality. Once a vulnerability becomes known, an outdated component can become an easy target for automated attacks.
A sensible update process includes backups before significant changes, compatibility checks where appropriate and regular installation of available releases. Delaying updates without a specific reason simply extends the period during which a website remains exposed to a known issue.