Deprecation
Managed Service for Apache Spark (formerly Dataproc on Compute Engine):
Managed Service for Apache Spark (formerly Dataproc on Compute Engine):
- Preconfigured Conda channels removed: Preconfigured conda channels (such as conda-forge) have been removed from configurations. All image version aliases now point to the latest image without conda channel configuration. Support for earlier images with conda channels configuration to be announced in upcoming release notes. Recommendation: Migrate to the latest image versions as soon as possible.
- Affected image versions: 1.3.96+, 1.4.81+, 1.5.92+, 2.0.161+, 2.1.119+, 2.2.87+, and 2.3.36+.
- Impact: Additional conda package installation using the dataproc:conda.packages cluster property or direct conda install <package> command will fail.
- Workaround:
- Use the <channel>::<package>==<version> specification for the dataproc:conda.packages property (for example: dataproc:conda.packages=conda-forge::pip==24.0).
- Specify the channel name on the command line when running conda install (for example: conda install <packages> -c conda-forge).
- google-guest-agent upgraded: Upgraded google-guest-agent on Debian and Rocky Linux images (remediating CVE-2026-33186).
- SSH metadata restriction: Stricter SSH metadata restrictions are enforced by default; metadata SSH keys mapped directly to root are ignored. Connect using a standard non-root user (such as dataproc) with sudo, or use Google Cloud OS Login.
Read the original announcement