Skip to content

Commit 1ed926d

Browse files
authored
chore(dataflow): use n1 machine types for GPUs (GoogleCloudPlatform#6473)
## Description Fixes GoogleCloudPlatform#6436 Explicitly use N1 machine types for GPU samples, it looks like the Dataflow service changed the default machine type to E2 shared-core machine types, which are not compatible with GPUs. https://cloud.google.com/dataflow/docs/concepts/gpu-support#machine_types_specifications ## Checklist - [ ] I have followed [Sample Guidelines from AUTHORING_GUIDE.MD](https://github.com/GoogleCloudPlatform/python-docs-samples/blob/master/AUTHORING_GUIDE.md) - [ ] README is updated to include [all relevant information](https://github.com/GoogleCloudPlatform/python-docs-samples/blob/master/AUTHORING_GUIDE.md#readme-file) - [ ] **Tests** pass: `nox -s py-3.6` (see [Test Environment Setup](https://github.com/GoogleCloudPlatform/python-docs-samples/blob/master/AUTHORING_GUIDE.md#test-environment-setup)) - [ ] **Lint** pass: `nox -s lint` (see [Test Environment Setup](https://github.com/GoogleCloudPlatform/python-docs-samples/blob/master/AUTHORING_GUIDE.md#test-environment-setup)) - [ ] These samples need a new **API enabled** in testing projects to pass (let us know which ones) - [ ] These samples need a new/updated **env vars** in testing projects set to pass (let us know which ones) - [ ] Please **merge** this PR for me once it is approved. - [ ] This sample adds a new sample directory, and I updated the [CODEOWNERS file](https://github.com/GoogleCloudPlatform/python-docs-samples/blob/master/.github/CODEOWNERS) with the codeowners for this sample
1 parent 6bba089 commit 1ed926d

File tree

3 files changed

+3
-0
lines changed

3 files changed

+3
-0
lines changed

dataflow/gpu-examples/pytorch-minimal/run.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -44,6 +44,7 @@ steps:
4444
- --job_name=$_JOB_NAME
4545
- --temp_location=$_TEMP_LOCATION
4646
- --sdk_container_image=gcr.io/$PROJECT_ID/$_IMAGE
47+
- --machine_type=n1-standard-4
4748
- --experiment=worker_accelerator=type:$_GPU_TYPE;count:$_GPU_COUNT;install-nvidia-driver
4849
- --experiment=use_runner_v2
4950
- --disk_size_gb=50

dataflow/gpu-examples/tensorflow-landsat/run.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -47,6 +47,7 @@ steps:
4747
- --temp_location=$_TEMP_LOCATION
4848
- --worker_machine_type=custom-1-13312-ext
4949
- --sdk_container_image=gcr.io/$PROJECT_ID/$_IMAGE
50+
- --machine_type=n1-standard-4
5051
- --experiment=worker_accelerator=type:$_GPU_TYPE;count:$_GPU_COUNT;install-nvidia-driver
5152
- --experiment=use_runner_v2
5253
- --experiment=no_use_multiple_sdk_containers

dataflow/gpu-examples/tensorflow-minimal/run.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -44,6 +44,7 @@ steps:
4444
- --job_name=$_JOB_NAME
4545
- --temp_location=$_TEMP_LOCATION
4646
- --sdk_container_image=gcr.io/$PROJECT_ID/$_IMAGE
47+
- --machine_type=n1-standard-4
4748
- --experiment=worker_accelerator=type:$_GPU_TYPE;count:$_GPU_COUNT;install-nvidia-driver
4849
- --experiment=use_runner_v2
4950
- --experiment=no_use_multiple_sdk_containers

0 commit comments

Comments
 (0)