[WIP] Add the testing property of pipelines to bundles by tharunbhuk-db · Pull Request #7300 · databricks/cli

tharunbhuk-db · 2026-11-02T19:45:55Z

🥞 Stacked PR

stack/pipelines-test-pr1-command [Files changed]
- stack/pipelines-test-pr2-output [Files changed]
  - stack/pipelines-test-pr3-junit [Files changed]
    - stack/pipelines-test-pr4-bundles [Files changed] ← this PR

Design doc: https://docs.google.com/document/d/1atW-JG_hQu-G-YX-m1M7OodNZdH7LMc9H7CBlQAv5gw/edit

Changes

Add resources.pipelines.<key>.testing, with the test sources and test-only dependencies that databricks pipelines test runs with.
Relative paths in testing are translated like libraries. bundle validate catches common mistakes in test dependencies, such as package names, URLs and a requirements file without -r.
Local wheels in test dependencies are uploaded like other libraries, and the same-name check covers them, so two wheels with one file name cannot overwrite each other.
bundle plan shows changes to testing made outside the bundle, and bundle deploy undoes them.
A local project folder after -e, such as -e ./project[test], now maps to its deployed folder instead of failing.

Why

A bundle needs to declare where a pipeline's tests and their dependencies live. The CLI uses its own types and raw calls for testing, because the Go SDK does not have the field yet. Depends on API support for testing on Create and Edit. Keep as draft until then.

Tests

Unit tests for path translation, the dependency checks and the read-back.
Acceptance tests in acceptance/bundle/resources/pipelines/testing*, acceptance/bundle/environments/editable-folder and acceptance/pipelines/test. The live test also installs a local test dependency.

This pull request and its description were written by Isaac.

github-actions · 2026-11-02T19:59:03Z

Commit: 9c9d9c8a6 | Workflow run

Regression test report

Selected 14 changed tests (limit=20, 0 not selected)

19 tests: regression=19 unreleased=0 coverage=0 failing=0

test	branch	main (`aed6702`)	latest (v1.23.0)
TestAccept/bundle/environments/editable-folder/DMS=	✅	❌	❌
TestAccept/bundle/environments/editable-folder/DMS=true	✅	❌	❌
TestAccept/bundle/refschema/DMS=	✅	❌	❌
TestAccept/bundle/refschema/DMS=true	✅	❌	❌
TestAccept/bundle/resources/pipelines/testing-dependencies/DMS=	✅	❌	❌
TestAccept/bundle/resources/pipelines/testing-dependencies/DMS=true	✅	❌	❌
TestAccept/bundle/resources/pipelines/testing-same-name-libraries/DMS=	✅	❌	❌
TestAccept/bundle/resources/pipelines/testing-same-name-libraries/DMS=true	✅	❌	❌
TestAccept/bundle/resources/pipelines/testing/DMS=	✅	❌	❌
TestAccept/bundle/resources/pipelines/testing/DMS=true	✅	❌	❌
TestAccept/pipelines/databricks-cli-help	✅	❌	❌
TestAccept/pipelines/test/arguments	✅	❌	❌
TestAccept/pipelines/test/immutable	✅	❌	❌
TestAccept/pipelines/test/live	✅	❌	❌
TestAccept/pipelines/test/many-cases	✅	❌	❌
TestAccept/pipelines/test/pipeline-id	✅	❌	❌
TestAccept/pipelines/test/results	✅	❌	❌
TestAccept/pipelines/test/run-control	✅	❌	❌
TestAccept/pipelines/test/selection	✅	❌	❌

TestAccept/bundle/environments/editable-folder/DMS=: branch ✅ | main (aed6702) ❌ | latest (v1.23.0) ❌

main (aed6702):

acceptance_test.go:1341: 
        	Error Trace:	/home/runner/work/cli/cli/libs/testdiff/testdiff.go:22
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1341
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1082
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:659
        	Error:      	Not equal: 
        	            	expected: "\n>>> [CLI] bundle validate -o json\n{\n  \"job\": [\n    \"-e /Workspace/Users/[USERNAME]/.bundle/editable-folder/default/files/project\"\n  ],\n  \"pipeline\": [\n    \"-e /Workspace/Users/[USERNAME]/.bundle/editable-folder/default/files/project\"\n  ],\n  \"testing\": [\n    \"-e /Workspace/Users/[USERNAME]/.bundle/editable-folder/default/files/project[test]\"\n  ]\n}\n"
        	            	actual  : "\n>>> [CLI] bundle validate -o json\nWarning: unknown field: testing\n  at resources.pipelines.my_pipeline\n  in databricks.yml:27:7\n\nError: unable to determine if [TEST_TMP_DIR]/project is not a notebook: read [TEST_TMP_DIR]/project: is a directory\n\n{\n  \"job\": [\n    \"-e project\"\n  ],\n  \"pipeline\": [\n    \"-e project\"\n  ],\n  \"testing\": null\n}\n\nExit code: 1\n"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -2,13 +2,19 @@
        	            	 >>> [CLI] bundle validate -o json
        	            	+Warning: unknown field: testing
        	            	+  at resources.pipelines.my_pipeline
        	            	+  in databricks.yml:27:7
        	            	+
        	            	+Error: unable to determine if [TEST_TMP_DIR]/project is not a notebook: read [TEST_TMP_DIR]/project: is a directory
        	            	+
        	            	 {
        	            	   "job": [
        	            	-    "-e /Workspace/Users/[USERNAME]/.bundle/editable-folder/default/files/project"
        	            	+    "-e project"
        	            	   ],
        	            	   "pipeline": [
        	            	-    "-e /Workspace/Users/[USERNAME]/.bundle/editable-folder/default/files/project"
        	            	+    "-e project"
        	            	   ],
        	            	-  "testing": [
        	            	-    "-e /Workspace/Users/[USERNAME]/.bundle/editable-folder/default/files/project[test]"
        	            	-  ]
        	            	+  "testing": null
        	            	 }
        	            	 
        	            	+Exit code: 1
        	            	+
        	Test:       	TestAccept/bundle/environments/editable-folder/DMS=
        	Messages:   	bundle/environments/editable-folder/output.txt vs /tmp/TestAcceptbundleenvironmentseditable-folderDMS=3985880016/002/output.txt

latest (v1.23.0): same output as main (aed6702)

TestAccept/bundle/environments/editable-folder/DMS=true: branch ✅ | main (aed6702) ❌ | latest (v1.23.0) ❌

main (aed6702):

acceptance_test.go:1341: 
        	Error Trace:	/home/runner/work/cli/cli/libs/testdiff/testdiff.go:22
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1341
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1082
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:659
        	Error:      	Not equal: 
        	            	expected: "\n>>> [CLI] bundle validate -o json\n{\n  \"job\": [\n    \"-e /Workspace/Users/[USERNAME]/.bundle/editable-folder/default/files/project\"\n  ],\n  \"pipeline\": [\n    \"-e /Workspace/Users/[USERNAME]/.bundle/editable-folder/default/files/project\"\n  ],\n  \"testing\": [\n    \"-e /Workspace/Users/[USERNAME]/.bundle/editable-folder/default/files/project[test]\"\n  ]\n}\n"
        	            	actual  : "\n>>> [CLI] bundle validate -o json\nWarning: unknown field: testing\n  at resources.pipelines.my_pipeline\n  in databricks.yml:27:7\n\nError: unable to determine if [TEST_TMP_DIR]/project is not a notebook: read [TEST_TMP_DIR]/project: is a directory\n\n{\n  \"job\": [\n    \"-e project\"\n  ],\n  \"pipeline\": [\n    \"-e project\"\n  ],\n  \"testing\": null\n}\n\nExit code: 1\n"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -2,13 +2,19 @@
        	            	 >>> [CLI] bundle validate -o json
        	            	+Warning: unknown field: testing
        	            	+  at resources.pipelines.my_pipeline
        	            	+  in databricks.yml:27:7
        	            	+
        	            	+Error: unable to determine if [TEST_TMP_DIR]/project is not a notebook: read [TEST_TMP_DIR]/project: is a directory
        	            	+
        	            	 {
        	            	   "job": [
        	            	-    "-e /Workspace/Users/[USERNAME]/.bundle/editable-folder/default/files/project"
        	            	+    "-e project"
        	            	   ],
        	            	   "pipeline": [
        	            	-    "-e /Workspace/Users/[USERNAME]/.bundle/editable-folder/default/files/project"
        	            	+    "-e project"
        	            	   ],
        	            	-  "testing": [
        	            	-    "-e /Workspace/Users/[USERNAME]/.bundle/editable-folder/default/files/project[test]"
        	            	-  ]
        	            	+  "testing": null
        	            	 }
        	            	 
        	            	+Exit code: 1
        	            	+
        	Test:       	TestAccept/bundle/environments/editable-folder/DMS=true
        	Messages:   	bundle/environments/editable-folder/output.txt vs /tmp/TestAcceptbundleenvironmentseditable-folderDMS=true977406283/002/output.txt

latest (v1.23.0): same output as main (aed6702)

TestAccept/bundle/refschema/DMS=: branch ✅ | main (aed6702) ❌ | latest (v1.23.0) ❌

main (aed6702):

acceptance_test.go:1341: Diff:
        --- bundle/refschema/output/pipelines.txt
        +++ /tmp/TestAcceptbundlerefschemaDMS=2793104948/001/output/pipelines.txt
        @@ -867,14 +867,6 @@
         resources.pipelines.*.tags	map[string]string	ALL
         resources.pipelines.*.tags.*	string	ALL
         resources.pipelines.*.target	string	ALL
        -resources.pipelines.*.testing	*resources.PipelineTesting	ALL
        -resources.pipelines.*.testing.environment	*resources.PipelineTestEnvironment	ALL
        -resources.pipelines.*.testing.environment.dependencies	[]string	ALL
        -resources.pipelines.*.testing.environment.dependencies[*]	string	ALL
        -resources.pipelines.*.testing.sources	[]resources.PipelineTestSource	ALL
        -resources.pipelines.*.testing.sources[*]	resources.PipelineTestSource	ALL
        -resources.pipelines.*.testing.sources[*].glob	*pipelines.PathPattern	ALL
        -resources.pipelines.*.testing.sources[*].glob.include	string	ALL
         resources.pipelines.*.trigger	*pipelines.PipelineTrigger	ALL
         resources.pipelines.*.trigger.cron	*pipelines.CronTrigger	ALL
         resources.pipelines.*.trigger.cron.quartz_cron_schedule	string	ALL

latest (v1.23.0): same output as main (aed6702)

TestAccept/bundle/refschema/DMS=true: branch ✅ | main (aed6702) ❌ | latest (v1.23.0) ❌

main (aed6702):

acceptance_test.go:1341: Diff:
        --- bundle/refschema/output/pipelines.txt
        +++ /tmp/TestAcceptbundlerefschemaDMS=true3088444186/001/output/pipelines.txt
        @@ -867,14 +867,6 @@
         resources.pipelines.*.tags	map[string]string	ALL
         resources.pipelines.*.tags.*	string	ALL
         resources.pipelines.*.target	string	ALL
        -resources.pipelines.*.testing	*resources.PipelineTesting	ALL
        -resources.pipelines.*.testing.environment	*resources.PipelineTestEnvironment	ALL
        -resources.pipelines.*.testing.environment.dependencies	[]string	ALL
        -resources.pipelines.*.testing.environment.dependencies[*]	string	ALL
        -resources.pipelines.*.testing.sources	[]resources.PipelineTestSource	ALL
        -resources.pipelines.*.testing.sources[*]	resources.PipelineTestSource	ALL
        -resources.pipelines.*.testing.sources[*].glob	*pipelines.PathPattern	ALL
        -resources.pipelines.*.testing.sources[*].glob.include	string	ALL
         resources.pipelines.*.trigger	*pipelines.PipelineTrigger	ALL
         resources.pipelines.*.trigger.cron	*pipelines.CronTrigger	ALL
         resources.pipelines.*.trigger.cron.quartz_cron_schedule	string	ALL
        
FAIL

latest (v1.23.0):

acceptance_test.go:1341: Diff:
        --- bundle/refschema/output/pipelines.txt
        +++ /tmp/TestAcceptbundlerefschemaDMS=true1715255534/001/output/pipelines.txt
        @@ -867,14 +867,6 @@
         resources.pipelines.*.tags	map[string]string	ALL
         resources.pipelines.*.tags.*	string	ALL
         resources.pipelines.*.target	string	ALL
        -resources.pipelines.*.testing	*resources.PipelineTesting	ALL
        -resources.pipelines.*.testing.environment	*resources.PipelineTestEnvironment	ALL
        -resources.pipelines.*.testing.environment.dependencies	[]string	ALL
        -resources.pipelines.*.testing.environment.dependencies[*]	string	ALL
        -resources.pipelines.*.testing.sources	[]resources.PipelineTestSource	ALL
        -resources.pipelines.*.testing.sources[*]	resources.PipelineTestSource	ALL
        -resources.pipelines.*.testing.sources[*].glob	*pipelines.PathPattern	ALL
        -resources.pipelines.*.testing.sources[*].glob.include	string	ALL
         resources.pipelines.*.trigger	*pipelines.PipelineTrigger	ALL
         resources.pipelines.*.trigger.cron	*pipelines.CronTrigger	ALL
         resources.pipelines.*.trigger.cron.quartz_cron_schedule	string	ALL

TestAccept/bundle/resources/pipelines/testing-dependencies/DMS=: branch ✅ | main (aed6702) ❌ | latest (v1.23.0) ❌

main (aed6702):

acceptance_test.go:1341: Diff:
        --- bundle/resources/pipelines/testing-dependencies/output.txt
        +++ /tmp/TestAcceptbundleresourcespipelinestesting-dependenciesDMS=2550458231/002/output.txt
        @@ -1,39 +1,17 @@
         
         >>> musterr [CLI] bundle validate
        -Error: testing.environment.dependencies must point at files, not "faker==33.0"
        -  at resources.pipelines.orders.testing.environment.dependencies[3]
        -  in databricks.yml:19:15
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:8:7
         
        -A test dependency is a project folder, a wheel, or a requirements file after -r, in the bundle, under /Workspace/, or under /Volumes/. Declare test packages in a project file, such as the test extra of a pyproject.toml, and reference its folder, for example -e ./project[test]. For a path in the bundle, use -e or -r followed by a space. URLs, other pip options, and .. are not supported.
        -
        -Error: testing.environment.dependencies must point at files, not "git+https://github.com/example/helpers"
        -  at resources.pipelines.orders.testing.environment.dependencies[4]
        -  in databricks.yml:20:15
        -
        -A test dependency is a project folder, a wheel, or a requirements file after -r, in the bundle, under /Workspace/, or under /Volumes/. Declare test packages in a project file, such as the test extra of a pyproject.toml, and reference its folder, for example -e ./project[test]. For a path in the bundle, use -e or -r followed by a space. URLs, other pip options, and .. are not supported.
        -
        -Error: testing.environment.dependencies needs -r before the requirements file "/Workspace/Shared/orders/requirements.txt"
        -  at resources.pipelines.orders.testing.environment.dependencies[5]
        -  in databricks.yml:21:15
        -
        -Without -r, pip treats the file as a package to install. For example: -r ./tests/requirements.txt.
        -
        -Error: testing.environment.dependencies must point at files, not "--requirement ./orders/requirements.txt"
        -  at resources.pipelines.orders.testing.environment.dependencies[6]
        -  in databricks.yml:22:15
        -
        -A test dependency is a project folder, a wheel, or a requirements file after -r, in the bundle, under /Workspace/, or under /Volumes/. Declare test packages in a project file, such as the test extra of a pyproject.toml, and reference its folder, for example -e ./project[test]. For a path in the bundle, use -e or -r followed by a space. URLs, other pip options, and .. are not supported.
        -
        -Error: testing.environment.dependencies must point at files, not "/Workspace/Shared/orders -i https://example.com/simple"
        -  at resources.pipelines.orders.testing.environment.dependencies[7]
        -  in databricks.yml:23:15
        -
        -A test dependency is a project folder, a wheel, or a requirements file after -r, in the bundle, under /Workspace/, or under /Volumes/. Declare test packages in a project file, such as the test extra of a pyproject.toml, and reference its folder, for example -e ./project[test]. For a path in the bundle, use -e or -r followed by a space. URLs, other pip options, and .. are not supported.
        -
         Name: pipeline-testing-dependencies
         Target: default
         Workspace:
           User: [USERNAME]
           Path: /Workspace/Users/[USERNAME]/.bundle/pipeline-testing-dependencies/default
         
        -Found 5 errors
        +Found 1 warning
        +
        +Unexpected success
        +
        +Exit code: 1
        
    acceptance_test.go:1131: Test produced unexpected files:
        .databricks/.gitignore

latest (v1.23.0): same output as main (aed6702)

TestAccept/bundle/resources/pipelines/testing-dependencies/DMS=true: branch ✅ | main (aed6702) ❌ | latest (v1.23.0) ❌

main (aed6702):

acceptance_test.go:1341: Diff:
        --- bundle/resources/pipelines/testing-dependencies/output.txt
        +++ /tmp/TestAcceptbundleresourcespipelinestesting-dependenciesDMS=t541969024/002/output.txt
        @@ -1,39 +1,17 @@
         
         >>> musterr [CLI] bundle validate
        -Error: testing.environment.dependencies must point at files, not "faker==33.0"
        -  at resources.pipelines.orders.testing.environment.dependencies[3]
        -  in databricks.yml:19:15
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:8:7
         
        -A test dependency is a project folder, a wheel, or a requirements file after -r, in the bundle, under /Workspace/, or under /Volumes/. Declare test packages in a project file, such as the test extra of a pyproject.toml, and reference its folder, for example -e ./project[test]. For a path in the bundle, use -e or -r followed by a space. URLs, other pip options, and .. are not supported.
        -
        -Error: testing.environment.dependencies must point at files, not "git+https://github.com/example/helpers"
        -  at resources.pipelines.orders.testing.environment.dependencies[4]
        -  in databricks.yml:20:15
        -
        -A test dependency is a project folder, a wheel, or a requirements file after -r, in the bundle, under /Workspace/, or under /Volumes/. Declare test packages in a project file, such as the test extra of a pyproject.toml, and reference its folder, for example -e ./project[test]. For a path in the bundle, use -e or -r followed by a space. URLs, other pip options, and .. are not supported.
        -
        -Error: testing.environment.dependencies needs -r before the requirements file "/Workspace/Shared/orders/requirements.txt"
        -  at resources.pipelines.orders.testing.environment.dependencies[5]
        -  in databricks.yml:21:15
        -
        -Without -r, pip treats the file as a package to install. For example: -r ./tests/requirements.txt.
        -
        -Error: testing.environment.dependencies must point at files, not "--requirement ./orders/requirements.txt"
        -  at resources.pipelines.orders.testing.environment.dependencies[6]
        -  in databricks.yml:22:15
        -
        -A test dependency is a project folder, a wheel, or a requirements file after -r, in the bundle, under /Workspace/, or under /Volumes/. Declare test packages in a project file, such as the test extra of a pyproject.toml, and reference its folder, for example -e ./project[test]. For a path in the bundle, use -e or -r followed by a space. URLs, other pip options, and .. are not supported.
        -
        -Error: testing.environment.dependencies must point at files, not "/Workspace/Shared/orders -i https://example.com/simple"
        -  at resources.pipelines.orders.testing.environment.dependencies[7]
        -  in databricks.yml:23:15
        -
        -A test dependency is a project folder, a wheel, or a requirements file after -r, in the bundle, under /Workspace/, or under /Volumes/. Declare test packages in a project file, such as the test extra of a pyproject.toml, and reference its folder, for example -e ./project[test]. For a path in the bundle, use -e or -r followed by a space. URLs, other pip options, and .. are not supported.
        -
         Name: pipeline-testing-dependencies
         Target: default
         Workspace:
           User: [USERNAME]
           Path: /Workspace/Users/[USERNAME]/.bundle/pipeline-testing-dependencies/default
         
        -Found 5 errors
        +Found 1 warning
        +
        +Unexpected success
        +
        +Exit code: 1
        
    acceptance_test.go:1131: Test produced unexpected files:
        .databricks/.gitignore

latest (v1.23.0): same output as main (aed6702)

TestAccept/bundle/resources/pipelines/testing-same-name-libraries/DMS=: branch ✅ | main (aed6702) ❌ | latest (v1.23.0) ❌

main (aed6702):

acceptance_test.go:1341: 
        	Error Trace:	/home/runner/work/cli/cli/libs/testdiff/testdiff.go:22
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1341
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1082
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:659
        	Error:      	Not equal: 
        	            	expected: "\n>>> errcode [CLI] bundle deploy\nError: Duplicate local library names: test_helpers-0.1-py3-none-any.whl\n  at resources.pipelines.orders.environment.dependencies[0]\n     resources.pipelines.orders.testing.environment.dependencies[0]\n  in databricks.yml:13:13\n     databricks.yml:21:15\n\nLocal library names must be unique but found libraries with the same name: pipeline/test_helpers-0.1-py3-none-any.whl, tests/test_helpers-0.1-py3-none-any.whl\n\n\nExit code: 1\n"
        	            	actual  : "\n>>> errcode [CLI] bundle deploy\nWarning: unknown field: testing\n  at resources.pipelines.orders\n  in databricks.yml:14:7\n\nUploading pipeline/test_helpers-0.1-py3-none-any.whl...\nUploading bundle files to /Workspace/Users/[USERNAME]/.bundle/pipeline-testing-same-name-libraries/default/files...\nCreated pipelines.orders\nFiles: 5 uploaded, 0 deleted\nResources: 1 created, 0 changed, 0 deleted, 0 unchanged\n"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -2,12 +2,11 @@
        	            	 >>> errcode [CLI] bundle deploy
        	            	-Error: Duplicate local library names: test_helpers-0.1-py3-none-any.whl
        	            	-  at resources.pipelines.orders.environment.dependencies[0]
        	            	-     resources.pipelines.orders.testing.environment.dependencies[0]
        	            	-  in databricks.yml:13:13
        	            	-     databricks.yml:21:15
        	            	+Warning: unknown field: testing
        	            	+  at resources.pipelines.orders
        	            	+  in databricks.yml:14:7
        	            	 
        	            	-Local library names must be unique but found libraries with the same name: pipeline/test_helpers-0.1-py3-none-any.whl, tests/test_helpers-0.1-py3-none-any.whl
        	            	+Uploading pipeline/test_helpers-0.1-py3-none-any.whl...
        	            	+Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/pipeline-testing-same-name-libraries/default/files...
        	            	+Created pipelines.orders
        	            	+Files: 5 uploaded, 0 deleted
        	            	+Resources: 1 created, 0 changed, 0 deleted, 0 unchanged
        	            	 
        	            	-
        	            	-Exit code: 1
        	            	-
        	Test:       	TestAccept/bundle/resources/pipelines/testing-same-name-libraries/DMS=
        	Messages:   	bundle/resources/pipelines/testing-same-name-libraries/output.txt vs /tmp/TestAcceptbundleresourcespipelinestesting-same-name-librarie333008857/002/output.txt

latest (v1.23.0): same output as main (aed6702)

TestAccept/bundle/resources/pipelines/testing-same-name-libraries/DMS=true: branch ✅ | main (aed6702) ❌ | latest (v1.23.0) ❌

main (aed6702):

acceptance_test.go:1341: 
        	Error Trace:	/home/runner/work/cli/cli/libs/testdiff/testdiff.go:22
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1341
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1082
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:659
        	Error:      	Not equal: 
        	            	expected: "\n>>> errcode [CLI] bundle deploy\nError: Duplicate local library names: test_helpers-0.1-py3-none-any.whl\n  at resources.pipelines.orders.environment.dependencies[0]\n     resources.pipelines.orders.testing.environment.dependencies[0]\n  in databricks.yml:13:13\n     databricks.yml:21:15\n\nLocal library names must be unique but found libraries with the same name: pipeline/test_helpers-0.1-py3-none-any.whl, tests/test_helpers-0.1-py3-none-any.whl\n\n\nExit code: 1\n"
        	            	actual  : "\n>>> errcode [CLI] bundle deploy\nWarning: unknown field: testing\n  at resources.pipelines.orders\n  in databricks.yml:14:7\n\nUploading pipeline/test_helpers-0.1-py3-none-any.whl...\nUploading bundle files to /Workspace/Users/[USERNAME]/.bundle/pipeline-testing-same-name-libraries/default/files...\nCreated pipelines.orders\nFiles: 5 uploaded, 0 deleted\nResources: 1 created, 0 changed, 0 deleted, 0 unchanged\n"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -2,12 +2,11 @@
        	            	 >>> errcode [CLI] bundle deploy
        	            	-Error: Duplicate local library names: test_helpers-0.1-py3-none-any.whl
        	            	-  at resources.pipelines.orders.environment.dependencies[0]
        	            	-     resources.pipelines.orders.testing.environment.dependencies[0]
        	            	-  in databricks.yml:13:13
        	            	-     databricks.yml:21:15
        	            	+Warning: unknown field: testing
        	            	+  at resources.pipelines.orders
        	            	+  in databricks.yml:14:7
        	            	 
        	            	-Local library names must be unique but found libraries with the same name: pipeline/test_helpers-0.1-py3-none-any.whl, tests/test_helpers-0.1-py3-none-any.whl
        	            	+Uploading pipeline/test_helpers-0.1-py3-none-any.whl...
        	            	+Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/pipeline-testing-same-name-libraries/default/files...
        	            	+Created pipelines.orders
        	            	+Files: 5 uploaded, 0 deleted
        	            	+Resources: 1 created, 0 changed, 0 deleted, 0 unchanged
        	            	 
        	            	-
        	            	-Exit code: 1
        	            	-
        	Test:       	TestAccept/bundle/resources/pipelines/testing-same-name-libraries/DMS=true
        	Messages:   	bundle/resources/pipelines/testing-same-name-libraries/output.txt vs /tmp/TestAcceptbundleresourcespipelinestesting-same-name-librarie3003879244/002/output.txt

latest (v1.23.0): same output as main (aed6702)

TestAccept/bundle/resources/pipelines/testing/DMS=: branch ✅ | main (aed6702) ❌ | latest (v1.23.0) ❌

main (aed6702):

acceptance_test.go:1341: Diff:
        --- bundle/resources/pipelines/testing/output.txt
        +++ /tmp/TestAcceptbundleresourcespipelinestestingDMS=3356233575/002/output.txt
        @@ -1,25 +1,17 @@
         
         === Relative test paths resolve to the deployed workspace paths
         >>> [CLI] bundle validate -o json
        -{
        -  "environment": {
        -    "dependencies": [
        -      "--editable /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files[test]",
        -      "-r /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/requirements.txt",
        -      "./dist/*.whl"
        -    ]
        -  },
        -  "sources": [
        -    {
        -      "glob": {
        -        "include": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/**"
        -      }
        -    }
        -  ]
        -}
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
         
        +null
        +
         >>> [CLI] bundle deploy
        -Uploading dist/test_helpers-0.1-py3-none-any.whl...
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
        +
         Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files...
         Created pipelines.orders
         Files: 5 uploaded, 0 deleted
        @@ -43,164 +33,73 @@
                 }
               }
             ],
        -    "name": "orders",
        -    "testing": {
        -      "sources": [
        -        {
        -          "glob": {
        -            "include": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/**"
        -          }
        -        }
        -      ],
        -      "environment": {
        -        "dependencies": [
        -          "--editable /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files[test]",
        -          "-r /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/requirements.txt",
        -          "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/artifacts/.internal/test_helpers-0.1-py3-none-any.whl"
        -        ]
        -      }
        -    }
        +    "name": "orders"
           }
         }
         
         === No changes after the deploy
         >>> [CLI] bundle plan
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
        +
         Plan: 0 to add, 0 to change, 0 to delete, 1 unchanged
         
         === A remote edit that drops testing shows in the plan
         >>> [CLI] bundle plan -o json
        -{
        -  "action": "update",
        -  "old": {
        -    "sources": [
        -      {
        -        "glob": {
        -          "include": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/**"
        -        }
        -      }
        -    ],
        -    "environment": {
        -      "dependencies": [
        -        "--editable /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files[test]",
        -        "-r /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/requirements.txt",
        -        "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/artifacts/.internal/test_helpers-0.1-py3-none-any.whl"
        -      ]
        -    }
        -  },
        -  "new": {
        -    "sources": [
        -      {
        -        "glob": {
        -          "include": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/**"
        -        }
        -      }
        -    ],
        -    "environment": {
        -      "dependencies": [
        -        "--editable /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files[test]",
        -        "-r /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/requirements.txt",
        -        "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/artifacts/.internal/test_helpers-0.1-py3-none-any.whl"
        -      ]
        -    }
        -  }
        -}
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
         
        +null
        +
         >>> [CLI] bundle deploy
        -Uploading dist/test_helpers-0.1-py3-none-any.whl...
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
        +
         Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files...
        -Updated pipelines.orders
         Files: 1 uploaded, 0 deleted
        -Resources: 0 created, 1 changed, 0 deleted, 0 unchanged
        +Resources: 0 created, 0 changed, 0 deleted, 1 unchanged
         
         >>> [CLI] bundle plan
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
        +
         Plan: 0 to add, 0 to change, 0 to delete, 1 unchanged
         
         === Changing testing updates the pipeline
         >>> update_file.py databricks.yml ./tests/** ./tests/unit/**
         
         >>> [CLI] bundle plan
        -update pipelines.orders
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
         
        -Plan: 0 to add, 1 to change, 0 to delete, 0 unchanged
        +Plan: 0 to add, 0 to change, 0 to delete, 1 unchanged
         
         >>> [CLI] bundle deploy
        -Uploading dist/test_helpers-0.1-py3-none-any.whl...
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
        +
         Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files...
        -Updated pipelines.orders
         Files: 1 uploaded, 0 deleted
        -Resources: 0 created, 1 changed, 0 deleted, 0 unchanged
        +Resources: 0 created, 0 changed, 0 deleted, 1 unchanged
         
         >>> print_requests.py //api/2.0/pipelines --nostamp
        -{
        -  "method": "PUT",
        -  "path": "/api/2.0/pipelines/[ORDERS_ID]",
        -  "body": {
        -    "channel": "CURRENT",
        -    "deployment": {
        -      "kind": "BUNDLE",
        -      "metadata_file_path": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/state/metadata.json"
        -    },
        -    "edition": "ADVANCED",
        -    "libraries": [
        -      {
        -        "glob": {
        -          "include": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/transformations/**"
        -        }
        -      }
        -    ],
        -    "name": "orders",
        -    "testing": {
        -      "sources": [
        -        {
        -          "glob": {
        -            "include": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/unit/**"
        -          }
        -        }
        -      ],
        -      "environment": {
        -        "dependencies": [
        -          "--editable /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files[test]",
        -          "-r /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/requirements.txt",
        -          "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/artifacts/.internal/test_helpers-0.1-py3-none-any.whl"
        -        ]
        -      }
        -    }
        -  }
        -}
         
         === Removing testing sends an update without it
         >>> [CLI] bundle plan
        -update pipelines.orders
        +Plan: 0 to add, 0 to change, 0 to delete, 1 unchanged
         
... (35 more lines truncated, raise DATABRICKS_CLI_TEST_MAX_LOG to see more)

latest (v1.23.0): same output as main (aed6702)

TestAccept/bundle/resources/pipelines/testing/DMS=true: branch ✅ | main (aed6702) ❌ | latest (v1.23.0) ❌

main (aed6702):

acceptance_test.go:1341: Diff:
        --- bundle/resources/pipelines/testing/output.txt
        +++ /tmp/TestAcceptbundleresourcespipelinestestingDMS=true4253938823/002/output.txt
        @@ -1,25 +1,17 @@
         
         === Relative test paths resolve to the deployed workspace paths
         >>> [CLI] bundle validate -o json
        -{
        -  "environment": {
        -    "dependencies": [
        -      "--editable /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files[test]",
        -      "-r /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/requirements.txt",
        -      "./dist/*.whl"
        -    ]
        -  },
        -  "sources": [
        -    {
        -      "glob": {
        -        "include": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/**"
        -      }
        -    }
        -  ]
        -}
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
         
        +null
        +
         >>> [CLI] bundle deploy
        -Uploading dist/test_helpers-0.1-py3-none-any.whl...
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
        +
         Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files...
         Created pipelines.orders
         Files: 5 uploaded, 0 deleted
        @@ -43,164 +33,73 @@
                 }
               }
             ],
        -    "name": "orders",
        -    "testing": {
        -      "sources": [
        -        {
        -          "glob": {
        -            "include": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/**"
        -          }
        -        }
        -      ],
        -      "environment": {
        -        "dependencies": [
        -          "--editable /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files[test]",
        -          "-r /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/requirements.txt",
        -          "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/artifacts/.internal/test_helpers-0.1-py3-none-any.whl"
        -        ]
        -      }
        -    }
        +    "name": "orders"
           }
         }
         
         === No changes after the deploy
         >>> [CLI] bundle plan
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
        +
         Plan: 0 to add, 0 to change, 0 to delete, 1 unchanged
         
         === A remote edit that drops testing shows in the plan
         >>> [CLI] bundle plan -o json
        -{
        -  "action": "update",
        -  "old": {
        -    "sources": [
        -      {
        -        "glob": {
        -          "include": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/**"
        -        }
        -      }
        -    ],
        -    "environment": {
        -      "dependencies": [
        -        "--editable /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files[test]",
        -        "-r /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/requirements.txt",
        -        "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/artifacts/.internal/test_helpers-0.1-py3-none-any.whl"
        -      ]
        -    }
        -  },
        -  "new": {
        -    "sources": [
        -      {
        -        "glob": {
        -          "include": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/**"
        -        }
        -      }
        -    ],
        -    "environment": {
        -      "dependencies": [
        -        "--editable /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files[test]",
        -        "-r /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/requirements.txt",
        -        "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/artifacts/.internal/test_helpers-0.1-py3-none-any.whl"
        -      ]
        -    }
        -  }
        -}
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
         
        +null
        +
         >>> [CLI] bundle deploy
        -Uploading dist/test_helpers-0.1-py3-none-any.whl...
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
        +
         Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files...
        -Updated pipelines.orders
         Files: 1 uploaded, 0 deleted
        -Resources: 0 created, 1 changed, 0 deleted, 0 unchanged
        +Resources: 0 created, 0 changed, 0 deleted, 1 unchanged
         
         >>> [CLI] bundle plan
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
        +
         Plan: 0 to add, 0 to change, 0 to delete, 1 unchanged
         
         === Changing testing updates the pipeline
         >>> update_file.py databricks.yml ./tests/** ./tests/unit/**
         
         >>> [CLI] bundle plan
        -update pipelines.orders
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
         
        -Plan: 0 to add, 1 to change, 0 to delete, 0 unchanged
        +Plan: 0 to add, 0 to change, 0 to delete, 1 unchanged
         
         >>> [CLI] bundle deploy
        -Uploading dist/test_helpers-0.1-py3-none-any.whl...
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
        +
         Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files...
        -Updated pipelines.orders
         Files: 1 uploaded, 0 deleted
        -Resources: 0 created, 1 changed, 0 deleted, 0 unchanged
        +Resources: 0 created, 0 changed, 0 deleted, 1 unchanged
         
         >>> print_requests.py //api/2.0/pipelines --nostamp
        -{
        -  "method": "PUT",
        -  "path": "/api/2.0/pipelines/[ORDERS_ID]",
        -  "body": {
        -    "channel": "CURRENT",
        -    "deployment": {
        -      "kind": "BUNDLE",
        -      "metadata_file_path": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/state/metadata.json"
        -    },
        -    "edition": "ADVANCED",
        -    "libraries": [
        -      {
        -        "glob": {
        -          "include": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/transformations/**"
        -        }
        -      }
        -    ],
        -    "name": "orders",
        -    "testing": {
        -      "sources": [
        -        {
        -          "glob": {
        -            "include": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/unit/**"
        -          }
        -        }
        -      ],
        -      "environment": {
        -        "dependencies": [
        -          "--editable /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files[test]",
        -          "-r /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/requirements.txt",
        -          "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/artifacts/.internal/test_helpers-0.1-py3-none-any.whl"
        -        ]
        -      }
        -    }
        -  }
        -}
         
         === Removing testing sends an update without it
         >>> [CLI] bundle plan
        -update pipelines.orders
        +Plan: 0 to add, 0 to change, 0 to delete, 1 unchanged
         
... (35 more lines truncated, raise DATABRICKS_CLI_TEST_MAX_LOG to see more)

latest (v1.23.0):

acceptance_test.go:1341: Diff:
        --- bundle/resources/pipelines/testing/output.txt
        +++ /tmp/TestAcceptbundleresourcespipelinestestingDMS=true2327709612/002/output.txt
        @@ -1,25 +1,17 @@
         
         === Relative test paths resolve to the deployed workspace paths
         >>> [CLI] bundle validate -o json
        -{
        -  "environment": {
        -    "dependencies": [
        -      "--editable /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files[test]",
        -      "-r /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/requirements.txt",
        -      "./dist/*.whl"
        -    ]
        -  },
        -  "sources": [
        -    {
        -      "glob": {
        -        "include": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/**"
        -      }
        -    }
        -  ]
        -}
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
         
        +null
        +
         >>> [CLI] bundle deploy
        -Uploading dist/test_helpers-0.1-py3-none-any.whl...
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
        +
         Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files...
         Created pipelines.orders
         Files: 5 uploaded, 0 deleted
        @@ -43,164 +33,73 @@
                 }
               }
             ],
        -    "name": "orders",
        -    "testing": {
        -      "sources": [
        -        {
        -          "glob": {
        -            "include": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/**"
        -          }
        -        }
        -      ],
        -      "environment": {
        -        "dependencies": [
        -          "--editable /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files[test]",
        -          "-r /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/requirements.txt",
        -          "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/artifacts/.internal/test_helpers-0.1-py3-none-any.whl"
        -        ]
        -      }
        -    }
        +    "name": "orders"
           }
         }
         
         === No changes after the deploy
         >>> [CLI] bundle plan
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
        +
         Plan: 0 to add, 0 to change, 0 to delete, 1 unchanged
         
         === A remote edit that drops testing shows in the plan
         >>> [CLI] bundle plan -o json
        -{
        -  "action": "update",
        -  "old": {
        -    "sources": [
        -      {
        -        "glob": {
        -          "include": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/**"
        -        }
        -      }
        -    ],
        -    "environment": {
        -      "dependencies": [
        -        "--editable /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files[test]",
        -        "-r /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/requirements.txt",
        -        "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/artifacts/.internal/test_helpers-0.1-py3-none-any.whl"
        -      ]
        -    }
        -  },
        -  "new": {
        -    "sources": [
        -      {
        -        "glob": {
        -          "include": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/**"
        -        }
        -      }
        -    ],
        -    "environment": {
        -      "dependencies": [
        -        "--editable /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files[test]",
        -        "-r /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/requirements.txt",
        -        "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/artifacts/.internal/test_helpers-0.1-py3-none-any.whl"
        -      ]
        -    }
        -  }
        -}
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
         
        +null
        +
         >>> [CLI] bundle deploy
        -Uploading dist/test_helpers-0.1-py3-none-any.whl...
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
        +
         Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files...
        -Updated pipelines.orders
         Files: 1 uploaded, 0 deleted
        -Resources: 0 created, 1 changed, 0 deleted, 0 unchanged
        +Resources: 0 created, 0 changed, 0 deleted, 1 unchanged
         
         >>> [CLI] bundle plan
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
        +
         Plan: 0 to add, 0 to change, 0 to delete, 1 unchanged
         
         === Changing testing updates the pipeline
         >>> update_file.py databricks.yml ./tests/** ./tests/unit/**
         
         >>> [CLI] bundle plan
        -update pipelines.orders
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
         
        -Plan: 0 to add, 1 to change, 0 to delete, 0 unchanged
        +Plan: 0 to add, 0 to change, 0 to delete, 1 unchanged
         
         >>> [CLI] bundle deploy
        -Uploading dist/test_helpers-0.1-py3-none-any.whl...
        +Warning: unknown field: testing
        +  at resources.pipelines.orders
        +  in databricks.yml:11:7
        +
         Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files...
        -Updated pipelines.orders
         Files: 1 uploaded, 0 deleted
        -Resources: 0 created, 1 changed, 0 deleted, 0 unchanged
        +Resources: 0 created, 0 changed, 0 deleted, 1 unchanged
         
         >>> print_requests.py //api/2.0/pipelines --nostamp
        -{
        -  "method": "PUT",
        -  "path": "/api/2.0/pipelines/[ORDERS_ID]",
        -  "body": {
        -    "channel": "CURRENT",
        -    "deployment": {
        -      "kind": "BUNDLE",
        -      "metadata_file_path": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/state/metadata.json"
        -    },
        -    "edition": "ADVANCED",
        -    "libraries": [
        -      {
        -        "glob": {
        -          "include": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/transformations/**"
        -        }
        -      }
        -    ],
        -    "name": "orders",
        -    "testing": {
        -      "sources": [
        -        {
        -          "glob": {
        -            "include": "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/unit/**"
        -          }
        -        }
        -      ],
        -      "environment": {
        -        "dependencies": [
        -          "--editable /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files[test]",
        -          "-r /Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/files/tests/requirements.txt",
        -          "/Workspace/Users/[USERNAME]/.bundle/pipeline-testing/default/artifacts/.internal/test_helpers-0.1-py3-none-any.whl"
        -        ]
        -      }
        -    }
        -  }
        -}
         
         === Removing testing sends an update without it
         >>> [CLI] bundle plan
        -update pipelines.orders
        +Plan: 0 to add, 0 to change, 0 to delete, 1 unchanged
         
... (36 more lines truncated, raise DATABRICKS_CLI_TEST_MAX_LOG to see more)

TestAccept/pipelines/databricks-cli-help: branch ✅ | main (aed6702) ❌ | latest (v1.23.0) ❌

main (aed6702):

acceptance_test.go:1341: Diff:
        --- pipelines/databricks-cli-help/output.txt
        +++ /tmp/TestAcceptpipelinesdatabricks-cli-help1995482803/002/output.txt
        @@ -30,7 +30,6 @@
           run                   Run a pipeline
           show                  Preview a table's columns and sample rows
           stop                  Stop a pipeline
        -  test                  *Preview* Run the tests of a pipeline
         
         Management Commands
           apply-environment     *Public Preview* Apply the latest environment to the pipeline.

latest (v1.23.0): same output as main (aed6702)

8 more failure details omitted, see the full report in the run.

eng-dev-ecosystem-bot · 2026-11-02T20:25:06Z

Integration test report

Commit: 9c9d9c8

Run: 41513957529

	Env	✅pass	🙈skip	Time
✅	aws linux-2core-8gb	281	29	6:07
✅	aws-windows-latest-4core-16gb	283	27	7:05
✅	azure linux-2core-8gb	280	29	5:50
✅	azure-windows-latest-4core-16gb	282	27	7:19
✅	gcp linux-2core-8gb	281	29	6:55
✅	gcp-windows-latest-4core-16gb	283	27	7:28

Top 6 slowest tests (at least 2 minutes):

duration	env	testname
7:22	gcp-windows-latest-4core-16gb	TestAccept
7:13	azure-windows-latest-4core-16gb	TestAccept
6:59	aws-windows-latest-4core-16gb	TestAccept
4:13	gcp linux-2core-8gb	TestAccept
3:33	azure linux-2core-8gb	TestAccept
3:16	aws linux-2core-8gb	TestAccept

tharunbhuk-db added 4 commits November 2, 2026 19:46

Add the testing property of pipelines to bundles

4113553

Check pipeline test dependencies for wheels with the same name

8777544

Install a test dependency in the live pipelines test smoke test

ac55aae

Link the pipelines test changelog entries to #7300

9c9d9c8

tharunbhuk-db force-pushed the tharun/pipelines-test-pr3-junit branch from cf934e0 to cc2e61a Compare November 2, 2026 19:49

tharunbhuk-db force-pushed the tharun/pipelines-test-pr4-bundles branch from 52e5f6b to 9c9d9c8 Compare November 2, 2026 19:50

Navigation Menu

Repository navigation

[WIP] Add the testing property of pipelines to bundles - #7300

[WIP] Add the testing property of pipelines to bundles#7300
tharunbhuk-db wants to merge 4 commits into
tharun/pipelines-test-pr3-junitfrom
tharun/pipelines-test-pr4-bundles

tharunbhuk-db commented Nov 2, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Nov 2, 2026

Uh oh!

eng-dev-ecosystem-bot commented Nov 2, 2026

Uh oh!

This branch has not been deployed

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

tharunbhuk-db commented Nov 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🥞 Stacked PR

Changes

Why

Tests

Uh oh!

github-actions Bot commented Nov 2, 2026

Regression test report

Uh oh!

eng-dev-ecosystem-bot commented Nov 2, 2026

Integration test report

Uh oh!

This branch has not been deployed

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

tharunbhuk-db commented Nov 2, 2026 •

edited

Loading