Expected Behavior
End to end tests should leave no trace (other than logs)
Current Behavior
The batch end-to-end tests do not properly clean up BQ data sets, or the files uploaded to gcs.
Possible Solution
To clean up BQ,
This line
bq rm -r -f ${GOOGLE_CLOUD_PROJECT}:${DATASET_NAME}
should be moved to before exit ${TEST_EXIT_CODE}
To clean up gcs, the python test code should have a teardown step.
Expected Behavior
End to end tests should leave no trace (other than logs)
Current Behavior
The batch end-to-end tests do not properly clean up BQ data sets, or the files uploaded to gcs.
Possible Solution
To clean up BQ,
This line
should be moved to before
exit ${TEST_EXIT_CODE}To clean up gcs, the python test code should have a teardown step.