HDDS-1799. Add goofyfs to the ozone-runner docker image

[elek]

Goofys is a s3 fuse driver which is required for the ozone csi setup.

As of now it's installed in hadoop-ozone/dist/src/main/docker/Dockerfile from a non-standard location (because it couldn't be part of hadoop-runner earlier as it's ozone specific).

It should be installed to the ozone-runner from a canonical goffys release URL.

See: https://issues.apache.org/jira/browse/HDDS-1799

[elek]

Please note, that this should be merged only after the other pull request in the docker-hadoop-runner repo.

See: https://issues.apache.org/jira/browse/HDDS-1799

Please review and I will take care about the merge + commit in the right order...

[hadoop-yetus]

💔 -1 overall

Vote	Subsystem	Runtime	Comment
0	reexec	149	Docker mode activated.
		_ Prechecks _
+1	dupname	0	No case conflicting files found.
0	shelldocs	0	Shelldocs was not available.
+1	@author	0	The patch does not contain any @author tags.
-1	test4tests	0	The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
		_ trunk Compile Tests _
+1	mvninstall	661	trunk passed
+1	compile	311	trunk passed
+1	mvnsite	0	trunk passed
+1	shadedclient	934	branch has no errors when building and testing our client artifacts.
+1	javadoc	174	trunk passed
		_ Patch Compile Tests _
+1	mvninstall	459	the patch passed
+1	compile	295	the patch passed
+1	javac	295	the patch passed
+1	hadolint	3	The patch generated 0 new + 1 unchanged - 3 fixed = 1 total (was 4)
+1	mvnsite	0	the patch passed
+1	shellcheck	0	There were no new shellcheck issues.
+1	whitespace	0	The patch has no whitespace issues.
+1	xml	3	The patch has no ill-formed XML file.
+1	shadedclient	801	patch has no errors when building and testing our client artifacts.
+1	javadoc	213	the patch passed
		_ Other Tests _
+1	unit	354	hadoop-hdds in the patch passed.
-1	unit	2151	hadoop-ozone in the patch failed.
+1	asflicense	66	The patch does not generate ASF License warnings.
		6826

Reason	Tests
Failed junit tests	hadoop.hdds.scm.pipeline.TestRatisPipelineCreateAndDestory
	hadoop.ozone.client.rpc.TestSecureOzoneRpcClient
	hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis
	hadoop.ozone.om.TestSecureOzoneManager
	hadoop.ozone.client.rpc.TestReadRetries
	hadoop.ozone.client.rpc.TestOzoneClientRetriesOnException
	hadoop.ozone.client.rpc.TestOzoneAtRestEncryption
	hadoop.ozone.client.rpc.TestCommitWatcher
	hadoop.ozone.client.rpc.TestBlockOutputStreamWithFailures
	hadoop.ozone.client.rpc.TestOzoneRpcClient

Subsystem	Report/Notes
Docker	Client=18.09.7 Server=18.09.7 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1105/1/artifact/out/Dockerfile
GITHUB PR	#1105
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml hadolint shellcheck shelldocs
uname	Linux de91ef652023 4.15.0-52-generic #56-Ubuntu SMP Tue Jun 4 22:49:08 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	personality/hadoop.sh
git revision	trunk / d21eccf
Default Java	1.8.0_212
unit	https://builds.apache.org/job/hadoop-multibranch/job/PR-1105/1/artifact/out/patch-unit-hadoop-ozone.txt
Test Results	https://builds.apache.org/job/hadoop-multibranch/job/PR-1105/1/testReport/
Max. process+thread count	5411 (vs. ulimit of 5500)
modules	C: hadoop-ozone/dist U: hadoop-ozone/dist
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-1105/1/console
versions	git=2.7.4 maven=3.3.9 shellcheck=0.4.6 hadolint=1.11.1-0-g0e692dd
Powered by	Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

[hadoop-yetus]

💔 -1 overall

Vote	Subsystem	Runtime	Comment
0	reexec	242	Docker mode activated.
		_ Prechecks _
+1	dupname	0	No case conflicting files found.
0	shelldocs	1	Shelldocs was not available.
+1	@author	0	The patch does not contain any @author tags.
-1	test4tests	0	The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
		_ trunk Compile Tests _
+1	mvninstall	570	trunk passed
+1	compile	315	trunk passed
+1	mvnsite	0	trunk passed
+1	shadedclient	919	branch has no errors when building and testing our client artifacts.
+1	javadoc	205	trunk passed
		_ Patch Compile Tests _
+1	mvninstall	565	the patch passed
+1	compile	332	the patch passed
+1	javac	332	the patch passed
+1	hadolint	2	The patch generated 0 new + 1 unchanged - 3 fixed = 1 total (was 4)
+1	mvnsite	0	the patch passed
+1	shellcheck	0	There were no new shellcheck issues.
+1	whitespace	0	The patch has no whitespace issues.
+1	xml	2	The patch has no ill-formed XML file.
+1	shadedclient	824	patch has no errors when building and testing our client artifacts.
+1	javadoc	191	the patch passed
		_ Other Tests _
+1	unit	345	hadoop-hdds in the patch passed.
-1	unit	2003	hadoop-ozone in the patch failed.
+1	asflicense	62	The patch does not generate ASF License warnings.
		6973

Reason	Tests
Failed junit tests	hadoop.ozone.client.rpc.TestCloseContainerHandlingByClient
	hadoop.ozone.ozShell.TestOzoneShell
	hadoop.ozone.client.rpc.TestOzoneRpcClient
	hadoop.ozone.web.client.TestKeys
	hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis
	hadoop.ozone.client.rpc.TestOzoneClientRetriesOnException
	hadoop.ozone.container.common.helpers.TestBlockData
	hadoop.ozone.web.client.TestOzoneClient
	hadoop.ozone.container.common.statemachine.commandhandler.TestCloseContainerByPipeline
	hadoop.ozone.container.common.TestBlockDeletingService
	hadoop.hdds.scm.pipeline.TestNodeFailure
	hadoop.ozone.web.TestOzoneVolumes
	hadoop.ozone.web.TestOzoneRestWithMiniCluster

Subsystem	Report/Notes
Docker	Client=18.09.7 Server=18.09.7 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1105/2/artifact/out/Dockerfile
GITHUB PR	#1105
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml hadolint shellcheck shelldocs
uname	Linux 34fd68325ee3 4.15.0-48-generic #51-Ubuntu SMP Wed Apr 3 08:28:49 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	personality/hadoop.sh
git revision	trunk / b4466a3
Default Java	1.8.0_212
unit	https://builds.apache.org/job/hadoop-multibranch/job/PR-1105/2/artifact/out/patch-unit-hadoop-ozone.txt
Test Results	https://builds.apache.org/job/hadoop-multibranch/job/PR-1105/2/testReport/
Max. process+thread count	5407 (vs. ulimit of 5500)
modules	C: hadoop-ozone/dist U: hadoop-ozone/dist
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-1105/2/console
versions	git=2.7.4 maven=3.3.9 shellcheck=0.4.6 hadolint=1.11.1-0-g0e692dd
Powered by	Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

[hadoop-yetus]

💔 -1 overall

Vote	Subsystem	Runtime	Comment
0	reexec	57	Docker mode activated.
		_ Prechecks _
+1	dupname	0	No case conflicting files found.
0	shelldocs	0	Shelldocs was not available.
+1	@author	0	The patch does not contain any @author tags.
-1	test4tests	0	The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
		_ trunk Compile Tests _
+1	mvninstall	534	trunk passed
+1	compile	254	trunk passed
+1	mvnsite	0	trunk passed
+1	shadedclient	818	branch has no errors when building and testing our client artifacts.
+1	javadoc	164	trunk passed
		_ Patch Compile Tests _
+1	mvninstall	469	the patch passed
+1	compile	275	the patch passed
+1	javac	275	the patch passed
+1	hadolint	2	The patch generated 0 new + 1 unchanged - 3 fixed = 1 total (was 4)
+1	mvnsite	0	the patch passed
+1	shellcheck	0	There were no new shellcheck issues.
+1	whitespace	0	The patch has no whitespace issues.
+1	xml	1	The patch has no ill-formed XML file.
+1	shadedclient	694	patch has no errors when building and testing our client artifacts.
+1	javadoc	165	the patch passed
		_ Other Tests _
+1	unit	330	hadoop-hdds in the patch passed.
-1	unit	2156	hadoop-ozone in the patch failed.
+1	asflicense	54	The patch does not generate ASF License warnings.
		6175

Reason	Tests
Failed junit tests	hadoop.ozone.client.rpc.TestOzoneRpcClient
	hadoop.ozone.client.rpc.TestSecureOzoneRpcClient
	hadoop.ozone.container.common.statemachine.commandhandler.TestBlockDeletion
	hadoop.ozone.client.rpc.TestFailureHandlingByClient
	hadoop.hdds.scm.pipeline.TestRatisPipelineCreateAndDestory
	hadoop.ozone.client.rpc.TestMultiBlockWritesWithDnFailures
	hadoop.ozone.container.ozoneimpl.TestSecureOzoneContainer
	hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis
	hadoop.ozone.client.rpc.TestOzoneAtRestEncryption
	hadoop.ozone.client.rpc.TestReadRetries
	hadoop.ozone.client.rpc.TestOzoneClientRetriesOnException
	hadoop.ozone.container.server.TestSecureContainerServer

Subsystem	Report/Notes
Docker	Client=18.09.8 Server=18.09.8 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1105/3/artifact/out/Dockerfile
GITHUB PR	#1105
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml hadolint shellcheck shelldocs
uname	Linux 258f7a8088f7 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	personality/hadoop.sh
git revision	trunk / 4e66cb9
Default Java	1.8.0_212
unit	https://builds.apache.org/job/hadoop-multibranch/job/PR-1105/3/artifact/out/patch-unit-hadoop-ozone.txt
Test Results	https://builds.apache.org/job/hadoop-multibranch/job/PR-1105/3/testReport/
Max. process+thread count	4912 (vs. ulimit of 5500)
modules	C: hadoop-ozone/dist U: hadoop-ozone/dist
Console output	https://builds.apache.org/job/hadoop-multibranch/job/PR-1105/3/console
versions	git=2.7.4 maven=3.3.9 shellcheck=0.4.6 hadolint=1.11.1-0-g0e692dd
Powered by	Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

[anuengineer]

I have committed this patch to trunk and ozone-0.4.1. Thanks for your contribution.