[BUG][DISTRIBUTION][2.0.0] Folder Name Change is not correct '/usr/share/opensearch/plugins/opensearch-performance-analyzer/config/': Not a directory

[peterzhuamazon]

Early today we have merged this change from PA team:
opensearch-project/opensearch-build#1982

And then the build is not correct as the new folder is not able to be found.

Sample bundle tarball:
wget https://ci.opensearch.org/ci/dbc/distribution-build-opensearch/2.0.0-rc1/2509/linux/x64/tar/dist/opensearch/opensearch-2.0.0-rc1-linux-x64.tar.gz

#24 ERROR: process "/bin/sh -c ls -l $TEMP_DIR &&     tar -xzpf /tmp/opensearch/opensearch-`uname -p`.tgz -C $OPENSEARCH_HOME --strip-components=1 &&     mkdir -p $OPENSEARCH_HOME/data && chown -Rv $UID:$GID $OPENSEARCH_HOME/data &&     if [[ -d $SECURITY_PLUGIN_DIR ]] ; then chmod -v 750 $SECURITY_PLUGIN_DIR/tools/* ; fi &&     if [[ -d $PERFORMANCE_ANALYZER_PLUGIN_DIR ]] ; then cp -v $TEMP_DIR/performance-analyzer.properties $PERFORMANCE_ANALYZER_PLUGIN_DIR/config/; fi &&     cp -v $TEMP_DIR/opensearch-docker-entrypoint.sh $TEMP_DIR/opensearch-onetime-setup.sh $OPENSEARCH_HOME/ &&     cp -v $TEMP_DIR/log4j2.properties $TEMP_DIR/opensearch.yml $OPENSEARCH_HOME/config/ &&     ls -l $OPENSEARCH_HOME &&     rm -rf $TEMP_DIR" did not complete successfully: exit code: 1
------
 > [linux/amd64 linux_stage_0 5/5] RUN ls -l /tmp/opensearch &&     tar -xzpf /tmp/opensearch/opensearch-`uname -p`.tgz -C /usr/share/opensearch --strip-components=1 &&     mkdir -p /usr/share/opensearch/data && chown -Rv 1000:1000 /usr/share/opensearch/data &&     if [[ -d /usr/share/opensearch/plugins/opensearch-security ]] ; then chmod -v 750 /usr/share/opensearch/plugins/opensearch-security/tools/* ; fi &&     if [[ -d /usr/share/opensearch/plugins/opensearch-performance-analyzer ]] ; then cp -v /tmp/opensearch/performance-analyzer.properties /usr/share/opensearch/plugins/opensearch-performance-analyzer/config/; fi &&     cp -v /tmp/opensearch/opensearch-docker-entrypoint.sh /tmp/opensearch/opensearch-onetime-setup.sh /usr/share/opensearch/ &&     cp -v /tmp/opensearch/log4j2.properties /tmp/opensearch/opensearch.yml /usr/share/opensearch/config/ &&     ls -l /usr/share/opensearch &&     rm -rf /tmp/opensearch:
#24 5.248 changed ownership of '/usr/share/opensearch/data' from root:root to 1000:1000
#24 5.249 mode of '/usr/share/opensearch/plugins/opensearch-security/tools/audit_config_migrater.bat' changed from 0644 (rw-r--r--) to 0750 (rwxr-x---)
#24 5.249 mode of '/usr/share/opensearch/plugins/opensearch-security/tools/audit_config_migrater.sh' changed from 0644 (rw-r--r--) to 0750 (rwxr-x---)
#24 5.249 mode of '/usr/share/opensearch/plugins/opensearch-security/tools/hash.bat' changed from 0644 (rw-r--r--) to 0750 (rwxr-x---)
#24 5.249 mode of '/usr/share/opensearch/plugins/opensearch-security/tools/hash.sh' changed from 0644 (rw-r--r--) to 0750 (rwxr-x---)
#24 5.249 mode of '/usr/share/opensearch/plugins/opensearch-security/tools/install_demo_configuration.sh' changed from 0644 (rw-r--r--) to 0750 (rwxr-x---)
#24 5.249 mode of '/usr/share/opensearch/plugins/opensearch-security/tools/securityadmin.bat' changed from 0644 (rw-r--r--) to 0750 (rwxr-x---)
#24 5.249 mode of '/usr/share/opensearch/plugins/opensearch-security/tools/securityadmin.sh' changed from 0644 (rw-r--r--) to 0750 (rwxr-x---)
#24 5.250 '/tmp/opensearch/performance-analyzer.properties' -> '/usr/share/opensearch/plugins/opensearch-performance-analyzer/config/'
#24 5.250 cp: cannot create regular file '/usr/share/opensearch/plugins/opensearch-performance-analyzer/config/': Not a directory
------
------
 > [linux/arm64 linux_stage_0 5/5] RUN ls -l /tmp/opensearch &&     tar -xzpf /tmp/opensearch/opensearch-`uname -p`.tgz -C /usr/share/opensearch --strip-components=1 &&     mkdir -p /usr/share/opensearch/data && chown -Rv 1000:1000 /usr/share/opensearch/data &&     if [[ -d /usr/share/opensearch/plugins/opensearch-security ]] ; then chmod -v 750 /usr/share/opensearch/plugins/opensearch-security/tools/* ; fi &&     if [[ -d /usr/share/opensearch/plugins/opensearch-performance-analyzer ]] ; then cp -v /tmp/opensearch/performance-analyzer.properties /usr/share/opensearch/plugins/opensearch-performance-analyzer/config/; fi &&     cp -v /tmp/opensearch/opensearch-docker-entrypoint.sh /tmp/opensearch/opensearch-onetime-setup.sh /usr/share/opensearch/ &&     cp -v /tmp/opensearch/log4j2.properties /tmp/opensearch/opensearch.yml /usr/share/opensearch/config/ &&     ls -l /usr/share/opensearch &&     rm -rf /tmp/opensearch:
#13 15.18 changed ownership of '/usr/share/opensearch/data' from root:root to 1000:1000
#13 15.21 mode of '/usr/share/opensearch/plugins/opensearch-security/tools/audit_config_migrater.bat' changed from 0644 (rw-r--r--) to 0750 (rwxr-x---)
#13 15.21 mode of '/usr/share/opensearch/plugins/opensearch-security/tools/audit_config_migrater.sh' changed from 0644 (rw-r--r--) to 0750 (rwxr-x---)
#13 15.21 mode of '/usr/share/opensearch/plugins/opensearch-security/tools/hash.bat' changed from 0644 (rw-r--r--) to 0750 (rwxr-x---)
#13 15.21 mode of '/usr/share/opensearch/plugins/opensearch-security/tools/hash.sh' changed from 0644 (rw-r--r--) to 0750 (rwxr-x---)
#13 15.21 mode of '/usr/share/opensearch/plugins/opensearch-security/tools/install_demo_configuration.sh' changed from 0644 (rw-r--r--) to 0750 (rwxr-x---)
#13 15.21 mode of '/usr/share/opensearch/plugins/opensearch-security/tools/securityadmin.bat' changed from 0644 (rw-r--r--) to 0750 (rwxr-x---)
#13 15.21 mode of '/usr/share/opensearch/plugins/opensearch-security/tools/securityadmin.sh' changed from 0644 (rw-r--r--) to 0750 (rwxr-x---)
#13 15.23 '/tmp/opensearch/performance-analyzer.properties' -> '/usr/share/opensearch/plugins/opensearch-performance-analyzer/config/'
#13 15.23 /usr/bin/cp: cannot create regular file '/usr/share/opensearch/plugins/opensearch-performance-analyzer/config/': Not a directory
------
opensearch.al2.dockerfile:38

Thanks.

[peterzhuamazon]

More testing shows that the bin and config folder does not exist in PA folder:

(22-04-16 1:24:11) <0> [~/opensearch-build-peterzhuamazon/docker/release/opensearch-2.0.0-rc1/plugins/opensearch-performance-analyzer]

% ls -l
total 31764
-rw-r--r-- 1 <>    3473 Apr 15 22:40 animal-sniffer-annotations-1.19.jar
-rw-r--r-- 1 <>    3120 Apr 15 22:40 annotations-4.1.1.4.jar
-rw-r--r-- 1 <>  963713 Apr 15 22:40 bcpkix-jdk15on-1.70.jar
-rw-r--r-- 1 <> 5867298 Apr 15 22:40 bcprov-jdk15on-1.70.jar
-rw-r--r-- 1 <>  482530 Apr 15 22:40 bcutil-jdk15on-1.70.jar
-rw-r--r-- 1 <>  214381 Apr 15 22:40 checker-qual-3.5.0.jar
-rw-r--r-- 1 <>  276413 Apr 15 22:40 commons-io-2.7.jar
-rw-r--r-- 1 <>  587402 Apr 15 22:40 commons-lang3-3.12.0.jar
-rw-r--r-- 1 <>   15994 Apr 15 22:40 error_prone_annotations-2.9.0.jar
-rw-r--r-- 1 <>    4617 Apr 15 22:40 failureaccess-1.0.1.jar
-rw-r--r-- 1 <>  253742 Apr 15 22:40 grpc-api-1.44.0.jar
-rw-r--r-- 1 <>   30593 Apr 15 22:40 grpc-context-1.44.0.jar
-rw-r--r-- 1 <>  686552 Apr 15 22:40 grpc-core-1.44.0.jar
-rw-r--r-- 1 <>  281668 Apr 15 22:40 grpc-netty-1.44.0.jar
-rw-r--r-- 1 <>    5115 Apr 15 22:40 grpc-protobuf-1.44.0.jar
-rw-r--r-- 1 <>    7570 Apr 15 22:40 grpc-protobuf-lite-1.44.0.jar
-rw-r--r-- 1 <>   50386 Apr 15 22:40 grpc-stub-1.44.0.jar
-rw-r--r-- 1 <>  258075 Apr 15 22:40 gson-2.8.9.jar
-rw-r--r-- 1 <> 2862361 Apr 15 22:40 guava-30.1-jre.jar
-rw-r--r-- 1 <>    8781 Apr 15 22:40 j2objc-annotations-1.3.jar
-rw-r--r-- 1 <>   75708 Apr 15 22:40 jackson-annotations-2.12.6.jar
-rw-r--r-- 1 <> 1516925 Apr 15 22:40 jackson-databind-2.12.6.jar
-rw-r--r-- 1 <>   43839 Apr 15 22:40 jackson-module-paranamer-2.12.6.jar
-rw-r--r-- 1 <>   26586 Apr 15 22:40 javax.annotation-api-1.3.2.jar
-rw-r--r-- 1 <> 2117677 Apr 15 22:40 jooq-3.10.8.jar
-rw-r--r-- 1 <>   19936 Apr 15 22:40 jsr305-3.0.2.jar
-rw-r--r-- 1 <>    2199 Apr 15 22:40 listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar
-rw-r--r-- 1 <>  302927 Apr 15 22:40 netty-buffer-4.1.73.Final.jar
-rw-r--r-- 1 <>  337170 Apr 15 22:40 netty-codec-4.1.73.Final.jar
-rw-r--r-- 1 <>  471353 Apr 15 22:40 netty-codec-http2-4.1.73.Final.jar
-rw-r--r-- 1 <>  634551 Apr 15 22:40 netty-codec-http-4.1.73.Final.jar
-rw-r--r-- 1 <>  119073 Apr 15 22:40 netty-codec-socks-4.1.73.Final.jar
-rw-r--r-- 1 <>  649516 Apr 15 22:40 netty-common-4.1.73.Final.jar
-rw-r--r-- 1 <>  522638 Apr 15 22:40 netty-handler-4.1.73.Final.jar
-rw-r--r-- 1 <>   23962 Apr 15 22:40 netty-handler-proxy-4.1.73.Final.jar
-rw-r--r-- 1 <>   37776 Apr 15 22:40 netty-resolver-4.1.73.Final.jar
-rw-r--r-- 1 <>   33919 Apr 15 22:40 netty-tcnative-classes-2.0.46.Final.jar
-rw-r--r-- 1 <>  478804 Apr 15 22:40 netty-transport-4.1.73.Final.jar
-rw-r--r-- 1 <>  159278 Apr 15 22:40 opensearch-performance-analyzer-2.0.0.0-rc1.jar
-rw-r--r-- 1 <>    6385 Apr 15 22:40 perfmark-api-0.23.0.jar
-rw-r--r-- 1 <> 1539322 Apr 15 22:40 performanceanalyzer-rca-2.0.0.0-rc1.jar
-rw-r--r-- 1 <>    1954 Apr 15 22:40 plugin-descriptor.properties
-rw-r--r-- 1 <>    1302 Apr 15 22:40 plugin-security.policy
-rw-r--r-- 1 <> 1681866 Apr 15 22:40 protobuf-java-3.19.2.jar
-rw-r--r-- 1 <> 1557780 Apr 15 22:40 proto-google-common-protos-2.0.1.jar
-rw-r--r-- 1 <> 7210681 Apr 15 22:40 sqlite-jdbc-3.32.3.2.jar

[peterzhuamazon]

Seems like the performance-analyzer-rca folder in root of the tarball has all three:

bin  config  lib

[peterzhuamazon]

After downloading the zip directly and extract, the bin and config folder is there thus makes me think it is missed during the installation step, not compiling:

wget https://ci.opensearch.org/ci/dbc/distribution-build-opensearch/2.0.0-rc1/2509/linux/x64/tar/builds/opensearch/plugins/opensearch-performance-analyzer-2.0.0.0-rc1.zip

-rw-r--r-- 1 <>     3473 Apr 15 22:38 animal-sniffer-annotations-1.19.jar
-rw-r--r-- 1 <>     3120 Apr 15 22:38 annotations-4.1.1.4.jar
-rw-r--r-- 1 <>   963713 Apr 15 22:25 bcpkix-jdk15on-1.70.jar
-rw-r--r-- 1 <>  5867298 Apr 15 22:25 bcprov-jdk15on-1.70.jar
-rw-r--r-- 1 <>   482530 Apr 15 22:38 bcutil-jdk15on-1.70.jar
drwxr-xr-x 2 <>     4096 Apr 15 22:39 bin
-rw-r--r-- 1 <>   214381 Apr 15 22:32 checker-qual-3.5.0.jar
-rw-r--r-- 1 <>   276413 Apr 15 22:22 commons-io-2.7.jar
-rw-r--r-- 1 <>   587402 Apr 15 22:25 commons-lang3-3.12.0.jar
drwxr-xr-x 2 <>     4096 Apr 15 22:39 config
-rw-r--r-- 1 <>    15994 Apr 15 22:38 error_prone_annotations-2.9.0.jar
-rw-r--r-- 1 <>     4617 Apr 15 22:25 failureaccess-1.0.1.jar
-rw-r--r-- 1 <>   253742 Apr 15 22:38 grpc-api-1.44.0.jar
-rw-r--r-- 1 <>    30593 Apr 15 22:38 grpc-context-1.44.0.jar
-rw-r--r-- 1 <>   686552 Apr 15 22:38 grpc-core-1.44.0.jar
-rw-r--r-- 1 <>   281668 Apr 15 22:38 grpc-netty-1.44.0.jar
-rw-r--r-- 1 <>     5115 Apr 15 22:38 grpc-protobuf-1.44.0.jar
-rw-r--r-- 1 <>     7570 Apr 15 22:38 grpc-protobuf-lite-1.44.0.jar
-rw-r--r-- 1 <>    50386 Apr 15 22:38 grpc-stub-1.44.0.jar
-rw-r--r-- 1 <>   258075 Apr 15 22:33 gson-2.8.9.jar
-rw-r--r-- 1 <>  2862361 Apr 15 22:38 guava-30.1-jre.jar
-rw-r--r-- 1 <>     8781 Apr 15 22:27 j2objc-annotations-1.3.jar
-rw-r--r-- 1 <>    75708 Apr 15 22:38 jackson-annotations-2.12.6.jar
-rw-r--r-- 1 <>  1516925 Apr 15 22:38 jackson-databind-2.12.6.jar
-rw-r--r-- 1 <>    43839 Apr 15 22:39 jackson-module-paranamer-2.12.6.jar
-rw-r--r-- 1 <>    26586 Apr 15 22:38 javax.annotation-api-1.3.2.jar
-rw-r--r-- 1 <>  2117677 Apr 15 22:38 jooq-3.10.8.jar
-rw-r--r-- 1 <>    19936 Apr 15 22:23 jsr305-3.0.2.jar
-rw-r--r-- 1 <>     2199 Apr 15 22:27 listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar
-rw-r--r-- 1 <>   302927 Apr 15 22:25 netty-buffer-4.1.73.Final.jar
-rw-r--r-- 1 <>   337170 Apr 15 22:25 netty-codec-4.1.73.Final.jar
-rw-r--r-- 1 <>   471353 Apr 15 22:25 netty-codec-http2-4.1.73.Final.jar
-rw-r--r-- 1 <>   634551 Apr 15 22:25 netty-codec-http-4.1.73.Final.jar
-rw-r--r-- 1 <>   119073 Apr 15 22:25 netty-codec-socks-4.1.73.Final.jar
-rw-r--r-- 1 <>   649516 Apr 15 22:25 netty-common-4.1.73.Final.jar
-rw-r--r-- 1 <>   522638 Apr 15 22:25 netty-handler-4.1.73.Final.jar
-rw-r--r-- 1 <>    23962 Apr 15 22:25 netty-handler-proxy-4.1.73.Final.jar
-rw-r--r-- 1 <>    37776 Apr 15 22:25 netty-resolver-4.1.73.Final.jar
-rw-r--r-- 1 <>    33919 Apr 15 22:38 netty-tcnative-classes-2.0.46.Final.jar
-rw-r--r-- 1 <>   478804 Apr 15 22:25 netty-transport-4.1.73.Final.jar
-rw-r--r-- 1 <>   159278 Apr 15 22:39 opensearch-performance-analyzer-2.0.0.0-rc1.jar
-rw-r--r-- 1 <> 61210457 Apr 15 22:41 opensearch-performance-analyzer-2.0.0.0-rc1.zip
-rw-r--r-- 1 <>     6385 Apr 15 22:38 perfmark-api-0.23.0.jar
drwxr-xr-x 5 <>     4096 Apr 15 22:39 performance-analyzer-rca
-rw-r--r-- 1 <>  1539322 Apr 15 22:39 performanceanalyzer-rca-2.0.0.0-rc1.jar
-rw-r--r-- 1 <>     1954 Apr 15 22:39 plugin-descriptor.properties
-rw-r--r-- 1 <>     1302 Apr 15 22:39 plugin-security.policy
-rw-r--r-- 1 <>  1681866 Apr 15 22:38 protobuf-java-3.19.2.jar
-rw-r--r-- 1 <>  1557780 Apr 15 22:38 proto-google-common-protos-2.0.1.jar
-rw-r--r-- 1 <>  7210681 Apr 15 22:38 sqlite-jdbc-3.32.3.2.jar

[peterzhuamazon]

Manually install the zip locally and observe the same behavior:

dev-dsk-zhujiaxi-2a-5662414e % ./opensearch-plugin install file://$PWD/opensearch-performance-analyzer-2.0.0.0-rc1.zip
-> Installing file://$PWD/opensearch-2.0.0-rc1/bin/opensearch-performance-analyzer-2.0.0.0-rc1.zip
-> Downloading file://$PWD/opensearch-2.0.0-rc1/bin/opensearch-performance-analyzer-2.0.0.0-rc1.zip
[=================================================] 100%
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@     WARNING: plugin requires additional permissions     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
* com.sun.tools.attach.AttachPermission attachVirtualMachine
* com.sun.tools.attach.AttachPermission createAttachProvider
* java.io.FilePermission /-#plus read,write,execute,delete,readlink
* java.io.FilePermission build/tmp/junit_metrics#plus read
* java.lang.RuntimePermission accessClassInPackage.jdk.internal.misc
* java.lang.RuntimePermission accessClassInPackage.sun.tools.attach
* java.lang.RuntimePermission accessDeclaredMembers
* java.lang.RuntimePermission createClassLoader
* java.lang.RuntimePermission defineClass
* java.lang.RuntimePermission loadLibrary.attach
* java.lang.RuntimePermission manageProcess
* java.lang.reflect.ReflectPermission suppressAccessChecks
See http://docs.oracle.com/javase/8/docs/technotes/guides/security/permissions.html
for descriptions of what these permissions allow and the associated risks.

-rw-r--r-- 1 <>    3473 Apr 16 01:33 animal-sniffer-annotations-1.19.jar
-rw-r--r-- 1 <>    3120 Apr 16 01:33 annotations-4.1.1.4.jar
-rw-r--r-- 1 <>  963713 Apr 16 01:33 bcpkix-jdk15on-1.70.jar
-rw-r--r-- 1 <> 5867298 Apr 16 01:33 bcprov-jdk15on-1.70.jar
-rw-r--r-- 1 <>  482530 Apr 16 01:33 bcutil-jdk15on-1.70.jar
-rw-r--r-- 1 <>  214381 Apr 16 01:33 checker-qual-3.5.0.jar
-rw-r--r-- 1 <>  276413 Apr 16 01:33 commons-io-2.7.jar
-rw-r--r-- 1 <>  587402 Apr 16 01:33 commons-lang3-3.12.0.jar
-rw-r--r-- 1 <>   15994 Apr 16 01:33 error_prone_annotations-2.9.0.jar
-rw-r--r-- 1 <>    4617 Apr 16 01:33 failureaccess-1.0.1.jar
-rw-r--r-- 1 <>  253742 Apr 16 01:33 grpc-api-1.44.0.jar
-rw-r--r-- 1 <>   30593 Apr 16 01:33 grpc-context-1.44.0.jar
-rw-r--r-- 1 <>  686552 Apr 16 01:33 grpc-core-1.44.0.jar
-rw-r--r-- 1 <>  281668 Apr 16 01:33 grpc-netty-1.44.0.jar
-rw-r--r-- 1 <>    5115 Apr 16 01:33 grpc-protobuf-1.44.0.jar
-rw-r--r-- 1 <>    7570 Apr 16 01:33 grpc-protobuf-lite-1.44.0.jar
-rw-r--r-- 1 <>   50386 Apr 16 01:33 grpc-stub-1.44.0.jar
-rw-r--r-- 1 <>  258075 Apr 16 01:33 gson-2.8.9.jar
-rw-r--r-- 1 <> 2862361 Apr 16 01:33 guava-30.1-jre.jar
-rw-r--r-- 1 <>    8781 Apr 16 01:33 j2objc-annotations-1.3.jar
-rw-r--r-- 1 <>   75708 Apr 16 01:33 jackson-annotations-2.12.6.jar
-rw-r--r-- 1 <> 1516925 Apr 16 01:33 jackson-databind-2.12.6.jar
-rw-r--r-- 1 <>   43839 Apr 16 01:33 jackson-module-paranamer-2.12.6.jar
-rw-r--r-- 1 <>   26586 Apr 16 01:33 javax.annotation-api-1.3.2.jar
-rw-r--r-- 1 <> 2117677 Apr 16 01:33 jooq-3.10.8.jar
-rw-r--r-- 1 <>   19936 Apr 16 01:33 jsr305-3.0.2.jar
-rw-r--r-- 1 <>    2199 Apr 16 01:33 listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar
-rw-r--r-- 1 <>  302927 Apr 16 01:33 netty-buffer-4.1.73.Final.jar
-rw-r--r-- 1 <>  337170 Apr 16 01:33 netty-codec-4.1.73.Final.jar
-rw-r--r-- 1 <>  471353 Apr 16 01:33 netty-codec-http2-4.1.73.Final.jar
-rw-r--r-- 1 <>  634551 Apr 16 01:33 netty-codec-http-4.1.73.Final.jar
-rw-r--r-- 1 <>  119073 Apr 16 01:33 netty-codec-socks-4.1.73.Final.jar
-rw-r--r-- 1 <>  649516 Apr 16 01:33 netty-common-4.1.73.Final.jar
-rw-r--r-- 1 <>  522638 Apr 16 01:33 netty-handler-4.1.73.Final.jar
-rw-r--r-- 1 <>   23962 Apr 16 01:33 netty-handler-proxy-4.1.73.Final.jar
-rw-r--r-- 1 <>   37776 Apr 16 01:33 netty-resolver-4.1.73.Final.jar
-rw-r--r-- 1 <>   33919 Apr 16 01:33 netty-tcnative-classes-2.0.46.Final.jar
-rw-r--r-- 1 <>  478804 Apr 16 01:33 netty-transport-4.1.73.Final.jar
-rw-r--r-- 1 <>  159278 Apr 16 01:33 opensearch-performance-analyzer-2.0.0.0-rc1.jar
-rw-r--r-- 1 <>    6385 Apr 16 01:33 perfmark-api-0.23.0.jar
drwxr-xr-x 5 <>    4096 Apr 16 01:33 performance-analyzer-rca
-rw-r--r-- 1 <> 1539322 Apr 16 01:33 performanceanalyzer-rca-2.0.0.0-rc1.jar
-rw-r--r-- 1 <>    1954 Apr 16 01:33 plugin-descriptor.properties
-rw-r--r-- 1 <>    1302 Apr 16 01:33 plugin-security.policy
-rw-r--r-- 1 <> 1681866 Apr 16 01:33 protobuf-java-3.19.2.jar
-rw-r--r-- 1 <> 1557780 Apr 16 01:33 proto-google-common-protos-2.0.1.jar
-rw-r--r-- 1 <> 7210681 Apr 16 01:33 sqlite-jdbc-3.32.3.2.jar

[peterzhuamazon]

I have noticed that due to bin config within PA folder is the same name as OS bin config folder, thus those folders are auto-merged with the bin config folder in OS root.

opensearch-2.0.0-rc1/config
total 48
-rw-r----- 1 <>  2419 Jan  1  1970 jvm.options
drwxr-x--- 2 <>  4096 Jan  1  1970 jvm.options.d
-rw-r----- 1 <> 12134 Jan  1  1970 log4j2.properties
drwxr-x--- 2 <>  4096 Apr 15 22:40 opensearch-notifications
drwxr-x--- 2 <>  4096 Apr 15 22:40 opensearch-notifications-core
drwxr-x--- 2 <>  4096 Apr 15 22:40 opensearch-observability
drwxr-x--- 2 <>  4096 Apr 15 22:40 opensearch-performance-analyzer
drwxr-x--- 2 <>  4096 Apr 15 22:40 opensearch-reports-scheduler
drwxr-x--- 2 <>  4096 Apr 15 22:40 opensearch-security
-rw-r----- 1 <>  2800 Jan  1  1970 opensearch.yml

opensearch-2.0.0-rc1/config/opensearch-performance-analyzer
-rw-r----- 1 <>  104 Apr 15 22:40 agent-stats-metadata
-rw-r----- 1 <> 2062 Apr 15 22:40 log4j2.xml
-rw-r----- 1 <>  355 Apr 15 22:40 opensearch_security.policy
-rw-r----- 1 <> 1668 Apr 15 22:40 performance-analyzer.properties
-rw-r----- 1 <>  106 Apr 15 22:40 plugin-stats-metadata
-rw-r----- 1 <> 2977 Apr 15 22:40 rca.conf
-rw-r----- 1 <> 4394 Apr 15 22:40 rca_idle_master.conf
-rw-r----- 1 <> 4389 Apr 15 22:40 rca_master.conf
-rw-r----- 1 <> 1310 Apr 15 22:40 supervisord.conf

[peterzhuamazon]

If above is the case then this PR from PA team is invalid from the start.
opensearch-project/opensearch-build#1982

As those folder will never exist in plugins/PA anymore.

[sruti1312]

Hi @peterzhuamazon. As a part of our integration test, we download the opensearch jar and install PA plugin. Tests that ran against this cluster was successful (config and bin folder were found inside the performance_analyzer directory).

https://github.com/opensearch-project/performance-analyzer-rca/blob/main/docker/Dockerfile#L45

Alternate options are,

1. Change the directory name to pa_config and pa_bin.
2. All the consumers can now point to the directories in OS root directory.

[peterzhuamazon]

Talked with @sruti1312 and we will get Core Engineers to understand the behavior of zip installation more.

[peterzhuamazon]

Core issue: opensearch-project/OpenSearch#2963