I noted that in the spark-base Dockerfile, PATH is set as follows: ENV PATH $SPARK_HOME:$SCALA_HOME/bin:$PATH I doubt it is harmful (the file has always been like this), but seems like the /bin is missing after $SPARK_HOME
I noted that in the spark-base Dockerfile, PATH is set as follows:
ENV PATH $SPARK_HOME:$SCALA_HOME/bin:$PATH
I doubt it is harmful (the file has always been like this), but seems like the /bin is missing after $SPARK_HOME