[Bug] [UI] Storage not enabled

[lhcg]

Search before asking

• I had searched in the issues and found no similar issues.

What happened

What happened
I set values.xml

sharedStoragePersistence:
enabled: true
mountPath: "/opt/soft"
accessModes:
- "ReadWriteMany"
## storageClassName must support the access mode: ReadWriteMany
storageClassName: "ds-shared-nfs"
storage: "2Gi"

fsFileResourcePersistence:
enabled: true
accessModes:
- "ReadWriteMany"
## storageClassName must support the access mode: ReadWriteMany
storageClassName: "ds-file-nfs"
storage: "2Gi"

DATA_BASEDIR_PATH: "/tmp/dolphinscheduler" RESOURCE_STORAGE_TYPE: "HDFS" RESOURCE_UPLOAD_PATH: "/dolphinscheduler" FS_DEFAULT_FS: "file:///"

What you expected to happen

It's show "Storage is not enabled" when I upload the spark-examples_2.11-2.4.7.jar.

How to reproduce

storageClassName: "ds-shared-nfs"
storageClassName: "ds-file-nfs"
all bound
It's use the nfs.

Anything else

root@dolphinscheduler-api-dbcf78666-72wff:/opt/dolphinscheduler/conf# pwd
/opt/dolphinscheduler/conf
root@dolphinscheduler-api-dbcf78666-72wff:/opt/dolphinscheduler/conf# cat common.properties

data.basedir.path=/tmp/dolphinscheduler
resource.storage.type=NONE
resource.upload.path=/dolphinscheduler
fs.defaultFS=file:///

why?

Version

3.0.0

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[github-actions]

Search before asking

• I had searched in the issues and found no similar issues.

What happened

What happened
I set values.xml
`sharedStoragePersistence:
enabled: true
mountPath: "/opt/soft"
accessModes:

• "ReadWriteMany"

storageClassName must support the access mode: ReadWriteMany

storageClassName: "ds-shared-nfs"
storage: "2Gi" fsFileResourcePersistence:
enabled: true
accessModes:

• "ReadWriteMany"

storageClassName must support the access mode: ReadWriteMany

storageClassName: "ds-file-nfs"
storage: "2Gi"`

DATA_BASEDIR_PATH: "/tmp/dolphinscheduler" RESOURCE_STORAGE_TYPE: "HDFS" RESOURCE_UPLOAD_PATH: "/dolphinscheduler" FS_DEFAULT_FS: "file:///"

What you expected to happen

It's show "存储未启用" when I upload the spark-examples_2.11-2.4.7.jar.

How to reproduce

storageClassName: "ds-shared-nfs"
storageClassName: "ds-file-nfs"
all bound
It's use the nfs.

Anything else

root@dolphinscheduler-api-dbcf78666-72wff:/opt/dolphinscheduler/conf# pwd
/opt/dolphinscheduler/conf
root@dolphinscheduler-api-dbcf78666-72wff:/opt/dolphinscheduler/conf# cat common.properties
`data.basedir.path=/tmp/dolphinscheduler

resource storage type: HDFS, S3, NONE

resource.storage.type=NONE

resource store on HDFS/S3 path, resource file will store to this hadoop hdfs path, self configuration, please make sure the directory exists on hdfs and have read write permissions. "/dolphinscheduler" is recommended

resource.upload.path=/dolphinscheduler

whether to startup kerberos

hadoop.security.authentication.startup.state=false

java.security.krb5.conf path

java.security.krb5.conf.path=/opt/krb5.conf

login user from keytab username

login.user.keytab.username=hdfs-mycluster@ESZ.COM

login user from keytab path

login.user.keytab.path=/opt/hdfs.headless.keytab

kerberos expire time, the unit is hour

kerberos.expire.time=2

resource view suffixs

#resource.view.suffixs=txt,log,sh,bat,conf,cfg,py,java,sql,xml,hql,properties,json,yml,yaml,ini,js

if resource.storage.type=HDFS, the user must have the permission to create directories under the HDFS root path

hdfs.root.user=hdfs

if resource.storage.type=S3, the value like: s3a://dolphinscheduler; if resource.storage.type=HDFS and namenode HA is enabled, you need to copy core-site.xml and hdfs-site.xml to conf dir

fs.defaultFS=file:///`
why?

Version

3.0.0

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[github-actions]

Thank you for your feedback, we have received your issue, Please wait patiently for a reply.

• In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
• If you haven't received a reply for a long time, you can join our slack and send your question to channel #troubleshooting

[KyleZhang0536]

Does it mean I have to modify common.properties in 3.0.0 ?

[itzhang89]

I deploy the 3.0.0-release by helm and take place the same issue when I try to upload the file to File Manager.

common:
  ## Configmap
  configmap:
    DOLPHINSCHEDULER_OPTS: ""
    DATA_BASEDIR_PATH: "/tmp/dolphinscheduler"
    RESOURCE_STORAGE_TYPE: "HDFS"
    RESOURCE_UPLOAD_PATH: "/dolphinscheduler"
    FS_DEFAULT_FS: "file:///"

I check the source code. and find theRESOURCE_STORAGE_TYPE value seem not take effect on the api module. The value is alway is None and not parse from the environment.

[dmzzzzhlj90]

I had the same problem

[aspexdaniel]

same problem with configuration with s3