Welcome to zenfs Discussions!

[MatiasBjorling]

👋 Welcome!

We’re using Discussions as a place to connect with other members of our community. We hope that you:

• Ask questions you’re wondering about.
• Share ideas.
• Engage with other community members.
• Welcome others and are open-minded. Remember that this is a community we
  build together 💪.

To get started, comment below with an introduction of yourself and tell us about what you do with this community.

[shampoo365]

Hello Matias,

When I read the code of ZenFS, I found there is a ZoneExtend class, what is that used for?
Thanks,

Bo Jiang

[Edward2k]

Hello Matias,

I am trying to reproduce the artifacts for your paper "ZNS: Avoiding the Block Interface Tax for Flash-based SSDs", but am running into quite some issues with the exact versions of tools.

You mention that Section 5 that you use RocksDB 6.12, but the first (public) release of this repo mentions at least RocksDB 6.25.3 is required. If possible, could you link the correct commits of RocksDB, ZenFS and LibZBD so I can reproduce the experimentation as close as possible? If not, a mention of any significant differences (that you know of) between the versions used on the paper vs the official release would be highly appreciated :)

Kind Regards,
Eduardo

[yhr]

Edward, you can use the v1.0.2 branch together with the latest libzbd and version 6.x.x of rocksdb, that should be very close to what we used in the paper experiments. There should be no significant differences.

[Edward2k]

Thanks!

[MatiasBjorling]

Also - make sure to test with the latest and greatest as well. There's been a lot of improvements to performance since that release.

[Edward2k]

I definitely will :D

[miniedwins]

Hello Matias,

I got some errors about compiling source code. Please help me.
Thanks,

Edward

OS INFO

Ubuntu : 20.04.1
Kernel : 5.13.0-44-generic

ERRORS

edwin@ubuntu20:~/Downloads/rocksdb$ sudo DEBUG_LEVEL=0 ROCKSDB_PLUGINS=zenfs make -j48 db_bench install
$DEBUG_LEVEL is 0
$DEBUG_LEVEL is 0
CC tools/db_bench.o
CC tools/db_bench_tool.o
CC tools/simulated_hybrid_file_system.o
CC test_util/testutil.o
CC cache/cache.o
........
........
........
CC db/error_handler.o
CC db/event_helpers.o
CC db/experimental.o
CC db/external_sst_file_ingestion_job.o
g++: fatal error: Killed signal terminated program cc1plus
compilation terminated.
make: *** [Makefile:2426: db/compaction/compaction_picker_universal.o] Error 1
make: *** Waiting for unfinished jobs....
g++: fatal error: Killed signal terminated program cc1plus
compilation terminated.
make: *** [Makefile:2426: db/db_impl/db_impl_experimental.o] Error 1
g++: fatal error: Killed signal terminated program cc1plus
compilation terminated.
make: *** [Makefile:2426: db/db_impl/db_impl_write.o] Error 1
g++: fatal error: Killed signal terminated program cc1plus
compilation terminated.

[aravind-wdc]

Hi Edward,
I am guessing here, I could be wrong, but it could be possible that you ran out of memory to run compilation with 48 cores.
Could you run with say "-j4" instead of 48. ?
Also what is the gcc/g++ version you are using(and upgrade to latest, if it is older version) ?

[miniedwins]

Hi aravind-wdc
It "-j4" works very well. Thank you for your help.

Thanks,
Edward

[miniedwins]

Hello,
Could I discuss Percona Server for Zenfs? I have a problem with "enable rocksdb engine".
I follow Percona installation guide to setup for server. When I add the setting "loose-rocksdb-fs-uri=zenfs://dev:nvme0n1" in /etc/mysql/my.cnf and reload mysql service, I can't finish this command "ps-admin --enable-rocksdb -u root -p ".

Percona Installation Guide : https://www.percona.com/doc/percona-server/8.0/myrocks/zenfs.html#zenfs

Ubuntu : 20.04.1
Kernel : 5.13.0-30-generic

Thanks,
Edward

[MaisenbacherD]

Hi Edward,

What error are you getting when enableing RocksDB?
There is a PR with slight improvements for the Percona Installation Guide: percona/percona-server#4762
In case you want to issue a sysbench workload I can also refere to this documentation commit (PR soon to be created): MaisenbacherD/zonedstorage.io@a7f0b58

[miniedwins]

Hi Dennis,
Pleaase let me to clarify again the error I got. When I execute command "ps-admin --enable-rocksdb -u root -p password", if I add "loose-rocksdb-fs-uri=zenfs://dev:nvme0n1" parameter in "/etc/mysql/my.cnf", the command will be hanged without any response.

If the "loose-rocksdb-fs-uri=zenfs://dev:nvme0n1" is removed from "my.cnf", the command "ps-admin --enable-rocksdb -u root -p " will not hang. However, MySQL server will not apply RockDB engine but turn to default InnoDB engine.

Thanks,
Edward

[MaisenbacherD]

How does your /etc/mysql/my.cnf look like?

[miniedwins]

Hi Dennis,

root@edwin-ubuntu:/home/edwin/Downloads# cat /etc/mysql/my.cnf

[mysqld]
loose-rocksdb-fs-uri=zenfs://dev:nvme0n1

!includedir /etc/mysql/conf.d/
!includedir /etc/mysql/mysql.conf.d/

[miniedwins]

Following is my installing setup, please refer to my operation.
Link: https://docs.google.com/document/d/1tTr7qsj9Yx3XdS0jqro5RriVUv1xNQaZGlKRxtgQ02U/edit

Thanks,
Edward

[Z-Jie2020]

I have no idea. Can someone help me?

[Z-Jie2020]

I installed, downloaded and compiled it according to the official documentation.

[Z-Jie2020]

[MaisenbacherD]

Hi @Z-Jie2020,
Did you configure the IO scheduler and create a ZenFS filesystem according to the documentation before running db_bench?
https://github.com/westerndigitalcorporation/zenfs#configure-the-io-scheduler-for-the-zoned-block-device
https://github.com/westerndigitalcorporation/zenfs#creating-a-zenfs-file-system

[Z-Jie2020]

Oh sir thank you. I have solved the problem. I am using zenfs on femu, and I found that every time I restart femu, zenfs needs to be recreated.

[Z-Jie2020]

Oh sir thank you. I have solved the problem. I am using zenfs on femu, and I found that every time I restart femu, zenfs needs to be recreated.

…

------------------ 原始邮件 ------------------ 发件人: "Dennis ***@***.***>; 发送时间: 2022年10月17日(星期一) 下午4:04 收件人: ***@***.***>; 抄送: ***@***.***>; ***@***.***>; 主题: Re: [westerndigitalcorporation/zenfs] Welcome to zenfs Discussions! (Discussion #1) Hi @Z-Jie2020, Did you configure the IO scheduler and create a ZenFS filesystem according to the documentation before running db_bench? https://github.com/westerndigitalcorporation/zenfs#configure-the-io-scheduler-for-the-zoned-block-device https://github.com/westerndigitalcorporation/zenfs#creating-a-zenfs-file-system — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: ***@***.***>

[zhoulening969]

Hello gentlemen,
I got some errors about compiling source code. If only rocksdb is compiled, there is no problem, but adding the Zenfs plugin will result in an error. Please help me.

Thanks,
Eddy

OS INFO
Centos : 7.9.2009(core)
Kernel : 6.3.1-1.el7.elrepo.x86_64

ERRORS
[root@localhost rocksdb]# DEBUG_LEVEL=0 ROCKSDB_PLUGINS=zenfs make -j48 db_bench install
$DEBUG_LEVEL is 0
plugin/zenfs/zenfs.mk:37: *** Generating ZenFS version failed。
[root@localhost rocksdb]#

[cheniujh]

I've met the same issue, but that was because I didn't pull the source code using the 'git clone' command. Instead, I downloaded the source code in zip format and manually unzipped 'zenfs' to 'rocksdb/plugin'. When I followed the instructions in the README file and used 'git clone' to pull the code, this issue was eliminated.

[MatiasBjorling]

Hi Zhou, Could you please create a new issue with your issue, then we are able to track it independently of this older issue. Thank you. Best, Matias

…

On Thu, 11 May 2023, 04:43 Zhou Lening, ***@***.***> wrote: Hello gentlemen, I got some errors about compiling source code. If only rocksdb is compiled, there is no problem, but adding the Zenfs plugin will result in an error. Please help me. Thanks, Eddy *OS INFO* Centos : 7.9.2009(core) Kernel : 6.3.1-1.el7.elrepo.x86_64 *ERRORS* ***@***.*** rocksdb]# DEBUG_LEVEL=0 ROCKSDB_PLUGINS=zenfs make -j48 db_bench install $DEBUG_LEVEL is 0 plugin/zenfs/zenfs.mk:37: *** Generating ZenFS version failed。 ***@***.*** rocksdb]# — Reply to this email directly, view it on GitHub <#1 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAEYEY4VCUEOXILIBOAFBP3XFTGE3ANCNFSM4YT4GSWA> . You are receiving this because you authored the thread.Message ID: <westerndigitalcorporation/zenfs/repo-discussions/1/comments/5872229@ github.com>

[zhoulening969]

Okay, thank you, sir