Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Verbose listing of namespace doesn't give "numa_node" #130

Closed
tanabarr opened this issue Jan 19, 2020 · 7 comments
Closed

Verbose listing of namespace doesn't give "numa_node" #130

tanabarr opened this issue Jan 19, 2020 · 7 comments

Comments

@tanabarr
Copy link

"ndctl list -N -v" when running version 62 gives the "numa_node" as it described in the current documentation:

-v In addition to the enabled namespaces default output, show the numa_node, raw_uuid, and bad block media errors.

from https://pmem.io/ndctl/ndctl-list.html

  {
    "dev":"namespace1.0",
    "mode":"fsdax",
    "map":"dev",
    "size":3183575302144,
    "uuid":"fae46605-9ded-4c97-a95e-2c796274e358",
    "raw_uuid":"c5c60ace-c326-4655-9dd2-2eb162d4aac2",
    "sector_size":512,
    "blockdev":"pmem1",
    "numa_node":1
  }

Whereas when running 64.1, using the same procedure to create the namespace (Centos 7.7 rather than 7.6 as above), no "numa_node" is given:

  {
    "dev":"namespace1.0",
    "mode":"fsdax",
    "map":"dev",
    "size":3183575302144,
    "uuid":"87d51179-b412-4d36-90cd-bc5deb0e785c",
    "raw_uuid":"278bf82f-0c40-40f7-a155-2f57b7f29c6b",
    "sector_size":512,
    "align":2097152,
    "blockdev":"pmem1",
    "supported_alignments":[
      4096,
      2097152,
      1073741824
    ]
  }
@tanabarr
Copy link
Author

filtering by NUMA node also seems to be broken in 64.1:

[root@wolf-121 ~]# ndctl list -v
[
  {
    "dev":"namespace1.0",
    "mode":"fsdax",
    "map":"dev",
    "size":3183575302144,
    "uuid":"7496f1db-e6ec-4ac0-b13e-729035747fdf",
    "raw_uuid":"ee8624f3-f3a7-4d81-b68d-2df81bc23c40",
    "sector_size":512,
    "align":2097152,
    "blockdev":"pmem1",
    "supported_alignments":[
      4096,
      2097152,
      1073741824
    ]
  },
  {
    "dev":"namespace0.0",
    "mode":"fsdax",
    "map":"dev",
    "size":3183575302144,
    "uuid":"38c7463a-898d-4f0b-83c4-6c36cadf3acb",
    "raw_uuid":"f6ade591-8106-43ab-aed1-eb327b32497d",
    "sector_size":512,
    "align":2097152,
    "blockdev":"pmem0",
    "supported_alignments":[
      4096,
      2097152,
      1073741824
    ]
  }
]
[root@wolf-121 ~]# ndctl list -U 0
[root@wolf-121 ~]# ndctl list -U 1
[root@wolf-121 ~]# ndctl version
64.1

@djbw
Copy link
Member

djbw commented Jan 21, 2020

@tanabarr you said you also updated from CentOS 7.6 to 7.7 are your 64.1 experiments on a different kernel? 64.1 looks ok to me on a v5.5-rc3 baseline, so I'd be interested to find out if this is a CentOS kernel regression.

@tanabarr
Copy link
Author

system that is returning numa_node as expected:

root@node-118 tanabarr]# uname -a
Linux node-118.<snip> 3.10.0-957.21.3.el7.x86_64 #1 SMP Tue Jun 18 16:35:19 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
[root@node-118 tanabarr]# cat /etc/redhat-release
CentOS Linux release 7.6.1810 (Core)
[root@node-118 tanabarr]# ndctl version
62

system that's not returning numa_node:

root@node-121 tanabarr]# uname -a
Linux node-121.<snip> 3.10.0-1062.1.1.el7.x86_64 #1 SMP Fri Sep 13 22:55:44 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
[root@node-121 tanabarr]# cat /etc/redhat-release
CentOS Linux release 7.7.1908 (Core)
[root@node-121 tanabarr]# ndctl version
64.1

@tanabarr
Copy link
Author

tanabarr commented Feb 5, 2020

any more info on this issue?

@djbw
Copy link
Member

djbw commented Apr 7, 2020

Can confirm that this is a kernel regression specific to the RHEL/CentOS 7.7 kernel. It appears fixed in the RHEL 8 series.

@tanabarr
Copy link
Author

tanabarr commented Apr 7, 2020

thanks

mjmac pushed a commit to daos-stack/daos that referenced this issue Feb 19, 2021
  * Validate the auto-generated config file after its creation.
  * Enable hostlist to be read from config file or overridden on cli.
  * Document limitation caused by github.com/pmem/ndctl/issues/130.

Signed-off-by: Tom Nabarro <tom.nabarro@intel.com>
@tanabarr
Copy link
Author

Regression fixed in CentOS 7.9 kernel.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants