feat: add ut and bump go to 1.25 and FUSE3: auto-detects fusermount or fusermount3; falls back to direct mount if neither found. Configurable modes: new flags --fs-file-mode, --fs-dir-mode, --fs-link-mode (octal, e.g. 0400/0500). Non-nydus clarity: returns ENOENT for diff on non-nydus layers; blob/info still available. Crash recovery: best-effort unmount of orphan bind mounts at startup." by fatelei · Pull Request #162 · containers/nydus-storage-plugin

fatelei · 2025-10-26T14:54:34Z

feat: add ut and bump go to 1.25 and FUSE3: auto-detects fusermount or fusermount3; falls back to direct mount if neither found. Configurable modes: new flags --fs-file-mode, --fs-dir-mode, --fs-link-mode (octal, e.g. 0400/0500). Non-nydus clarity: returns ENOENT for diff on non-nydus layers; blob/info still available. Crash recovery: best-effort unmount of orphan bind mounts at startup."

imeoer · 2025-10-27T11:28:10Z

Thanks for the PR, we can start by fixing the broken CI and DCO check, and squashing commits. :)

Signed-off-by: fatelei <fatelei@gmail.com>

…r fusermount3; falls back to direct mount if neither found. Configurable modes: new flags --fs-file-mode, --fs-dir-mode, --fs-link-mode (octal, e.g. 0400/0500). Non-nydus clarity: returns ENOENT for diff on non-nydus layers; blob/info still available. Crash recovery: best-effort unmount of orphan bind mounts at startup. Signed-off-by: fatelei <fatelei@gmail.com>

Signed-off-by: fatelei <fatelei@gmail.com>

nibble0x2 · 2025-12-14T04:09:51Z

was trying to run these changes locally with podman 4.9 and nydus 2.3.9 -

seems there is Loop between store/snapshotID/layerDigest/diff and rafs/snapshotId/mnt as stat command on /diff throw error Too many levels of symbolic links.

logs from sudo dmesg -w -

[177319.197683] INFO: task nydus-store:346306 blocked for more than 368 seconds.
[177319.197684]       Tainted: G           OE      6.8.0-88-generic #89-Ubuntu
[177319.197686] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[177319.197687] task:nydus-store    state:D stack:0     pid:346306 tgid:345647 ppid:291011 flags:0x00000002
[177319.197689] Call Trace:
[177319.197690]  <TASK>
[177319.197691]  __schedule+0x27c/0x6b0
[177319.197695]  schedule+0x33/0x110
[177319.197698]  d_alloc_parallel+0x30e/0x3e0
[177319.197701]  ? __pfx_default_wake_function+0x10/0x10
[177319.197704]  __lookup_slow+0x5c/0x130
[177319.197707]  walk_component+0x117/0x190
[177319.197710]  path_lookupat+0x6a/0x1b0
[177319.197713]  filename_lookup+0xe4/0x200
[177319.197718]  vfs_statx+0x95/0x1d0
[177319.197721]  vfs_fstatat+0xaa/0xe0
[177319.197723]  __do_sys_newfstatat+0x44/0x90
[177319.197727]  __x64_sys_newfstatat+0x1c/0x30
[177319.197730]  x64_sys_call+0x2505/0x25a0
[177319.197731]  do_syscall_64+0x7f/0x180
[177319.197734]  ? update_load_avg+0x82/0x850
[177319.197737]  ? update_load_avg+0x82/0x850
[177319.197739]  ? set_next_entity+0xd7/0x1a0
[177319.197741]  ? pick_next_task_fair+0x367/0x620
[177319.197744]  ? os_xsave+0x2e/0x70
[177319.197748]  ? rseq_get_rseq_cs+0x22/0x280
[177319.197751]  ? rseq_ip_fixup+0x90/0x1f0
[177319.197753]  ? restore_fpregs_from_fpstate+0x3d/0xd0
[177319.197756]  ? switch_fpu_return+0x55/0xf0
[177319.197757]  ? arch_exit_to_user_mode_prepare.isra.0+0x95/0xe0
[177319.197759]  ? irqentry_exit_to_user_mode+0x38/0x1e0
[177319.197761]  ? irqentry_exit+0x43/0x50
[177319.197763]  entry_SYSCALL_64_after_hwframe+0x78/0x80
[177319.197765] RIP: 0033:0x407d2e
[177319.197768] RSP: 002b:000000c0003e4c80 EFLAGS: 00000216 ORIG_RAX: 0000000000000106
[177319.197770] RAX: ffffffffffffffda RBX: ffffffffffffff9c RCX: 0000000000407d2e
[177319.197771] RDX: 000000c0005dec68 RSI: 000000c0000ca240 RDI: ffffffffffffff9c
[177319.197772] RBP: 000000c0003e4cc0 R08: 0000000000000000 R09: 0000000000000000
[177319.197773] R10: 0000000000000000 R11: 0000000000000216 R12: 000000c0000ca240
[177319.197774] R13: 0000000000000000 R14: 000000c0000a28c0 R15: 07ffffffffffffff
[177319.197777]  </TASK>

[230724.197402] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230777.595637] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230777.595764] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230784.210701] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230784.210936] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230797.578002] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230797.578916] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230797.578998] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230801.538405] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230801.541827] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230801.542235] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230806.658285] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230806.658417] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230864.578949] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230864.579676] VFS: Lookup of 'diff' in fuse fuse would have caused loop

sorry I have limited understanding around these - but is it a right thing to do i.e binding between two FUSE (FUSE RAFS & FUSE store) mounts?

mount info -

nydusstore on /home/machine/git_projects/nydus-storage-plugin/temp/store type fuse.rawBridge (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000,allow_other,max_read=131072)

rafs on /home/machine/git_projects/nydus-storage-plugin/temp/snapshots/bG9jYWxob3N0OjUwMDAvaGVsbG8td29ybGQ6bnlkdXMtMi4zLjk=/mnt type fuse (ro,nosuid,nodev,noatime,user_id=1000,group_id=1000,default_permissions,allow_other,max_read=1052672)

fatelei · 2025-12-14T06:32:05Z

was trying to run these changes locally with podman 4.9 and nydus 2.3.9 -

seems there is Loop between store/snapshotID/layerDigest/diff and rafs/snapshotId/mnt as stat command on /diff throw error Too many levels of symbolic links.

logs from sudo dmesg -w -

[177319.197683] INFO: task nydus-store:346306 blocked for more than 368 seconds.
[177319.197684]       Tainted: G           OE      6.8.0-88-generic #89-Ubuntu
[177319.197686] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[177319.197687] task:nydus-store    state:D stack:0     pid:346306 tgid:345647 ppid:291011 flags:0x00000002
[177319.197689] Call Trace:
[177319.197690]  <TASK>
[177319.197691]  __schedule+0x27c/0x6b0
[177319.197695]  schedule+0x33/0x110
[177319.197698]  d_alloc_parallel+0x30e/0x3e0
[177319.197701]  ? __pfx_default_wake_function+0x10/0x10
[177319.197704]  __lookup_slow+0x5c/0x130
[177319.197707]  walk_component+0x117/0x190
[177319.197710]  path_lookupat+0x6a/0x1b0
[177319.197713]  filename_lookup+0xe4/0x200
[177319.197718]  vfs_statx+0x95/0x1d0
[177319.197721]  vfs_fstatat+0xaa/0xe0
[177319.197723]  __do_sys_newfstatat+0x44/0x90
[177319.197727]  __x64_sys_newfstatat+0x1c/0x30
[177319.197730]  x64_sys_call+0x2505/0x25a0
[177319.197731]  do_syscall_64+0x7f/0x180
[177319.197734]  ? update_load_avg+0x82/0x850
[177319.197737]  ? update_load_avg+0x82/0x850
[177319.197739]  ? set_next_entity+0xd7/0x1a0
[177319.197741]  ? pick_next_task_fair+0x367/0x620
[177319.197744]  ? os_xsave+0x2e/0x70
[177319.197748]  ? rseq_get_rseq_cs+0x22/0x280
[177319.197751]  ? rseq_ip_fixup+0x90/0x1f0
[177319.197753]  ? restore_fpregs_from_fpstate+0x3d/0xd0
[177319.197756]  ? switch_fpu_return+0x55/0xf0
[177319.197757]  ? arch_exit_to_user_mode_prepare.isra.0+0x95/0xe0
[177319.197759]  ? irqentry_exit_to_user_mode+0x38/0x1e0
[177319.197761]  ? irqentry_exit+0x43/0x50
[177319.197763]  entry_SYSCALL_64_after_hwframe+0x78/0x80
[177319.197765] RIP: 0033:0x407d2e
[177319.197768] RSP: 002b:000000c0003e4c80 EFLAGS: 00000216 ORIG_RAX: 0000000000000106
[177319.197770] RAX: ffffffffffffffda RBX: ffffffffffffff9c RCX: 0000000000407d2e
[177319.197771] RDX: 000000c0005dec68 RSI: 000000c0000ca240 RDI: ffffffffffffff9c
[177319.197772] RBP: 000000c0003e4cc0 R08: 0000000000000000 R09: 0000000000000000
[177319.197773] R10: 0000000000000000 R11: 0000000000000216 R12: 000000c0000ca240
[177319.197774] R13: 0000000000000000 R14: 000000c0000a28c0 R15: 07ffffffffffffff
[177319.197777]  </TASK>

[230724.197402] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230777.595637] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230777.595764] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230784.210701] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230784.210936] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230797.578002] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230797.578916] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230797.578998] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230801.538405] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230801.541827] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230801.542235] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230806.658285] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230806.658417] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230864.578949] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230864.579676] VFS: Lookup of 'diff' in fuse fuse would have caused loop

sorry I have limited understanding around these - but is it a right thing to do i.e binding between two FUSE (FUSE RAFS & FUSE store) mounts?

mount info -

nydusstore on /home/machine/git_projects/nydus-storage-plugin/temp/store type fuse.rawBridge (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000,allow_other,max_read=131072)

rafs on /home/machine/git_projects/nydus-storage-plugin/temp/snapshots/bG9jYWxob3N0OjUwMDAvaGVsbG8td29ybGQ6bnlkdXMtMi4zLjk=/mnt type fuse (ro,nosuid,nodev,noatime,user_id=1000,group_id=1000,default_permissions,allow_other,max_read=1052672)

i will dig the error

nibble0x2 · 2025-12-14T14:56:46Z

was trying to run these changes locally with podman 4.9 and nydus 2.3.9 -
seems there is Loop between store/snapshotID/layerDigest/diff and rafs/snapshotId/mnt as stat command on /diff throw error Too many levels of symbolic links.
logs from sudo dmesg -w -

[177319.197683] INFO: task nydus-store:346306 blocked for more than 368 seconds.
[177319.197684]       Tainted: G           OE      6.8.0-88-generic #89-Ubuntu
[177319.197686] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[177319.197687] task:nydus-store    state:D stack:0     pid:346306 tgid:345647 ppid:291011 flags:0x00000002
[177319.197689] Call Trace:
[177319.197690]  <TASK>
[177319.197691]  __schedule+0x27c/0x6b0
[177319.197695]  schedule+0x33/0x110
[177319.197698]  d_alloc_parallel+0x30e/0x3e0
[177319.197701]  ? __pfx_default_wake_function+0x10/0x10
[177319.197704]  __lookup_slow+0x5c/0x130
[177319.197707]  walk_component+0x117/0x190
[177319.197710]  path_lookupat+0x6a/0x1b0
[177319.197713]  filename_lookup+0xe4/0x200
[177319.197718]  vfs_statx+0x95/0x1d0
[177319.197721]  vfs_fstatat+0xaa/0xe0
[177319.197723]  __do_sys_newfstatat+0x44/0x90
[177319.197727]  __x64_sys_newfstatat+0x1c/0x30
[177319.197730]  x64_sys_call+0x2505/0x25a0
[177319.197731]  do_syscall_64+0x7f/0x180
[177319.197734]  ? update_load_avg+0x82/0x850
[177319.197737]  ? update_load_avg+0x82/0x850
[177319.197739]  ? set_next_entity+0xd7/0x1a0
[177319.197741]  ? pick_next_task_fair+0x367/0x620
[177319.197744]  ? os_xsave+0x2e/0x70
[177319.197748]  ? rseq_get_rseq_cs+0x22/0x280
[177319.197751]  ? rseq_ip_fixup+0x90/0x1f0
[177319.197753]  ? restore_fpregs_from_fpstate+0x3d/0xd0
[177319.197756]  ? switch_fpu_return+0x55/0xf0
[177319.197757]  ? arch_exit_to_user_mode_prepare.isra.0+0x95/0xe0
[177319.197759]  ? irqentry_exit_to_user_mode+0x38/0x1e0
[177319.197761]  ? irqentry_exit+0x43/0x50
[177319.197763]  entry_SYSCALL_64_after_hwframe+0x78/0x80
[177319.197765] RIP: 0033:0x407d2e
[177319.197768] RSP: 002b:000000c0003e4c80 EFLAGS: 00000216 ORIG_RAX: 0000000000000106
[177319.197770] RAX: ffffffffffffffda RBX: ffffffffffffff9c RCX: 0000000000407d2e
[177319.197771] RDX: 000000c0005dec68 RSI: 000000c0000ca240 RDI: ffffffffffffff9c
[177319.197772] RBP: 000000c0003e4cc0 R08: 0000000000000000 R09: 0000000000000000
[177319.197773] R10: 0000000000000000 R11: 0000000000000216 R12: 000000c0000ca240
[177319.197774] R13: 0000000000000000 R14: 000000c0000a28c0 R15: 07ffffffffffffff
[177319.197777]  </TASK>

[230724.197402] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230777.595637] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230777.595764] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230784.210701] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230784.210936] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230797.578002] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230797.578916] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230797.578998] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230801.538405] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230801.541827] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230801.542235] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230806.658285] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230806.658417] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230864.578949] VFS: Lookup of 'diff' in fuse fuse would have caused loop
[230864.579676] VFS: Lookup of 'diff' in fuse fuse would have caused loop

sorry I have limited understanding around these - but is it a right thing to do i.e binding between two FUSE (FUSE RAFS & FUSE store) mounts?
mount info -

nydusstore on /home/machine/git_projects/nydus-storage-plugin/temp/store type fuse.rawBridge (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000,allow_other,max_read=131072)

rafs on /home/machine/git_projects/nydus-storage-plugin/temp/snapshots/bG9jYWxob3N0OjUwMDAvaGVsbG8td29ybGQ6bnlkdXMtMi4zLjk=/mnt type fuse (ro,nosuid,nodev,noatime,user_id=1000,group_id=1000,default_permissions,allow_other,max_read=1052672)

i will dig the error

Thanks! let me know if you are not able to reproduce it...

fatelei force-pushed the diff1 branch from 5b94a42 to 0affa4a Compare October 26, 2025 14:57

fatelei added 7 commits October 28, 2025 11:18

fix: fix read diff1 directory

e8df599

Signed-off-by: fatelei <fatelei@gmail.com>

fix: fix when mount nydus layer failed not return error

2b070b1

Signed-off-by: fatelei <fatelei@gmail.com>

fix: fix nil

cef0ca7

Signed-off-by: fatelei <fatelei@gmail.com>

refactor: refactor this plugin

638e178

Signed-off-by: fatelei <fatelei@gmail.com>

chore: upgrade go version

eda3a1a

Signed-off-by: fatelei <fatelei@gmail.com>

fix: fix lint error

956d9db

Signed-off-by: fatelei <fatelei@gmail.com>

fatelei force-pushed the diff1 branch from 18943fe to 956d9db Compare October 28, 2025 03:18

fatelei added 16 commits December 15, 2025 12:20

fix: fix mount fuse

e5bf029

fix: fix log

742de0e

fix: fix readdir

be79ae5

fix: fix layer inspect

51f3baf

chore: add debug log

1295bee

chore: debug me

d2d51de

chore: debug me

98ad75d

chore: debug me

4279737

chore: debug me

1269170

chore: debug me

70f9150

chore: debug me

0e48b71

chore: debug me

79116e1

chore: debug me

f698e4f

chore: debug me

24d6cf3

chore: add missing file

81cd4af

chore: debug me

3d8580d

imeoer mentioned this pull request Jan 14, 2026

[RAFS v6] invalid chunk table offset 0x6b000/size 0x31240 in Rafs v6 extended superblock dragonflyoss/nydus#1818

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

fatelei commented Oct 26, 2025

Uh oh!

imeoer commented Oct 27, 2025 •

edited

Loading

Uh oh!

nibble0x2 commented Dec 14, 2025

Uh oh!

fatelei commented Dec 14, 2025

Uh oh!

nibble0x2 commented Dec 14, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

fatelei commented Oct 26, 2025

Uh oh!

imeoer commented Oct 27, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nibble0x2 commented Dec 14, 2025

Uh oh!

fatelei commented Dec 14, 2025

Uh oh!

nibble0x2 commented Dec 14, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

imeoer commented Oct 27, 2025 •

edited

Loading