A Small Optimization for File Directory Mapping

[hugo529100]

A Small Optimization for File Directory Mapping:

Could an option be added to "defer" or "lazy-load" a folder?

Here is the scenario: For example, the root directory of the home page or a certain directory mounts multiple folders from hard drives A, B, C, D, E, F, G. Once you enter the home page, it triggers all the hard drives to spin up simultaneously, which causes server lag and increases the risk of unstable current draw for the drives.

Since these are mapped file directories, it would be feasible to add a checkbox option in the settings panel for these "Shared files" folders, labeled something like "Persistent Mount" or "Lazy Mount." This way, when accessing the home page, not all dormant hard drives would be awakened at the same time. Instead, the corresponding hard drive would only spin up when you actually enter that specific folder.

[rejetto]

ok, it will be included in the next release.
do you want a preview so you can tell me if it works well for you?
if yes, tell me your platform as reported when hfs starts

[hugo529100]

Wow!!! Thank you so much! This is an extra boost that greatly improves access speed. I can just wait for the next version, so that it won't take up too much of your daily work and personal time. I check the HFS project homepage every two or three days, so I'll be able to catch the update in time. Besides, this issue has been around for quite a while, so there's no rush.

[hugo529100]

Here's the translation:

---

"Thank you very much for the timely update notification. I tested it today and it significantly saves time. The mechanical hard drive no longer starts up as frequently as before. I also happened to notice a small issue: folders or files containing the "@" character cause the server to crash. It doesn't shut down completely, but it automatically unloads some plugins and pops up an admin interface with a "no directory" error message. For now, I've batch-removed the "@" symbol from all affected files and folders on my end. I haven't found any other issues yet. If I do, I'll report them promptly."

[hugo529100]

"After looking into it further, it doesn't seem to be directly related to the '@' character. I think the real issue might be that my config.yaml is too complex — too many nested layers, or some paths are like www.some.com . Whenever I go into a folder with 300+ files, the server crashes and the config.yaml gets wiped clean. Still investigating what's actually causing it."

[rejetto]

indeed, @ is working fine in my tests.
i doubt the problem is config being "too complex".
i make my tests even with 70000 files without a problem.
let me know if you find more.
if you want you can send me your config and i'll see if, with a bit of luck, i can spot some possible problem.

[hugo529100]

"I found that another server also has this issue. It occurs when switching back and forth between photo-heavy albums. It doesn't cause an obvious server crash, but I can see that the config.yaml file size gets reset to a very small file, and then the plugin crashes and goes offline. Of course, I'm still investigating this. What's more awkward is that the scan plugin automatically flagged these as 'redundant invalid settings,' and since I have a lot of plugins enabled, it's possible that the crash is triggered by having too many plugins. But oddly enough, the issue only happens when switching between folders. So I'll need to test each plugin one by one to find the root cause."

"The main server has a file directory that is several times more complex, because the data directories from 10 hard drives have been cross-organized and consolidated into different folders for unified management, making it much harder to troubleshoot. However, I later discovered that another server also exhibits the same issue, and its file system is somewhat simpler, which should make it relatively easier to pinpoint the root cause."

config_no_passwords (1).yaml

the plugins i load
17:08:22 Loading plugin 404-jumper
17:08:22 Loading plugin AdminThemeCustomizer
17:08:22 Loading plugin Allow-IP-Change-Plugin
17:08:22 Loading plugin Banner-footer-plugin
17:08:22 Loading plugin Better-select
17:08:22 Loading plugin Cache-cleaner-plugin
17:08:22 Loading plugin Click-sounds
17:08:22 Loading plugin Copy-link
17:08:22 Loading plugin cors-main
17:08:22 Loading plugin Dashboard
17:08:22 Loading plugin Descripts-Backup
17:08:22 Loading plugin Disable-actions
17:08:22 Loading plugin Disk-info-plugin
17:08:22 Loading plugin Disk-monitor
17:08:22 Loading plugin Enter-key-helper
17:08:22 Loading plugin Errorsilencer
17:08:22 Loading plugin File-icon-fix
17:08:22 Loading plugin Fixed-folder-order
17:08:22 Loading plugin filessync-plugin
17:08:22 Loading plugin Frontend-performance-optimizer
17:08:22 Loading plugin Frontend-toggles
17:08:22 Loading plugin Gesture-navi-plugin
17:08:22 Loading plugin hfs-click-icon-to-show-main
17:08:22 Loading plugin hfs-purge-old-logs-main
17:08:22 Loading plugin hfs-simple-editor-master
17:08:22 Loading plugin Hide-file
17:08:22 Loading plugin HighContrastDisable
17:08:22 Loading plugin Json-db
17:08:22 Loading plugin Menu-Reorder
17:08:22 Loading plugin Musicplayer+
17:08:22 Loading plugin MVfiles-covers
17:08:22 Loading plugin Notes
17:08:22 Loading plugin Orange-theme-main
17:08:22 Loading plugin Orange-8bit-filter
17:08:22 Loading plugin P2P-remote-ctrl
17:08:22 Loading plugin QuickPages
17:08:22 Loading plugin Rightclick-menu
17:08:22 Loading plugin Scroll-position-Remember
17:08:22 Loading plugin sharp-main
17:08:22 Loading plugin show-any-main
17:08:22 Loading plugin Stop-images-on-navigate
17:08:22 Loading plugin unsupported-videos
17:08:22 Loading plugin Visited-filename
17:08:22 Loading plugin videojs-player-master
17:08:22 Loading plugin WalkieTalkie

08:25:09 Plugin "Config-audit":
========== Config Audit ==========

Found invalid items in config.yaml:

[frontend-toggles] - hideZipButton: true

[Scroll-back2Top] - delaySeconds: 3
[Scroll-back2Top] - idleSeconds: 3
[Scroll-back2Top] - delay: 10

[Musicplayer+] - show_visuals: true
[Musicplayer+] - custom_button_folder: "/Music/CloudMusic/"
[Musicplayer+] - custom_button_action: "go_to_folder"
[Musicplayer+] - ffmpeg_path: "ffmpeg.exe"
[Musicplayer+] - lossless_decode: true
[Musicplayer+] - lossless_decoding: true
[Musicplayer+] - remote_control: true
[Musicplayer+] - hide_back_button: true

[sync-client] - ffmpegExe: "ffmpeg.exe"
[sync-client] - autoStartFFmpeg: true
[sync-client] - autoStartWebRTC: true
[sync-client] - webrtcExe: "sgcWebRTCServer.exe"
[sync-client] - syncStatus: {"status":"error","message":"⛔ server 結束，退出碼: 1"}
[sync-client] - listenAllIP: "true"
[sync-client] - enableLogging: "true"
[sync-client] - syncPrecision: "high"
[sync-client] - localOnly: true
[sync-client] - syncInterval: 30
[sync-client] - debugLog: "true"
[sync-client] - playbackDelay: 12
[sync-client] - timeSyncInterval: 1000

[Disable-actions] - blockMenusWhenNotLoggedIn: false
[Disable-actions] - rightClickMenuType: "hfs"

[filessync-plugin] - localPath: "/Pictures/SYNC/"
[filessync-plugin] - remoteUrl: "http://192.168.1.224/Musics/E-Music/John%20Williams,Y%C3%B6,%E9%A9%AC%E5%8F%8B%E5%8F%8B"
[filessync-plugin] - backupInterval: 7
[filessync-plugin] - remoteAddress: "http://192.168.1.224/Musics/E-Music/John%20Williams,Y%C3%B6,%E9%A9%AC%E5%8F%8B%E5%8F%8B/"
[filessync-plugin] - localFolder: "C:\SYNC"
[filessync-plugin] - excludeFolders: "www.toptoonmh.com,img.ymmh01.top,www.toptoonmh.com,nizhidaoma.bqulou.com,img.imh99.top,www.nainiumh.top,www.luchuxuedh.xyz,www.googletagmanager.com,cdn.jsdelivr.net,statics.huzhan.com,res.wx.qq.com,wsx.acqc9.com,zyt.cjcvd6.com"
[filessync-plugin] - mirrorMode: true
[filessync-plugin] - concurrentExplorers: 2
[filessync-plugin] - concurrency: 3

[Show-cover] - defaultCover: "/images/banner/cover.gif"
[Show-cover] - maxCoverHeightValue: 100
[Show-cover] - maxCoverHeightUnit: "%"

[unsupported-videos] - mp4_compatibility_mode: true

[P2P-remote-ctrl] - maxRetries: 5
[P2P-remote-ctrl] - retryDelay: 3000

[getfilelist-cache] - fileThreshold: 1

[HHDlisting-speedup] - folderName: "cache"
[HHDlisting-speedup] - cacheStrategy: "validate"
[HHDlisting-speedup] - cacheFolder: "cache"

[Lazyloading] - regenerateBefore: "2025-11-09T12:54:28.943Z"

[Orange-8bit-filter] - crt: false
[Orange-8bit-filter] - levels: 8

[Visited-filename] - keepMinutes: 60

[404-jumper] - closeInsteadOfHome: true

[Fixed-folder-order] - folderOrder: [{"name":"Musics"}]
[Fixed-folder-order] - alwaysLast: "temp\ncache"
[Fixed-folder-order] - alwaysFirst: ".mp4\n.jpeg\n*.jpg\n*.png\n*.stl\n*.dwg\n*.txt\n*.htm\n*.html"

[Click-sounds] - enableVibrate: true

[Virtual-Folder-Snapshot] - checkDelay: 10
[Virtual-Folder-Snapshot] - cooldown: 30
[Virtual-Folder-Snapshot] - cooldownMinutes: 0

[Notes] - tabs: "General,Ideas,TODO"

[Scroll-position-Remember] - scrollMemoryEnabled: true
[Scroll-position-Remember] - gestureBackEnabled: true
[Scroll-position-Remember] - backspaceBackEnabled: true

[WalkieTalkie] - voiceQuality: "Medium (16kHz, mono)"
[WalkieTalkie] - wsExePath: "ws_server_pure.exe"

========== End Audit ==========

[hugo529100]

indeed, @ is working fine in my tests. i doubt the problem is config being "too complex". i make my tests even with 70000 files without a problem. let me know if you find more. if you want you can send me your config and i'll see if, with a bit of luck, i can spot some possible problem.

"The current debugging progress is as follows: when the titles setting is very small, the photo album, or when encountering a large number of music files that reference my MVfiles-covers plugin, once you enter a large album and then quickly switch to other directories repeatedly many times, the server crashes. It appears that this is all triggered by an interruption in the processing of the thumbnails-main plugin.

So, I disabled the thumbnails-main plugin, and everything works fine. I estimate that I need to implement rate limiting for thumbnails or sharp..."

[hugo529100]

"Unfortunately, my MVfiles-covers plugin also bypasses your thumbnails-main plugin when it comes to GIF references. With the thumbnails-main plugin disabled and the MVfiles-covers plugin running independently, the same issue occurs when referencing a large number of GIFs. So, it's probably not a thumbnail issue, but rather a crash caused by burst/concurrent access volume."

[rejetto]

from what you say, it seems that it's a problem related to your plugin.
you don't have to give me all the details unless you find a real bug in hfs or someone else's plugin.
can we say the problem of the title of this discussion is solved?

[hugo529100]

Uploading [SHANA]VID_20260806_231944.mp4…

[hugo529100]

Only this version has this crash issue. You just need to enable Sharp and Thumbnails, then find an album, quickly enter and switch back and forth a few times, and the bug can be triggered. Especially when titles mode=1, scrolling the page and then quickly switching will trigger it. If there are many plugins loaded, it may cause config.yaml to be cleared.

[hugo529100]

SHANA.VID_20260806_231944.mp4

[hugo529100]

"If I enable only my GIF plugin, the issue persists. The plugin does not connect the Sharp and Thumbnails plugin at all — it merely overlays a GIF image onto all icons, yet this alone is sufficient to bring down the server. Furthermore, activating just this one plugin is all that is required to trigger the crash."

[rejetto]

wait, in your video you were showing that only sharp and thumbnails were active, and it crashed. right?
so now you get the same with sharp and thumbnails OFF ?

[hugo529100]

yes same with sharp and thumbnails on/off if the burst access

[rejetto]

admin > logs > options > "debug messages in console"

enable this to get potentially more info

[rejetto]

i'm now reproducing the problem.
i can tell, for now, that it's not crashing: it's resetting the configuration.
if you restore the configuration, it works again, without restarting.
i'll keep studying.

[hugo529100]

yes not crash ,just reset the config

[rejetto]

it seems to happen only on Windows, and not on my mac.
it doesn't need to "tiles".
it happens when you load many thumbnails at once, switching pages.
i'm still working on it.

[rejetto]

it seems that the problem is a regression of 3.3.0-beta2 – i'm working to fix it.
and it's not triggered by thumbnails, but by many requests (caused by thumbnails in this case).
your config, even if it's lost, should be present in config.yaml.bak

[hugo529100]

"Apologies for the delayed reply — I was away from computer during my break (Beijing time, UTC+8) and couldn't respond in time. Yes, the situation is exactly as you see. Fortunately, I have the backup (.bak) file, so I can make a backup copy, restore the server promptly, and investigate the root cause.

Thank you very much for timely response and for verifying the issue so quickly."

trans deepseek

抱歉遲來的答復，剛好我這邊+8北京時間休息離開了電腦未能及時回應。是的正如您提及到的情況一致，所以幸運的是有bak文件，所以我可以做一個備份并且及時恢復服務器以及查找問題。
非常感謝您的及時回復以及短時間驗證了這個問題。

[rejetto]

cool! published beta3.
now i won't be home for 2 days, and i won't have my pc

[rejetto]

Haha~~ I've found that there's still a chance of plugins reloading or failing to load occasionally when entering an album with a lot of thumbnails. Looks like it needs a bit more fine-tuning. This issue wasn't present in 3.3.0-beta1.

plugins reloading when entering an album? what does that mean?

[hugo529100]

Under the same circumstances, it still triggers a reload of config.yaml when entering a gallery with a large number of images, similar to the previous situation, though the probability is much lower. Since the last update from beta3 to beta4, I have observed this once so far. The last time I checked the console, it showed a few plugins with an unload prompt. I am currently still trying to reproduce this issue to determine whether it is caused by my own setup.

[rejetto]

ok so it's plugin "unloading" not "reloading". It is very strange, because i made several tests and the config file is never touched. Let me know if you see the same problem again.

[hugo529100]

"Okay, I'll keep using it and provide timely report. Many thanks for your reply, and for fixing this issue and boosting the performance before!"

好的好的 我會繼續繼續使用和及時匯報請情況，也非常感謝您的答復以及之前解決了這個問題并且提升了性能！

[rejetto]

a week has passed, did you see the problem again?