Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Connecting LDAP with SMB eats space from disk #11743

Closed
enoch85 opened this issue Oct 10, 2018 · 19 comments
Closed

Connecting LDAP with SMB eats space from disk #11743

enoch85 opened this issue Oct 10, 2018 · 19 comments
Labels
bug feature: ldap

Comments

@enoch85
Copy link
Member

enoch85 commented Oct 10, 2018 •
edited
Loading

Steps to reproduce

  1. Install Nextcloud with PostgreSQL (Nextcloud VM)
  2. Activate SMB (everything is normal)
  3. Activate LDAP and connect to Active Directory

Expected behavior

The space on the disk should remain the same

Actual behaviour

Something is eating space from the disk, and when running du -h on /var/lib/10/postgres/main/base you can see that something in Postgres is creating multiple files (probably binary) every second that make the folder grow.

Here is the path of the files that grow, the bottom files from 17551 are the ones affected.

-rw------- 1 postgres postgres    139264 Oct 10 20:22 2840
-rw------- 1 postgres postgres    147456 Oct 10 19:57 2604
-rw------- 1 postgres postgres    163840 Oct 10 20:22 1259
-rw------- 1 postgres postgres    188416 Oct 10 19:53 2658
-rw------- 1 postgres postgres    196608 Sep  7 17:34 2675
-rw------- 1 postgres postgres    204800 Sep  7 17:28 3456
-rw------- 1 postgres postgres    253952 Oct 10 20:22 2619
-rw------- 1 postgres postgres    270336 Sep  7 17:28 2691
-rw------- 1 postgres postgres    327680 Sep  7 17:33 2609
-rw------- 1 postgres postgres    409600 Oct 10 19:53 2673
-rw------- 1 postgres postgres    417792 Sep  7 17:28 2838
-rw------- 1 postgres postgres    450560 Oct 10 19:53 2674
-rw------- 1 postgres postgres    516096 Oct 10 19:52 2608
-rw------- 1 postgres postgres    606208 Sep  7 17:28 1255
-rw------- 1 postgres postgres    679936 Oct 10 20:03 17313
-rw------- 1 postgres postgres    770048 Oct 10 20:17 1249
-rw------- 1 postgres postgres  12402688 Oct 10 20:23 17551
-rw------- 1 postgres postgres  15712256 Oct 10 20:23 17557
-rw------- 1 postgres postgres  20520960 Oct 10 20:23 17555
-rw------- 1 postgres postgres  20553728 Oct 10 20:23 17554
-rw------- 1 postgres postgres  30302208 Oct 10 20:23 17556
-rw------- 1 postgres postgres  32612352 Oct 10 20:23 17553
-rw------- 1 postgres postgres  47464448 Oct 10 20:23 17552
-rw------- 1 postgres postgres 198238208 Oct 10 20:23 17545
root@nextcloud:/var/lib/postgresql/10/main/base/16385#

Server configuration detail

Operating system: Linux 4.15.0-36-generic #39-Ubuntu SMP Mon Sep 24 16:19:09 UTC 2018 x86_64

Webserver: Apache/2.4.29 (Ubuntu) (fpm-fcgi)

Database: pgsql PostgreSQL 10.5 (Ubuntu 10.5-0ubuntu0.18.04) on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 7.3.0-16ubuntu3) 7.3.0, 64-bit

PHP version:

7.2.10-0ubuntu0.18.04.1
Modules loaded: Core, date, libxml, openssl, pcre, zlib, filter, hash, Reflection, SPL, sodium, session, standard, cgi-fcgi, redis, PDO, xml, bz2, calendar, ctype, curl, dom, mbstring, fileinfo, ftp, gd, gettext, gmp, iconv, igbinary, imagick, imap, intl, json, ldap, exif, pdo_pgsql, pgsql, Phar, posix, readline, shmop, SimpleXML, smbclient, soap, sockets, sysvmsg, sysvsem, sysvshm, tokenizer, wddx, xmlreader, xmlwriter, xsl, zip, libsmbclient, Zend OPcache

Nextcloud version: 14.0.1 - 14.0.1.1

Updated from an older Nextcloud/ownCloud or fresh install: Updated from 14.0.0

Where did you install Nextcloud from: unknown

Signing status

Array
(
)

List of activated apps 
Enabled:
 - accessibility: 1.0.1
 - cloud_federation_api: 0.0.1
 - comments: 1.4.0
 - dav: 1.6.0
 - federatedfilesharing: 1.4.0
 - federation: 1.4.0
 - files: 1.9.0
 - files_external: 1.5.0
 - files_pdfviewer: 1.3.2
 - files_sharing: 1.6.2
 - files_texteditor: 2.6.0
 - files_trashbin: 1.4.1
 - files_versions: 1.7.1
 - files_videoplayer: 1.3.0
 - issuetemplate: 0.4.0
 - logreader: 2.0.0
 - lookup_server_connector: 1.2.0
 - nextcloud_announcements: 1.3.0
 - notifications: 2.2.1
 - oauth2: 1.2.1
 - password_policy: 1.4.0
 - provisioning_api: 1.4.0
 - serverinfo: 1.4.0
 - sharebymail: 1.4.0
 - survey_client: 1.2.0
 - systemtags: 1.4.0
 - theming: 1.5.0
 - twofactor_backupcodes: 1.3.1
 - updatenotification: 1.4.1
 - user_external: 0.4
 - user_ldap: 1.4.0
 - workflowengine: 1.4.0
Disabled:
 - activity
 - admin_audit
 - encryption
 - firstrunwizard
 - gallery
Configuration (config/config.php) 
{
    "passwordsalt": "***REMOVED SENSITIVE VALUE***",
    "secret": "***REMOVED SENSITIVE VALUE***",
    "trusted_domains": [
        "localhost",
        "172.30.100.189",
        "molnet.elektronikhuset.it",
        "molnet.elektronikhuset.it"
    ],
    "datadirectory": "***REMOVED SENSITIVE VALUE***",
    "dbtype": "pgsql",
    "version": "14.0.1.1",
    "overwrite.cli.url": "https:\/\/molnet.elektronikhuset.it\/",
    "dbname": "***REMOVED SENSITIVE VALUE***",
    "dbhost": "***REMOVED SENSITIVE VALUE***",
    "dbport": "",
    "dbtableprefix": "oc_",
    "dbuser": "***REMOVED SENSITIVE VALUE***",
    "dbpassword": "***REMOVED SENSITIVE VALUE***",
    "installed": true,
    "instanceid": "***REMOVED SENSITIVE VALUE***",
    "mail_smtpmode": "smtp",
    "log_rotate_size": "10485760",
    "memcache.local": "\\OC\\Memcache\\Redis",
    "filelocking.enabled": true,
    "memcache.distributed": "\\OC\\Memcache\\Redis",
    "memcache.locking": "\\OC\\Memcache\\Redis",
    "redis": {
        "host": "***REMOVED SENSITIVE VALUE***",
        "port": 0,
        "timeout": 0.5,
        "dbindex": 0,
        "password": "***REMOVED SENSITIVE VALUE***"
    },
    "htaccess.RewriteBase": "\/",
    "maintenance": false,
    "loglevel": 2,
    "ldapIgnoreNamingRules": false,
    "ldapProviderFactory": "OCA\\User_LDAP\\LDAPProviderFactory"
}

Are you using external storage, if yes which one: local/smb/sftp/...

Are you using encryption:

Are you using an external user-backend, if yes which one: LDAP

LDAP configuration (delete this par if not used) 
background_sync_interval: 43200background_sync_offset: 0background_sync_prefix: s01cleanUpJobOffset: 50enabled: yesinstalled_version: 1.4.0s01_lastChange: 1539194171s01has_memberof_filter_support: 1s01home_folder_naming_rule: attr:sAMAccountNames01last_jpegPhoto_lookup: 0s01ldap_agent_password: IWU1JWg4PUhFs01ldap_attributes_for_group_search: s01ldap_attributes_for_user_search: s01ldap_backup_host: s01ldap_backup_port: s01ldap_base: DC=ad01,DC=locals01ldap_base_groups: DC=ad01,DC=locals01ldap_base_users: DC=ad01,DC=locals01ldap_cache_ttl: 600s01ldap_configuration_active: 1s01ldap_default_ppolicy_dn: s01ldap_display_name: displaynames01ldap_dn: CN=Administrator,CN=Users,DC=ad01,DC=locals01ldap_dynamic_group_member_url: s01ldap_email_attr: mails01ldap_experienced_admin: 0s01ldap_expert_username_attr: sAMAccountNames01ldap_expert_uuid_group_attr: s01ldap_expert_uuid_user_attr: s01ldap_gid_number: gidNumbers01ldap_group_display_name: cns01ldap_group_filter: (|(cn=Kund-Emoln-DelaFiler)(cn=Kund-Emoln-Dokument)(cn=Kund-Emoln-Grund)(cn=Kund-Emoln-HemMapp)(cn=Kund-Emoln-Kalender)(cn=Kund-Emoln-Kontakter)(cn=Kund-Emoln-Mail)(cn=Kund-Emoln-Mail-Roundcube)(cn=Kund-Emoln-MappElektronikhuset))s01ldap_group_filter_mode: 0s01ldap_group_member_assoc_attribute: members01ldap_groupfilter_groups: Kund-Emoln-DelaFiler
Kund-Emoln-Dokument
Kund-Emoln-Grund
Kund-Emoln-HemMapp
Kund-Emoln-Kalender
Kund-Emoln-Kontakter
Kund-Emoln-Mail
Kund-Emoln-Mail-Roundcube
Kund-Emoln-MappElektronikhusets01ldap_groupfilter_objectclass: s01ldap_host: 172.30.100.5s01ldap_login_filter: (&(&(|(objectclass=person))(|(|(memberof=CN=Kund-Emoln-HemMapp,OU=Group,OU=EMoln,OU=Kunder,DC=ad01,DC=local)(primaryGroupID=1264))(|(memberof=CN=Kund-Emoln-Grund,OU=Group,OU=EMoln,OU=Kunder,DC=ad01,DC=local)(primaryGroupID=1326))))(|(samaccountname=%uid)(|(mailPrimaryAddress=%uid)(mail=%uid))(|(userPrincipalName=%uid))))s01ldap_login_filter_mode: 0s01ldap_loginfilter_attributes: userPrincipalNames01ldap_loginfilter_email: 1s01ldap_loginfilter_username: 1s01ldap_nested_groups: 0s01ldap_override_main_server: s01ldap_paging_size: 500s01ldap_port: 389s01ldap_quota_attr: s01ldap_quota_def: s01ldap_tls: 0s01ldap_turn_off_cert_check: 0s01ldap_turn_on_pwd_change: 0s01ldap_user_avatar_rule: defaults01ldap_user_display_name_2: s01ldap_user_filter_mode: 1s01ldap_userfilter_groups: Kund-Emoln-HemMapp
Kund-Emoln-Grunds01ldap_userfilter_objectclass: persons01ldap_userlist_filter: (&(|(objectclass=person))(|(|(memberof=CN=Kund-Emoln-HemMapp,OU=Group,OU=EMoln,OU=Kunder,DC=ad01,DC=local)(primaryGroupID=1264))(|(memberof=CN=Kund-Emoln-Grund,OU=Group,OU=EMoln,OU=Kunder,DC=ad01,DC=local)(primaryGroupID=1326))))s01use_memberof_to_detect_membership: 1types: authentication

Client configuration

Browser: Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Safari/537.36

Operating system: Windows Server 2012R2

Logs

Browser log 
-rw------- 1 postgres postgres    139264 Oct 10 20:22 2840
-rw------- 1 postgres postgres    147456 Oct 10 19:57 2604
-rw------- 1 postgres postgres    163840 Oct 10 20:22 1259
-rw------- 1 postgres postgres    188416 Oct 10 19:53 2658
-rw------- 1 postgres postgres    196608 Sep  7 17:34 2675
-rw------- 1 postgres postgres    204800 Sep  7 17:28 3456
-rw------- 1 postgres postgres    253952 Oct 10 20:22 2619
-rw------- 1 postgres postgres    270336 Sep  7 17:28 2691
-rw------- 1 postgres postgres    327680 Sep  7 17:33 2609
-rw------- 1 postgres postgres    409600 Oct 10 19:53 2673
-rw------- 1 postgres postgres    417792 Sep  7 17:28 2838
-rw------- 1 postgres postgres    450560 Oct 10 19:53 2674
-rw------- 1 postgres postgres    516096 Oct 10 19:52 2608
-rw------- 1 postgres postgres    606208 Sep  7 17:28 1255
-rw------- 1 postgres postgres    679936 Oct 10 20:03 17313
-rw------- 1 postgres postgres    770048 Oct 10 20:17 1249
-rw------- 1 postgres postgres  12402688 Oct 10 20:23 17551
-rw------- 1 postgres postgres  15712256 Oct 10 20:23 17557
-rw------- 1 postgres postgres  20520960 Oct 10 20:23 17555
-rw------- 1 postgres postgres  20553728 Oct 10 20:23 17554
-rw------- 1 postgres postgres  30302208 Oct 10 20:23 17556
-rw------- 1 postgres postgres  32612352 Oct 10 20:23 17553
-rw------- 1 postgres postgres  47464448 Oct 10 20:23 17552
-rw------- 1 postgres postgres 198238208 Oct 10 20:23 17545
root@nextcloud:/var/lib/postgresql/10/main/base/16385#
Nextcloud log 
{"reqId":"Mzi6hx5qsj0Tg1dOjPVe","level":2,"time":"2018-10-10T17:54:57+00:00","remoteAddr":"172.30.100.19","user":"ncadmin","app":"user_ldap","method":"POST","url":"\/apps\/user_ldap\/ajax\/wizard.php","message":"Configuration Error (prefix s01): No LDAP Login Filter given!","userAgent":"Mozilla\/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/69.0.3497.100 Safari\/537.36","version":"14.0.1.1"}
{"reqId":"Mzi6hx5qsj0Tg1dOjPVe","level":2,"time":"2018-10-10T17:54:57+00:00","remoteAddr":"172.30.100.19","user":"ncadmin","app":"user_ldap","method":"POST","url":"\/apps\/user_ldap\/ajax\/wizard.php","message":"Configuration Error (prefix s01): login filter does not contain %uid place holder.","userAgent":"Mozilla\/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/69.0.3497.100 Safari\/537.36","version":"14.0.1.1"}
{"reqId":"Mzi6hx5qsj0Tg1dOjPVe","level":2,"time":"2018-10-10T17:54:57+00:00","remoteAddr":"172.30.100.19","user":"ncadmin","app":"user_ldap","method":"POST","url":"\/apps\/user_ldap\/ajax\/wizard.php","message":"Configuration Error (prefix s01): No LDAP Login Filter given!","userAgent":"Mozilla\/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/69.0.3497.100 Safari\/537.36","version":"14.0.1.1"}
{"reqId":"Mzi6hx5qsj0Tg1dOjPVe","level":2,"time":"2018-10-10T17:54:57+00:00","remoteAddr":"172.30.100.19","user":"ncadmin","app":"user_ldap","method":"POST","url":"\/apps\/user_ldap\/ajax\/wizard.php","message":"Configuration Error (prefix s01): login filter does not contain %uid place holder.","userAgent":"Mozilla\/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/69.0.3497.100 Safari\/537.36","version":"14.0.1.1"}
{"reqId":"u1VxDlckO7g1hzUOPO8K","level":2,"time":"2018-10-10T17:54:57+00:00","remoteAddr":"172.30.100.19","user":"ncadmin","app":"user_ldap","method":"POST","url":"\/apps\/user_ldap\/ajax\/wizard.php","message":"Configuration Error (prefix s01): No LDAP Login Filter given!","userAgent":"Mozilla\/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/69.0.3497.100 Safari\/537.36","version":"14.0.1.1"}
{"reqId":"u1VxDlckO7g1hzUOPO8K","level":2,"time":"2018-10-10T17:54:57+00:00","remoteAddr":"172.30.100.19","user":"ncadmin","app":"user_ldap","method":"POST","url":"\/apps\/user_ldap\/ajax\/wizard.php","message":"Configuration Error (prefix s01): login filter does not contain %uid place holder.","userAgent":"Mozilla\/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/69.0.3497.100 Safari\/537.36","version":"14.0.1.1"}
{"reqId":"u1VxDlckO7g1hzUOPO8K","level":2,"time":"2018-10-10T17:54:57+00:00","remoteAddr":"172.30.100.19","user":"ncadmin","app":"user_ldap","method":"POST","url":"\/apps\/user_ldap\/ajax\/wizard.php","message":"Configuration Error (prefix s01): No LDAP Login Filter given!","userAgent":"Mozilla\/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/69.0.3497.100 Safari\/537.36","version":"14.0.1.1"}
{"reqId":"u1VxDlckO7g1hzUOPO8K","level":2,"time":"2018-10-10T17:54:57+00:00","remoteAddr":"172.30.100.19","user":"ncadmin","app":"user_ldap","method":"POST","url":"\/apps\/user_ldap\/ajax\/wizard.php","message":"Configuration Error (prefix s01): login filter does not contain %uid place holder.","userAgent":"Mozilla\/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/69.0.3497.100 Safari\/537.36","version":"14.0.1.1"}
{"reqId":"u1VxDlckO7g1hzUOPO8K","level":3,"time":"2018-10-10T17:54:57+00:00","remoteAddr":"172.30.100.19","user":"ncadmin","app":"PHP","method":"POST","url":"\/apps\/user_ldap\/ajax\/wizard.php","message":"ldap_search(): Partial search results returned: Sizelimit exceeded at \/var\/www\/nextcloud\/apps\/user_ldap\/lib\/LDAP.php#293","userAgent":"Mozilla\/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/69.0.3497.100 Safari\/537.36","version":"14.0.1.1"}
{"reqId":"KXH2m8ZLKow7wdWjLrd4","level":3,"time":"2018-10-10T17:55:25+00:00","remoteAddr":"172.30.100.19","user":"ncadmin","app":"PHP","method":"POST","url":"\/apps\/user_ldap\/ajax\/wizard.php","message":"ldap_search(): Partial search results returned: Sizelimit exceeded at \/var\/www\/nextcloud\/apps\/user_ldap\/lib\/LDAP.php#293","userAgent":"Mozilla\/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/69.0.3497.100 Safari\/537.36","version":"14.0.1.1"}
{"reqId":"QCTJfqWSLiJqzeJdL1QG","level":3,"time":"2018-10-10T17:55:31+00:00","remoteAddr":"172.30.100.19","user":"ncadmin","app":"PHP","method":"POST","url":"\/apps\/user_ldap\/ajax\/wizard.php","message":"ldap_search(): Partial search results returned: Sizelimit exceeded at \/var\/www\/nextcloud\/apps\/user_ldap\/lib\/LDAP.php#293","userAgent":"Mozilla\/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/69.0.3497.100 Safari\/537.36","version":"14.0.1.1"}
{"reqId":"dT0HV4dRMAtric913TMX","level":3,"time":"2018-10-10T17:55:55+00:00","remoteAddr":"172.30.100.19","user":"ncadmin","app":"PHP","method":"POST","url":"\/apps\/user_ldap\/ajax\/wizard.php","message":"ldap_search(): Partial search results returned: Sizelimit exceeded at \/var\/www\/nextcloud\/apps\/user_ldap\/lib\/LDAP.php#293","userAgent":"Mozilla\/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/69.0.3497.100 Safari\/537.36","version":"14.0.1.1"}
{"reqId":"8ASdTIbHORIoDSywScHO","level":3,"time":"2018-10-10T17:58:26+00:00","remoteAddr":"172.30.100.19","user":"--","app":"index","method":"POST","url":"\/login","message":{"Exception":"Error","Message":"Call to a member function getBackendClassName() on null","Code":0,"Trace":[{"file":"\/var\/www\/nextcloud\/apps\/dav\/lib\/HookManager.php","line":104,"function":"updateUser","class":"OCA\\DAV\\CardDAV\\SyncService","type":"->","args":["*** sensitive parameter replaced ***"]},{"file":"\/var\/www\/nextcloud\/apps\/dav\/lib\/HookManager.php","line":81,"function":"postCreateUser","class":"OCA\\DAV\\HookManager","type":"->","args":[{"uid":"*** sensitive parameter replaced ***"}]},{"function":"OCA\\DAV\\{closure}","class":"OCA\\DAV\\HookManager","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"\/var\/www\/nextcloud\/lib\/private\/Hooks\/EmitterTrait.php","line":99,"function":"call_user_func_array","args":[{"__class__":"Closure"},["*** sensitive parameter replaced ***"]]},{"file":"\/var\/www\/nextcloud\/lib\/private\/Hooks\/PublicEmitter.php","line":36,"function":"emit","class":"OC\\Hooks\\BasicEmitter","type":"->","args":["\\OC\\User","assignedUserId",["*** sensitive parameter replaced ***"]]},{"file":"\/var\/www\/nextcloud\/apps\/user_ldap\/lib\/Access.php","line":618,"function":"emit","class":"OC\\Hooks\\PublicEmitter","type":"->","args":["\\OC\\User","assignedUserId",["*** sensitive parameter replaced ***"]]},{"file":"\/var\/www\/nextcloud\/apps\/user_ldap\/lib\/Access.php","line":875,"function":"dn2ocname","class":"OCA\\User_LDAP\\Access","type":"->","args":["cn=daniel.adm,ou=adminusers,ou=hosting,dc=ad01,dc=local","daniel administrat\u00f6r","*** sensitive parameter replaced ***",false,"*** sensitive parameter replaced ***"]},{"function":"OCA\\User_LDAP\\{closure}","class":"OCA\\User_LDAP\\Access","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"\/var\/www\/nextcloud\/apps\/user_ldap\/lib\/Access.php","line":880,"function":"array_filter","args":[["*** sensitive parameter replaced ***"],{"__class__":"Closure"}]},{"file":"\/var\/www\/nextcloud\/apps\/user_ldap\/lib\/Access.php","line":843,"function":"fetchListOfUsers","class":"OCA\\User_LDAP\\Access","type":"->","args":["(&(&(|(objectclass=person))(|(|(memberof=CN=Kund-Emoln-HemMapp,OU=Group,OU=EMoln,OU=Kunder,DC=ad01,DC=local)(primaryGroupID=1264))(|(memberof=CN=Kund-Emoln-Grund,OU=Group,OU=EMoln,OU=Kunder,DC=ad01,DC=local)(primaryGroupID=1326))))(|(samaccountname=daniel.adm)(|(mailPrimaryAddress=daniel.adm)(mail=daniel.adm))(|(userPrincipalName=daniel.adm))))",["entryuuid","nsuniqueid","objectguid","guid","ipauniqueid","dn","uid","samaccountname","memberof","","","mail","displayName","","sAMAccountName","jpegphoto","thumbnailphoto"]]},{"file":"\/var\/www\/nextcloud\/apps\/user_ldap\/lib\/User_LDAP.php","line":172,"function":"fetchUsersByLoginName","class":"OCA\\User_LDAP\\Access","type":"->","args":["*** sensitive parameter replaced ***",["entryuuid","nsuniqueid","objectguid","guid","ipauniqueid","dn","uid","samaccountname","memberof","","","mail","displayName","","sAMAccountName","jpegphoto","thumbnailphoto"]]},{"file":"\/var\/www\/nextcloud\/apps\/user_ldap\/lib\/User_LDAP.php","line":189,"function":"getLDAPUserByLoginName","class":"OCA\\User_LDAP\\User_LDAP","type":"->","args":["*** sensitive parameter replaced ***"]},{"function":"checkPassword","class":"OCA\\User_LDAP\\User_LDAP","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"\/var\/www\/nextcloud\/apps\/user_ldap\/lib\/User_Proxy.php","line":81,"function":"call_user_func_array","args":[[{"__class__":"OCA\\User_LDAP\\User_LDAP"},"checkPassword"],["*** sensitive parameter replaced ***","*** sensitive parameter replaced ***"]]},{"file":"\/var\/www\/nextcloud\/apps\/user_ldap\/lib\/Proxy.php","line":152,"function":"walkBackends","class":"OCA\\User_LDAP\\User_Proxy","type":"->","args":["*** sensitive parameter replaced ***","checkPassword",["*** sensitive parameter replaced ***","*** sensitive parameter replaced ***"]]},{"file":"\/var\/www\/nextcloud\/apps\/user_ldap\/lib\/User_Proxy.php","line":196,"function":"handleRequest","class":"OCA\\User_LDAP\\Proxy","type":"->","args":["*** sensitive parameter replaced ***","checkPassword",["*** sensitive parameter replaced ***","*** sensitive parameter replaced ***"]]},{"file":"\/var\/www\/nextcloud\/lib\/private\/User\/Manager.php","line":208,"function":"checkPassword","class":"OCA\\User_LDAP\\User_Proxy","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"\/var\/www\/nextcloud\/core\/Controller\/LoginController.php","line":298,"function":"checkPasswordNoLogging","class":"OC\\User\\Manager","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"\/var\/www\/nextcloud\/lib\/private\/AppFramework\/Http\/Dispatcher.php","line":166,"function":"tryLogin","class":"OC\\Core\\Controller\\LoginController","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"\/var\/www\/nextcloud\/lib\/private\/AppFramework\/Http\/Dispatcher.php","line":99,"function":"executeController","class":"OC\\AppFramework\\Http\\Dispatcher","type":"->","args":[{"__class__":"OC\\Core\\Controller\\LoginController"},"tryLogin"]},{"file":"\/var\/www\/nextcloud\/lib\/private\/AppFramework\/App.php","line":118,"function":"dispatch","class":"OC\\AppFramework\\Http\\Dispatcher","type":"->","args":[{"__class__":"OC\\Core\\Controller\\LoginController"},"tryLogin"]},{"file":"\/var\/www\/nextcloud\/lib\/private\/AppFramework\/Routing\/RouteActionHandler.php","line":47,"function":"main","class":"OC\\AppFramework\\App","type":"::","args":["OC\\Core\\Controller\\LoginController","tryLogin",{"__class__":"OC\\AppFramework\\DependencyInjection\\DIContainer"},{"_route":"core.login.tryLogin"}]},{"function":"__invoke","class":"OC\\AppFramework\\Routing\\RouteActionHandler","type":"->","args":[{"_route":"core.login.tryLogin"}]},{"file":"\/var\/www\/nextcloud\/lib\/private\/Route\/Router.php","line":297,"function":"call_user_func","args":[{"__class__":"OC\\AppFramework\\Routing\\RouteActionHandler"},{"_route":"core.login.tryLogin"}]},{"file":"\/var\/www\/nextcloud\/lib\/base.php","line":987,"function":"match","class":"OC\\Route\\Router","type":"->","args":["\/login"]},{"file":"\/var\/www\/nextcloud\/index.php","line":42,"function":"handleRequest","class":"OC","type":"::","args":[]}],"File":"\/var\/www\/nextcloud\/apps\/dav\/lib\/CardDAV\/SyncService.php","Line":268,"CustomMessage":"--"},"userAgent":"Mozilla\/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/69.0.3497.100 Safari\/537.36","version":"14.0.1.1"}
{"reqId":"O2fV5LduTIotPrO6vPL4","level":3,"time":"2018-10-10T18:01:14+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"opendir(\/mnt\/smb\/Bjorn.Niklasson\/files\/Million Bells 12cm Alla sorter ): failed to open dir: No such file or directory at \/var\/www\/nextcloud\/lib\/private\/Files\/Storage\/Local.php#125","userAgent":"--","version":"14.0.1.1"}
{"reqId":"NsiGU3xaHriWd41zdxeZ","level":2,"time":"2018-10-10T18:03:45+00:00","remoteAddr":"172.30.100.19","user":"--","app":"core","method":"POST","url":"\/login","message":"Login failed: 'ncadmin' (Remote IP: '172.30.100.19')","userAgent":"Mozilla\/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/69.0.3497.100 Safari\/537.36","version":"14.0.1.1"}
root@nextcloud:/mnt/smb# date
Wed Oct 10 20:24:40 CEST 2018
Browser log
@enoch85 enoch85 added the bug label Oct 10, 2018
@nextcloud-bot
Copy link
Member

GitMate.io thinks possibly related issues are #8838 (Return free disk space if quota is set to unlimited), #11658 (Empty trash-bin when runnig out of physical disk space), #7150 (LDAP self password change not possible when cn contains space), #8867 (Wont connect:), and #7329 (Deleted files in shared folder take twice the disk space).

@enoch85
Copy link
Member Author

enoch85 commented Oct 10, 2018

cc @blizzz

@blizzz
Copy link
Member

blizzz commented Oct 12, 2018

@enoch85 is redis or apcu configured?

@enoch85
Copy link
Member Author

enoch85 commented Oct 12, 2018

@blizzz Redis is configured like this.

@blizzz
Copy link
Member

blizzz commented Oct 12, 2018

OK, Redis config seems fine.

The space on the disk should remain the same

I cannot share this expectations, as bindings and meta data per user is being stored in the database. Depeding of the size of the directory that is connect, it is clear that a certain amount of space is being used.

@enoch85
Copy link
Member Author

enoch85 commented Oct 12, 2018

The mounted SMB share is pretty large, I think it's around 2 TB.

it is clear that a certain amount of space is being used.

Yeah, I agree. But /var/lib/postgresql/10/main/base/16385 shouldn't grow with like 10 GB per day. That's a little bit excessive if you ask me.

@enoch85
Copy link
Member Author

enoch85 commented Oct 12, 2018

And another thing; it grows without any files being touched in the SMB share. As soon as LDAP is connected it starts growing.

@blizzz
Copy link
Member

blizzz commented Oct 12, 2018

True, 10 gigs a day feel too much. Do you know what is being placed there?

@blizzz
Copy link
Member

blizzz commented Oct 12, 2018

And does it also happen without the SMB mount?

@enoch85
Copy link
Member Author

enoch85 commented Oct 12, 2018

Do you know what is being placed there?

As you can see in the original post it places different files with different numbers. I haven't checked the content and have to check with the admin for that server.

And does it also happen without the SMB mount?

Same thing here, have to check with the admin for the server.

I'll get back to you!

@enoch85
Copy link
Member Author

enoch85 commented Oct 15, 2018 •
edited
Loading

Mail from the customer:

I have tried to move back data storage to the original datadir (not SMB), then Postgres stopped growing.
I still have the smb partition mounted. But the ncdata is not stored there.
I tested do to a reinstallation too, where I started with ldap, it was working until I changed the data path to the mounted smb share and logged in as a user in nc, then the Postgres-folder started to increase again.
The same thing when the nc data path was changed from the smb mapping to the old path, psotgres calmed down.

@blizzz
Copy link
Member

blizzz commented Oct 16, 2018

Then I guess something's wrong with the mount → config issue

@blizzz blizzz closed this as completed Oct 16, 2018
@enoch85
Copy link
Member Author

enoch85 commented Oct 16, 2018

But as you can see, nothing starts growing before you add the LDAP, so how can that be a mount issue since SMB alone doesn't create the growing space.

LDAP alone - works
SMB alone - works
LDAP + data on disk - works
LDAP + SMB - issue --^

@blizzz

This comment has been minimized.

Sign in to view
@enoch85

This comment has been minimized.

Sign in to view
@blizzz
Copy link
Member

blizzz commented Oct 23, 2018

Did I ask for support? The fact remains, LDAP + SMB doesn't work.

There are several things to check with the customer, and this is what I would do with ours. If the plot thickens, sure, but this is just too thin, sorry. We're using doctrine for abstraction and the LDAP backend does not do anything unordinary related to the database. Further, there is no direct connection to the storage layer. I hope you belive me when I say that the LDAP backend does not have a switch that checks what the storage behind the database is and decides to act strangely, if SMB. Therefore i am not convinced it is a software bug, but a configuration issue.

@enoch85

This comment has been minimized.

Sign in to view
@enoch85
Copy link
Member Author

enoch85 commented Nov 22, 2018

@blizzz OK, so we skipped using /etc/fsatb and chose the External Storages app instead. Same thing happens with that one as well.

Bug or not?

@Schubbie
Copy link

Schubbie commented May 7, 2019

Hello,
i think i have the same problem. If i mount an external SMB-Storage from a Windows 10 Machine the PostgreSQL-Folder blow up till the Disc is full and i can't login to the WebGUI. I have installed nextCloud a several times and my Oncle with another DB and Installationsscript can reproduce this with his Installation.

Has anyone an Idea? I think the issue is by mounting an external SMB-Storage.

@enoch85 enoch85 mentioned this issue Aug 27, 2019
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug feature: ldap
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@blizzz @enoch85 @nextcloud-bot @Schubbie and others