Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NocoDB can't display the values of a cell when it's of type LinkToAnotherRecord and has hundreds of connections #2242

Closed
nilsreichardt opened this issue Jun 2, 2022 · 3 comments
Assignees
Labels
Status: Reproducible Able to reproduce the issue based on the reporters' guideline.

Comments

@nilsreichardt
Copy link
Contributor

Problem

I have a table for email addresses and a table for newsletter subscribers. I added 50.000 subscribers to one newsletter. Therefore, there are 50,000 connections in the "Addresses" field in the newsletter table for the row "Wheelmap".

You can see this also in the video. In the newsletter table, we see only ~30 connections. But when we switch to the email address table, we see that also emails like 7444@test.com have also a connection to the newseltter.

Screen.Recording.2022-06-02.at.21.01.02.mov

The response by the REST API shows the same as the client:

Response
{
    "Id": 0,
    "Name": "Wheelmap",
    "Mailjet ID": "17634",
    "Addresses": [
        {
            "Id": 17076,
            "Email": "17063@test.com",
            "CreatedAt": "2022-06-02T13:37:38.787Z",
            "UpdatedAt": "2022-06-02T18:29:23.967Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        },
        {
            "Id": 17077,
            "Email": "17064@test.com",
            "CreatedAt": "2022-06-02T13:37:38.798Z",
            "UpdatedAt": "2022-06-02T18:29:23.974Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        },
        {
            "Id": 17078,
            "Email": "17065@test.com",
            "CreatedAt": "2022-06-02T13:37:38.812Z",
            "UpdatedAt": "2022-06-02T18:29:23.982Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        },
        {
            "Id": 6,
            "Email": "561fe5b8dc0c45a19@gmail.com",
            "CreatedAt": "2022-06-01T20:19:28.864Z",
            "UpdatedAt": "2022-06-02T17:41:04.185Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        },
        {
            "Id": 12,
            "Email": "0@test.com",
            "CreatedAt": "2022-06-02T13:32:40.471Z",
            "UpdatedAt": "2022-06-02T18:07:16.208Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        },
        {
            "Id": 15,
            "Email": "2@test.com",
            "CreatedAt": "2022-06-02T13:33:40.743Z",
            "UpdatedAt": "2022-06-02T18:07:16.240Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        },
        {
            "Id": 16,
            "Email": "3@test.com",
            "CreatedAt": "2022-06-02T13:33:40.769Z",
            "UpdatedAt": "2022-06-02T18:07:16.249Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        },
        {
            "Id": 17,
            "Email": "4@test.com",
            "CreatedAt": "2022-06-02T13:33:40.799Z",
            "UpdatedAt": "2022-06-02T18:07:16.260Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        },
        {
            "Id": 18,
            "Email": "5@test.com",
            "CreatedAt": "2022-06-02T13:33:40.828Z",
            "UpdatedAt": "2022-06-02T18:07:16.272Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        },
        {
            "Id": 19,
            "Email": "6@test.com",
            "CreatedAt": "2022-06-02T13:33:40.847Z",
            "UpdatedAt": "2022-06-02T18:07:16.290Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        },
        {
            "Id": 20,
            "Email": "7@test.com",
            "CreatedAt": "2022-06-02T13:33:40.869Z",
            "UpdatedAt": "2022-06-02T18:07:16.306Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        },
        {
            "Id": 22,
            "Email": "9@test.com",
            "CreatedAt": "2022-06-02T13:33:40.925Z",
            "UpdatedAt": "2022-06-02T18:07:16.330Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        },
        {
            "Id": 23,
            "Email": "10@test.com",
            "CreatedAt": "2022-06-02T13:33:40.953Z",
            "UpdatedAt": "2022-06-02T18:07:16.336Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        },
        {
            "Id": 24,
            "Email": "11@test.com",
            "CreatedAt": "2022-06-02T13:33:40.983Z",
            "UpdatedAt": "2022-06-02T18:07:16.341Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        },
        {
            "Id": 25,
            "Email": "12@test.com",
            "CreatedAt": "2022-06-02T13:33:41.016Z",
            "UpdatedAt": "2022-06-02T18:07:16.353Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        },
        {
            "Id": 26,
            "Email": "13@test.com",
            "CreatedAt": "2022-06-02T13:33:41.047Z",
            "UpdatedAt": "2022-06-02T18:07:16.365Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        },
        {
            "Id": 28,
            "Email": "15@test.com",
            "CreatedAt": "2022-06-02T13:33:41.112Z",
            "UpdatedAt": "2022-06-02T18:07:16.387Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        },
        {
            "Id": 29,
            "Email": "16@test.com",
            "CreatedAt": "2022-06-02T13:33:41.139Z",
            "UpdatedAt": "2022-06-02T18:07:16.402Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        },
        {
            "Id": 30,
            "Email": "17@test.com",
            "CreatedAt": "2022-06-02T13:33:41.161Z",
            "UpdatedAt": "2022-06-02T18:07:16.409Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        },
        {
            "Id": 31,
            "Email": "18@test.com",
            "CreatedAt": "2022-06-02T13:33:41.191Z",
            "UpdatedAt": "2022-06-02T18:07:16.415Z",
            "emails_id": null,
            "emails_id1": null,
            "newsletter_id": 0,
            "menschen_id": null
        }
    ]
}

What I would expect

I would expect to see all 50.000 connections in the "Wheelmap" row or some kind of pagination. The same for the API.

@nilsreichardt nilsreichardt changed the title NocoDB can't display the values of a cell when it's of type LinkToAnotherRecord has hundreds of connections NocoDB can't display the values of a cell when it's of type LinkToAnotherRecord and has hundreds of connections Jun 2, 2022
@dstala dstala added the Status: Reproducible Able to reproduce the issue based on the reporters' guideline. label Jun 3, 2022
@dstala
Copy link
Member

dstala commented Jun 3, 2022

1.js.zip
Use attached script to reproduce it quickly.

  • issue observed only with hm. works fine for mm

@dstala
Copy link
Member

dstala commented Jun 3, 2022

noco.db.zip
For SQLite root-db

pranavxc added a commit that referenced this issue Jun 11, 2022
re #2242

Signed-off-by: Pranav C <pranavxc@gmail.com>
@pranavxc pranavxc self-assigned this Jun 11, 2022
@pranavxc pranavxc added the 👀 Status: In Review The PR is currently being verified. label Jun 11, 2022
@pranavxc pranavxc added this to the Next Release : v0.91.x milestone Jun 11, 2022
@pranavxc pranavxc added Status: Fixed and removed 👀 Status: In Review The PR is currently being verified. labels Jun 13, 2022
wingkwong added a commit that referenced this issue Jun 14, 2022
* add vscode ide's ignore list

* fix passing nested query in nested getAst calls

* chore: update nocodb-sdk to local path

* fix: ignore duplicating app config

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: swagger columnNameParam type

re: #2208
Signed-off-by: mertmit <mertmit99@gmail.com>

* docs: update README.md [skip ci]

* docs: update .all-contributorsrc [skip ci]

* enhancement: hide slider on escape key

Signed-off-by: Pranav C <pranavxc@gmail.com>

* Add information about maximum value for `limit` in REST API

* refactor: folder structure

* refactor: folder structure

* test: webhook (WIP)

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* test: webhook

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* test/cypress: corrections post develop branch refactoring

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* fix: handle null

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: path correction

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: assign validation for correct column(LTAR)

re #2228

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: disable api docs access for viewer role

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* docs: Repair broken link

* fix: DatePickerCell invalid date handling

Signed-off-by: mertmit <mertmit99@gmail.com>

* fix: nested insert correction in belongs to

re #2228

Signed-off-by: Pranav C <pranavxc@gmail.com>

* feat: compare with non-os products

Signed-off-by: mertmit <mertmit99@gmail.com>

* fix: Persian language moving across table

Signed-off-by: mertmit <mertmit99@gmail.com>

* docs: env variables

* docs: env variables reorder

* docs: env variables reorder

* fix: i18n corrections (WeT-Klb)

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* chore: image text corrections (@WeT-Klb)

* chore: upgrade nc-help

Signed-off-by: Pranav C <pranavxc@gmail.com>

* docs: security.md

* Update packages/nocodb/src/lib/noco/meta/api/swagger/helpers/templates/params.ts

Co-authored-by: աɨռɢӄաօռɢ <wingkwong.code@gmail.com>

* Update SqliteUi.ts - set float for decimal case in getAbstractType (#2260)

* set float for decimal case in getAbstractType

* fix: add cross-env to nc-gui package.json (#2275)

* add cross-env to nc-gui package.json

* fix: sanitize project title

* chore: disable pr release for draft

* chore: attachment log during airtable import

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* modification of the traduction

I aslo add some stuff according to the README (it was a different display so i didn't add a lot)

* docs: update README.md [skip ci]

* docs: update .all-contributorsrc [skip ci]

* fix: change password cache logic

* fix: add missing job name back

* fix: prop types for FlipCard component

Signed-off-by: mertmit <mertmit99@gmail.com>

* fix: invalid char in content-disposition header

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* fix: question mark in CONCAT

* fix: handling lookup column reference in formula

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: throw err if user is already a project user

* chore: revise error msg

* fix: package lock corrections

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* test/ trigger

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* fix: lock file version

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* fix: package lock after npm/node upgrade

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* fix: cypress package lock json

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* test: lock node-version to 16.15.0

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* enhancement: allow custom limit values

* chore: update query limit description

* chore: bump to 16.15.0

* fix: node version

* fix: handle invalid limit numbers

Signed-off-by: Pranav C <pranavxc@gmail.com>

* docs: update default value of pagination max limit value

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: pg database type money

Signed-off-by: mertmit <mertmit99@gmail.com>

* fix: hasmany pagination - api correction

re #2242

Signed-off-by: Pranav C <pranavxc@gmail.com>

* script: add nc_017_add_user_token_exp_column

* fix: add token_expired

* fix: return unauthorized if token is expired

* chore: revise toast message

* chore: sign out n redirect to sign in page after changing password

* fix: SingeSelect/MultiSelect webhook trigger (#2309)

* fix: SingleSelect webhook trigger

Signed-off-by: mertmit <mertmit99@gmail.com>

* fix: MultiSelect webhook trigger

Signed-off-by: mertmit <mertmit99@gmail.com>

* Fix: Remove user reference from webhook context (#2337)

* fix: remove user info from webhook handlebar context

Signed-off-by: Pranav C <pranavxc@gmail.com>

* docs: update webhook context variables docs

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: only check token_expired in non-public base

* fix: make rating readonly in lookup column (#2340)

re #2045

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: exclude sensitive data related to server from SMTP test api

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: session across broswers

* fix: reload related table metadata after relation column delete (#2345)

re #2344

Signed-off-by: Pranav C <pranavxc@gmail.com>

* Fix: Sanitise comment data  (#2343)

* fix: sanitise row comment description

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: add dom purify and sanitize content

- Add DOMPurify in nuxt
- On update value encode html tags to render as text in comment

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: add missing dependency

Signed-off-by: Pranav C <pranavxc@gmail.com>

Co-authored-by: cattong <tangym@jifenbang.net>
Co-authored-by: LepkoQQ <LepkoQQ@users.noreply.github.com>
Co-authored-by: Pranav C <pranavxc@gmail.com>
Co-authored-by: mertmit <mertmit99@gmail.com>
Co-authored-by: navi <oof1lab@gmail.com>
Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com>
Co-authored-by: Nils Reichardt <nils@reichardt.io>
Co-authored-by: Raju Udava <86527202+dstala@users.noreply.github.com>
Co-authored-by: Toon van Ramshorst <ramshorst@gmail.com>
Co-authored-by: GurukiranMH <89529565+GurukiranMH@users.noreply.github.com>
Co-authored-by: QuentinDstl <qdesautel@gmail.com>
@github-actions
Copy link
Contributor

Fixed in v0.91.8.

dstala added a commit that referenced this issue Jun 20, 2022
* add vscode ide's ignore list

* fix passing nested query in nested getAst calls

* chore: update nocodb-sdk to local path

* fix: ignore duplicating app config

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: swagger columnNameParam type

re: #2208
Signed-off-by: mertmit <mertmit99@gmail.com>

* docs: update README.md [skip ci]

* docs: update .all-contributorsrc [skip ci]

* enhancement: hide slider on escape key

Signed-off-by: Pranav C <pranavxc@gmail.com>

* Add information about maximum value for `limit` in REST API

* refactor: folder structure

* refactor: folder structure

* test: webhook (WIP)

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* test: webhook

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* test/cypress: corrections post develop branch refactoring

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* fix: handle null

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: path correction

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: assign validation for correct column(LTAR)

re #2228

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: disable api docs access for viewer role

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* docs: Repair broken link

* fix: DatePickerCell invalid date handling

Signed-off-by: mertmit <mertmit99@gmail.com>

* fix: nested insert correction in belongs to

re #2228

Signed-off-by: Pranav C <pranavxc@gmail.com>

* feat: compare with non-os products

Signed-off-by: mertmit <mertmit99@gmail.com>

* fix: Persian language moving across table

Signed-off-by: mertmit <mertmit99@gmail.com>

* docs: env variables

* docs: env variables reorder

* docs: env variables reorder

* fix: i18n corrections (WeT-Klb)

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* chore: image text corrections (@WeT-Klb)

* chore: upgrade nc-help

Signed-off-by: Pranav C <pranavxc@gmail.com>

* docs: security.md

* Update packages/nocodb/src/lib/noco/meta/api/swagger/helpers/templates/params.ts

Co-authored-by: աɨռɢӄաօռɢ <wingkwong.code@gmail.com>

* Update SqliteUi.ts - set float for decimal case in getAbstractType (#2260)

* set float for decimal case in getAbstractType

* fix: add cross-env to nc-gui package.json (#2275)

* add cross-env to nc-gui package.json

* fix: sanitize project title

* chore: disable pr release for draft

* chore: attachment log during airtable import

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* modification of the traduction

I aslo add some stuff according to the README (it was a different display so i didn't add a lot)

* docs: update README.md [skip ci]

* docs: update .all-contributorsrc [skip ci]

* fix: change password cache logic

* fix: add missing job name back

* fix: prop types for FlipCard component

Signed-off-by: mertmit <mertmit99@gmail.com>

* fix: invalid char in content-disposition header

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* fix: question mark in CONCAT

* fix: handling lookup column reference in formula

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: throw err if user is already a project user

* chore: revise error msg

* fix: package lock corrections

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* test/ trigger

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* fix: lock file version

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* fix: package lock after npm/node upgrade

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* fix: cypress package lock json

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* test: lock node-version to 16.15.0

Signed-off-by: Raju Udava <86527202+dstala@users.noreply.github.com>

* enhancement: allow custom limit values

* chore: update query limit description

* chore: bump to 16.15.0

* fix: node version

* fix: handle invalid limit numbers

Signed-off-by: Pranav C <pranavxc@gmail.com>

* docs: update default value of pagination max limit value

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: pg database type money

Signed-off-by: mertmit <mertmit99@gmail.com>

* fix: hasmany pagination - api correction

re #2242

Signed-off-by: Pranav C <pranavxc@gmail.com>

* script: add nc_017_add_user_token_exp_column

* fix: add token_expired

* fix: return unauthorized if token is expired

* chore: revise toast message

* chore: sign out n redirect to sign in page after changing password

* fix: SingeSelect/MultiSelect webhook trigger (#2309)

* fix: SingleSelect webhook trigger

Signed-off-by: mertmit <mertmit99@gmail.com>

* fix: MultiSelect webhook trigger

Signed-off-by: mertmit <mertmit99@gmail.com>

* Fix: Remove user reference from webhook context (#2337)

* fix: remove user info from webhook handlebar context

Signed-off-by: Pranav C <pranavxc@gmail.com>

* docs: update webhook context variables docs

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: only check token_expired in non-public base

* fix: make rating readonly in lookup column (#2340)

re #2045

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: exclude sensitive data related to server from SMTP test api

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: session across broswers

* fix: reload related table metadata after relation column delete (#2345)

re #2344

Signed-off-by: Pranav C <pranavxc@gmail.com>

* Fix: Sanitise comment data  (#2343)

* fix: sanitise row comment description

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: add dom purify and sanitize content

- Add DOMPurify in nuxt
- On update value encode html tags to render as text in comment

Signed-off-by: Pranav C <pranavxc@gmail.com>

* fix: add missing dependency

Signed-off-by: Pranav C <pranavxc@gmail.com>

Co-authored-by: cattong <tangym@jifenbang.net>
Co-authored-by: LepkoQQ <LepkoQQ@users.noreply.github.com>
Co-authored-by: Pranav C <pranavxc@gmail.com>
Co-authored-by: mertmit <mertmit99@gmail.com>
Co-authored-by: navi <oof1lab@gmail.com>
Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com>
Co-authored-by: Nils Reichardt <nils@reichardt.io>
Co-authored-by: Raju Udava <86527202+dstala@users.noreply.github.com>
Co-authored-by: Toon van Ramshorst <ramshorst@gmail.com>
Co-authored-by: GurukiranMH <89529565+GurukiranMH@users.noreply.github.com>
Co-authored-by: QuentinDstl <qdesautel@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Status: Reproducible Able to reproduce the issue based on the reporters' guideline.
Projects
None yet
Development

No branches or pull requests

3 participants