Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use source lookup for ANALYZE #15087

Merged
merged 2 commits into from
Nov 27, 2023
Merged

Use source lookup for ANALYZE #15087

merged 2 commits into from
Nov 27, 2023

Conversation

mfussenegger
Copy link
Member

Subset of #15078
I couldn't verify if the segment access optimization has any impact

I also couldn't get realiable outputs with JFR FileRead sampling
anymore. So, this instead shows the dstat output, recorded while the
analyze was running.

The first column is the status-quo, the second column is this commit,
the third column is the linked PR.

-dsk/total-      -dsk/total-       -dsk/total-
 read  writ       read  writ        read  writ
  38M   45M        39M   45M         37M   45M
   0   664k         0   272k          0     0
   0     0       6584k   63M          0     0
   0     0       1016k   59M          0   584k
7056k  102M        16k    0           0    24k
   0     0          0     0           0     0
  16k    0          0     0           0   232k
  68M    0          0     0           0     0
1317M    0        126M 1056k         16k 8488k
4250M  512k      2024M    0           0     0
3748M  584k      1787M    0           0     0
3818M  136k      1605M    0        6744k 6272k
3819M    0       1497M    0           0  1488k
3872M  392k      1248M  912k         16k 2024k
3790M    0       1095M    0          91M    0
3778M  584k       946M    0         587M    0
3710M    0        807M    0        1562M  504k
3650M    0        729M    0        1593M    0
3130M    0        419M  136k       1370M    0
2619M    0        120M   11M       1039M    0
2223M  584k         0   664k        929M    0
1715M    0          0  1328k        599M    0
 678M    0                         2914M    0
 118M 2312k                        1088M 1032k
   0     0                         9008k   26M
   0   584k                           0     0
                                      0     0

@mfussenegger
Copy link
Member Author

Given that the scope of this is much smaller then the other PR I think it would be fine to backport this.
We made the same change also in other areas (fetch, and afaik insert from sub-query).

What do you think?

@BaurzhanSakhariev
Copy link
Contributor

I think it would be fine to backport this.

Sounds good but it's again a general improvement not a fix, right? (Because we are not touching throttling mechanism).

Subset of #15078
I couldn't verify if the segment access optimization has any impact

I also couldn't get realiable outputs with JFR FileRead sampling
anymore. So, this instead shows the dstat output, recorded while the
analyze was running.

The first column is the status-quo, the second column is _this_ commit,
the third column is the linked PR.

    -dsk/total-      -dsk/total-       -dsk/total-
     read  writ       read  writ        read  writ
      38M   45M        39M   45M         37M   45M
       0   664k         0   272k          0     0
       0     0       6584k   63M          0     0
       0     0       1016k   59M          0   584k
    7056k  102M        16k    0           0    24k
       0     0          0     0           0     0
      16k    0          0     0           0   232k
      68M    0          0     0           0     0
    1317M    0        126M 1056k         16k 8488k
    4250M  512k      2024M    0           0     0
    3748M  584k      1787M    0           0     0
    3818M  136k      1605M    0        6744k 6272k
    3819M    0       1497M    0           0  1488k
    3872M  392k      1248M  912k         16k 2024k
    3790M    0       1095M    0          91M    0
    3778M  584k       946M    0         587M    0
    3710M    0        807M    0        1562M  504k
    3650M    0        729M    0        1593M    0
    3130M    0        419M  136k       1370M    0
    2619M    0        120M   11M       1039M    0
    2223M  584k         0   664k        929M    0
    1715M    0          0  1328k        599M    0
     678M    0                         2914M    0
     118M 2312k                        1088M 1032k
       0     0                         9008k   26M
       0   584k                           0     0
                                          0     0
@mfussenegger
Copy link
Member Author

I think it would be fine to backport this.

Sounds good but it's again a general improvement not a fix, right? (Because we are not touching throttling mechanism).

Right. I added a regular changes entry.

@mfussenegger mfussenegger added the ready-to-merge Let Mergify merge the PR once approved and checks pass label Nov 27, 2023
@mergify mergify bot merged commit e28bafb into master Nov 27, 2023
18 checks passed
@mergify mergify bot deleted the j/analyze-source-lookup branch November 27, 2023 10:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ready-to-merge Let Mergify merge the PR once approved and checks pass
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants