Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Backport "HBASE-27814 Add support for dump and process metrics servlet in REST InfoServer" to branch-2.6 #5724

Closed
wants to merge 6,438 commits into from
Closed

Backport "HBASE-27814 Add support for dump and process metrics servlet in REST InfoServer" to branch-2.6 #5724

wants to merge 6,438 commits into from

Conversation

NihalJain
Copy link
Contributor

@NihalJain NihalJain commented Feb 29, 2024 •
edited
Loading

Other changes:

  • Ensure info server stops during stop()
  • Extract header and footer. This would fix the log level page layout for rest web UI (See HBASE-20693)
  • Add hostname in the landing page instead of just port similar to other web UIs

Apache9 and others added 30 commits May 15, 2023 10:35
@Apache9
HBASE-27865 TestThriftServerCmdLine fails with org.apache.hadoop.hbas…
fd4f984 
…e.SystemExitRule (apache#5238)

Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Xin Sun <ddupgs@gmail.com>
@Apache9
HBASE-27864 Reduce the Cardinality for TestFuzzyRowFilterEndToEndLarge (
8b8c684 
apache#5237)

From 50^3 to 30^3, 125000 -> 27000

Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Xin Sun <ddupgs@gmail.com>
@Apache9
HBASE-27212 Implement a new table based replication queue storage and…
e2d8db6 
… make the minimum replication system work (apache#4672)

Signed-off-by: Xin Sun <ddupgs@gmail.com>
@Apache9
HBASE-27213 Add support for claim queue operation (apache#4708)
f81bdeb 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
@Apache9
HBASE-27214 Implement the new replication hfile/log cleaner (apache#4722
6d0311c 
)

Signed-off-by: Xin Sun <ddupgs@gmail.com>
@Apache9
HBASE-27215 Add support for sync replication (apache#4762)
7044150 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
@Apache9
HBASE-27392 Add a new procedure type for implementing some global ope…
c01c8e4 
…rations such as migration (apache#4803)

Signed-off-by: Xin Sun <ddupgs@gmail.com>
@2005hithlj @Apache9
HBASE-27405 Fix the replication hfile/log cleaner report that the rep…
5f95a91 
…lication table does not exist (apache#4811)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
@Apache9
HBASE-27218 Support rolling upgrading (apache#4808)
0d57ee1 
Signed-off-by: Yu Li <liyu@apache.org>
@2005hithlj @Apache9
HBASE-27217 Revisit the DumpReplicationQueues tool (apache#4810)
ffad1ff 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
@Apache9
HBASE-27429 Add exponential retry backoff support for MigrateReplicat…
dfb125f 
…ionQueueFromZkToTableProcedure

Signed-off-by: Liangjun He <heliangjun@apache.org>
@Apache9
HBASE-27430 Should disable replication log cleaner when migrating rep…
7c74f9e 
…lication queue data (apache#4901)

Signed-off-by: Liangjun He <heliangjun@apache.org>
@Apache9
HBASE-27216 Revisit the ReplicationSyncUp tool (apache#4966)
000e64a 
Signed-off-by: Liangjun He <heliangjun@apache.org>
@2005hithlj @Apache9
HBASE-27623 Start a new ReplicationSyncUp after the previous failed (a…
650350a 
…pache#5150)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
@Apache9
HBASE-27775 Use a separate WAL provider for hbase:replication table (a…
8fe691c 
…pache#5157)

Signed-off-by: Liangjun He <heliangjun@apache.org>
@2005hithlj @Apache9
HBASE-27274 Re-enable the disabled tests when implementing HBASE-27212 (
679dfcf 
apache#5178)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
@2005hithlj @Apache9
HBASE-27809 Attach move replication queue storage from zookeeper to a…
b343562 
… separated HBase table design doc to git repo (apache#5197)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
@2005hithlj @Apache9
HBASE-27516 Document the table based replication queue storage in ref…
93ddd70 
… guide (apache#5203)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
@Apache9
HBASE-27870 Eliminate the 'WARNING: package jdk.internal.util.random …
71d7996 
…not in java.base' when running UTs with jdk11 (apache#5242)

Signed-off-by: Tianhang Tang <tianhang@apache.org>
@ydodeja365
HBASE-27812 Provide option in HBase UI to disable stack trace for sec…
cf9684d 
…urity (apache#5205)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
@guluo2016
HBASE-27848:Should fast-fail if unmatched column family exists when u…
ce29f97 
…sing ImportTsv (apache#5225)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
@yamasakisua
HBASE-27634 Builds emit errors related to SBOM parsing (apache#5246)
49bdf61 
Update CycloneDX version

Signed-off-by: Duo Zhang <zhangduo@apache.org>
@wchevreuil @Apache9
HBASE-27874 Problem in flakey generated report causes pre-commit run …
e4e7917 
…to fail (apache#5244)

Forward cherry-pick from branch-2.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewew-by: Kota-SH <shanmukhaharipriya@gmail.com>
(cherry picked from commit 0ba562a)
@Apache9
HBASE-27277 TestRaceBetweenSCPAndTRSP fails in pre commit (apache#5248)
dc30ca5 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
@dependabot
HBASE-27879 Bump requests in /dev-support/git-jira-release-audit (apa…
d98b962 
…che#5249)

Bumps [requests](https://github.com/psf/requests) from 2.22.0 to 2.31.0.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](psf/requests@v2.22.0...v2.31.0)

---
updated-dependencies:
- dependency-name: requests
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
@dependabot
HBASE-27880 Bump requests from 2.28.1 to 2.31.0 in /dev-support/flaky…
22526a6 
…-tests (apache#5250)

Bumps [requests](https://github.com/psf/requests) from 2.28.1 to 2.31.0.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](psf/requests@v2.28.1...v2.31.0)

---
updated-dependencies:
- dependency-name: requests
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
@yamasakisua
HBASE-27876 Only generate SBOM when releasing (apache#5251)
256e5e9 
Move CycloneDX plugin to profile section

Signed-off-by: Duo Zhang <zhangduo@apache.org>
@chrajeshbabu
HBASE-27793 Make HBCK be able to report unknown servers (apache#5229)
d7b2fb4 
Co-authored-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
@ydodeja365
HBASE-27811 Enable cache control for logs endpoint and set max age as…
ea3a44e 
… 0 (apache#5204)
@apurtell
HBASE-27843 If moveAndClose fails HFileArchiver should delete any inc…
7510d06 
…omplete archive side changes (apache#5240)

When HFiles are placed on a filesystem other than HDFS a rename operation can be
a non-atomic file copy operation. It can take a long time to copy a large hfile
and if interrupted there may be a partially copied file present at the destination.

If we fail to “rename” the files into the archive we will continue to fail
indefinitely. Before larger changes are considered, perhaps to StoreFileTracker, we
should mitigate this problem.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
apurtell and others added 20 commits December 24, 2023 09:57
@apurtell
HBASE-28282 Update downloads.xml for release 2.5.7
75801a5 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
@Apache9
HBASE-28290 Add 'TM' superscript to the index page title when generat…
ec43ea1 
…ing javadoc (apache#5600)

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
@Apache9
HBASE-28290 Addendum also change title for test javadoc (apache#5601)
4e0af3b 
Signed-off-by: Nihal Jain <nihaljain@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
@NihalJain
HBASE-28249 Bump jruby to 9.3.13.0 and related joni and jcodings to 2…
4a54558 
….2.1 and 1.0.58 respectively (apache#5568)

- Also fix "NoMethodError: undefined method runtime for JRuby:Module" caused due to bump

Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
@zhaomoran
HBASE-28259 Add java.base/java.io=ALL-UNNAMED open to jdk11_jvm_flags (…
1198854 
…apache#5581)

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Nihal Jain <nihaljain@apache.org>
@Apache9
HBASE-28290 Addendum use 'Test API' for test javadoc (apache#5602)
849eee4 
Signed-off-by: Nihal Jain <nihaljain@apache.org>
@Apache9
HBASE-28277 Move minimum hadoop 3 support to 3.3.x for 2.6+ (apache#5598
4aeabdc 
)

Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
@NihalJain
HBASE-28295 Fews tests are failing due to NCDFE: org/bouncycastle/ope…
1176e92 
…rator/OperatorCreationException (apache#5608)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
@charlesconnell
HBASE-26268 Provide coprocessor hooks for updateConfiguration and cle…
71cecb0 
…arRegionBlockCache (apache#5593)


Co-authored-by: Charles Connell <cconnell@hubspot.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
@stoty
HBASE-28261 Sync jvm11 module flags from hbase-surefire.jdk11.flags t…
0916c72 
…o bin/hbase (apache#5610)

Signed-off-by: Nihal Jain <nihaljain@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
@Apache9
HBASE-28297 IntegrationTestImportTsv fails with ArrayIndexOfOutBounds (…
a09305d 
…apache#5612)

Signed-off-by: Nihal Jain <nihaljain@apache.org>
@NihalJain
[ADDENDUM] HBASE-28295 Few tests are failing due to NCDFE: org/bouncy…
0db4231 
…castle/operator/OperatorCreationException (apache#5611)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
@bbeaudreault
HBASE-28304 Add hbase-shaded-testing-util version to dependencyManage…
8cab5a2 
…ment (apache#5618)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
@NihalJain
HBASE-28301 IntegrationTestImportTsv fails with UnsupportedOperationE…
a7429a7 
…xception (apache#5613)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
@dependabot
HBASE-28308 Bump gitpython from 3.1.37 to 3.1.41 in /dev-support/flak…
d57e4e2 
…y-tests (apache#5616)

Bumps [gitpython](https://github.com/gitpython-developers/GitPython) from 3.1.37 to 3.1.41.
- [Release notes](https://github.com/gitpython-developers/GitPython/releases)
- [Changelog](https://github.com/gitpython-developers/GitPython/blob/main/CHANGES)
- [Commits](gitpython-developers/GitPython@3.1.37...3.1.41)

---
updated-dependencies:
- dependency-name: gitpython
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
@dependabot
HBASE-28309 Bump gitpython in /dev-support/git-jira-release-audit (ap…
8ae77e2 
…ache#5617)

Bumps [gitpython](https://github.com/gitpython-developers/GitPython) from 3.1.37 to 3.1.41.
- [Release notes](https://github.com/gitpython-developers/GitPython/releases)
- [Changelog](https://github.com/gitpython-developers/GitPython/blob/main/CHANGES)
- [Commits](gitpython-developers/GitPython@3.1.37...3.1.41)

---
updated-dependencies:
- dependency-name: gitpython
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
@dependabot
HBASE-28310 Bump jinja2 from 3.1.2 to 3.1.3 in /dev-support/flaky-tes…
6133d74 
…ts (apache#5619)

Bumps [jinja2](https://github.com/pallets/jinja) from 3.1.2 to 3.1.3.
- [Release notes](https://github.com/pallets/jinja/releases)
- [Changelog](https://github.com/pallets/jinja/blob/main/CHANGES.rst)
- [Commits](pallets/jinja@3.1.2...3.1.3)

---
updated-dependencies:
- dependency-name: jinja2
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
@liuwenjing17
HBASE-28287 MOB HFiles are expired earlier than their reference data (a…
4d2b8f8 
…pache#5599)

Co-authored-by: liuwenjing3 <liuwenjing3@360.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
@haosenchen
HBASE-28305 Add "Uncompressed StoreFileSize" column to the table.jsp (a…
e3a0174 
…pache#5620)

Co-authored-by: Haosen Chen <haosenchen@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
@NihalJain
HBASE-27814 Add support for dump and process metrics servlet in REST …
52926d0 
…InfoServer
@NihalJain NihalJain added the backport This PR is a back port of some issue or issues already committed to master label Feb 29, 2024
@NihalJain
Copy link
Contributor Author

Backports #5215

FYI @ndimiduk @bbeaudreault

@NihalJain NihalJain changed the title Backport "HBASE-27814 Add support for dump and process metrics servlet in REST … Backport "HBASE-27814 Add support for dump and process metrics servlet in REST InfoServer" to branch-2.6 Feb 29, 2024
@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 0s Docker mode activated.
-1 ❌ patch 0m 2s #5724 does not apply to master. Rebase required? Wrong Branch? See https://yetus.apache.org/documentation/in-progress/precommit-patchnames for help.
Subsystem Report/Notes
GITHUB PR #5724
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5724/1/console
versions git=2.17.1
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

1 similar comment
@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 0s Docker mode activated.
-1 ❌ patch 0m 2s #5724 does not apply to master. Rebase required? Wrong Branch? See https://yetus.apache.org/documentation/in-progress/precommit-patchnames for help.
Subsystem Report/Notes
GITHUB PR #5724
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5724/1/console
versions git=2.17.1
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@NihalJain NihalJain changed the base branch from master to branch-2.6 February 29, 2024 14:41
@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 0s Docker mode activated.
-1 ❌ patch 0m 13s #5724 does not apply to branch-2.6. Rebase required? Wrong Branch? See https://yetus.apache.org/documentation/in-progress/precommit-patchnames for help.
Subsystem Report/Notes
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5724/1/console
versions git=2.17.1
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 0s Docker mode activated.
-1 ❌ patch 0m 12s #5724 does not apply to branch-2.6. Rebase required? Wrong Branch? See https://yetus.apache.org/documentation/in-progress/precommit-patchnames for help.
Subsystem Report/Notes
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5724/1/console
versions git=2.17.1
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@NihalJain
Copy link
Contributor Author

Oops this seems to have messed up. Closing. Will raise a new one.

@NihalJain NihalJain closed this Feb 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
backport This PR is a back port of some issue or issues already committed to master
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.