Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tomnewton/build azure sdk #2

Closed
wants to merge 208 commits into from
Closed

Conversation

Tom-Newton
Copy link
Owner

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

@Tom-Newton Tom-Newton force-pushed the tomnewton/build_azure_sdk branch 2 times, most recently from 4e3e7a5 to d0f5b65 Compare July 24, 2023 07:43
@Tom-Newton Tom-Newton force-pushed the tomnewton/build_azure_sdk branch 2 times, most recently from 9d14edd to 6ec7910 Compare August 8, 2023 07:39
lidavidm and others added 23 commits August 8, 2023 09:24
…he#37026)

### Rationale for this change

Needed to test apache/arrow-adbc#963.

### What changes are included in this PR?

Have the SQLite Flight SQL server sample emit a gRPC status detail.

### Are these changes tested?

No.

### Are there any user-facing changes?

No.

Authored-by: David Li <li.davidm96@gmail.com>
Signed-off-by: David Li <li.davidm96@gmail.com>
…apache#37032)

### Rationale for this change

apache#35197 appears to have introduced significant performance regressions in `FieldPath::Get` - indicated [here](https://conbench.ursa.dev/compare/runs/9cf73ac83f0a44179e6538b2c1c7babd...3d76cb5ffb8849bf8c3ea9b32d08b3b7/), in a benchmark that uses a wide (10K column) dataframe.

### What changes are included in this PR?

- Adds basic benchmarks for `FieldPath::Get` across various input types, as they didn't previously exist
- Addresses several performance issues. These came in the form of extremely high upfront costs for the `RecordBatch` and `ArrayData` overloads specifically
- Some minor refactoring of `NestedSelector`

### Are these changes tested?

Yes (covered by existing tests)

### Are there any user-facing changes?

No

* Closes: apache#36892

Lead-authored-by: benibus <bpharks@gmx.com>
Co-authored-by: Antoine Pitrou <antoine@python.org>
Signed-off-by: Antoine Pitrou <antoine@python.org>
…ache#36673)

### Rationale for this change
In Arrow compute, there are four main types of functions: Scalar, Vector, ScalarAggregate and HashAggregate.

Some of the previous work added support for Scalar, ScalarAggregate(apache#35515) and HashAggregate(apache#36252). I think it makes sense to add support for vector function as well to complete all non-decomposable UDF kernel support.

Internally, we plan to extend Acero to implement a "SegmentVectorNode" which would use this API to invoke vector on a segment by segment basis, which will allow to use constant memory to compute things like "rank the value across all rows per segment using a python UDF".

### What changes are included in this PR?
The change includes is very similar to the support for aggregate function, which includes code to register the vector UDF, and a kernel that invokes the vector UDF on given inputs.

### Are these changes tested?
Yes. Added new test.

### Are there any user-facing changes?
Yes. This adds an user-facing API to register the vector function. 

* Closes: apache#36672

Authored-by: Li Jin <ice.xelloss@gmail.com>
Signed-off-by: Li Jin <ice.xelloss@gmail.com>
…e#37053)

### Rationale for this change

We can add `MINOR: [JS] ` prefix to PRs from Dependabot automatically.

### What changes are included in this PR?

Add a configuration for npm.

### Are these changes tested?

No. I want to test this by merging this to main.

### Are there any user-facing changes?

No.
* Closes: apache#37051

Lead-authored-by: Sutou Kouhei <kou@clear-code.com>
Co-authored-by: Sutou Kouhei <kou@cozmixng.org>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
… 4.7.1 in /csharp (apache#37074)

Bumps [System.Runtime.CompilerServices.Unsafe](https://github.com/dotnet/corefx) from 4.5.3 to 4.7.1.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a href="https://github.com/dotnet/corefx/releases">System.Runtime.CompilerServices.Unsafe's releases</a>.</em></p>
<blockquote>
<h2>.NET Core 2.1.0 RC1</h2>
<ul>
<li><a href="https://github.com/dotnet/core/blob/master/release-notes/2.1/Preview/2.1.0-rc1.md">Release Notes</a></li>
<li><a href="https://github.com/dotnet/core/blob/master/release-notes/2.1/Preview/2.1.0-rc1-known-issues.md">Known Issues</a></li>
<li><a href="https://github.com/dotnet/core/blob/master/release-notes/download-archives/2.1.0-rc1-download.md">Download and Install</a></li>
</ul>
<h2>Repos</h2>
<ul>
<li><a href="https://github.com/dotnet/coreclr/releases/tag/v2.1-rc1">CoreCLR</a></li>
<li><a href="https://github.com/dotnet/corefx/releases/tag/v2.1-rc1">CoreFX</a></li>
<li><a href="https://github.com/dotnet/core-setup/releases/tag/v2.1-rc1">Core-Setup</a></li>
<li><a href="https://github.com/dotnet/cli/releases/tag/v2.1.300-rc1-008673">CLI</a></li>
</ul>
</blockquote>
</details>
<details>
<summary>Commits</summary>
<ul>
<li>See full diff in <a href="https://github.com/dotnet/corefx/commits">compare view</a></li>
</ul>
</details>
<br />

[![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=System.Runtime.CompilerServices.Unsafe&package-manager=nuget&previous-version=4.5.3&new-version=4.7.1)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@ dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@ dependabot rebase` will rebase this PR
- `@ dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@ dependabot merge` will merge this PR after your CI passes on it
- `@ dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@ dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@ dependabot reopen` will reopen this PR if it is closed
- `@ dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@ dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency
- `@ dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@ dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@ dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

</details>

Authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
…e#37075)

Bumps [ZstdSharp.Port](https://github.com/oleg-st/ZstdSharp) from 0.6.7 to 0.7.2.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a href="https://github.com/oleg-st/ZstdSharp/releases">ZstdSharp.Port's releases</a>.</em></p>
<blockquote>
<h2>0.7.2</h2>
<p>IL2CPP compatibility (Unity)</p>
<h2>0.7.1</h2>
<p>Ported zstd v1.5.5</p>
<h2>0.7.0</h2>
<p>Ported zstd v1.5.4
Improved decompression speed (~5-10%)</p>
</blockquote>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a href="https://github.com/oleg-st/ZstdSharp/commit/5bd8080e555c5efd47b5de7e9725d4be47a4c438"><code>5bd8080</code></a> 0.7.2</li>
<li><a href="https://github.com/oleg-st/ZstdSharp/commit/f3949372f831255002107fc85eeda9074298cb93"><code>f394937</code></a> IL2CPP compatibility</li>
<li><a href="https://github.com/oleg-st/ZstdSharp/commit/314fbc4c7e87c4eec503090c23d93329d25e4b59"><code>314fbc4</code></a> 0.7.1</li>
<li><a href="https://github.com/oleg-st/ZstdSharp/commit/8b5177c6dc59104b8f880d3920fd999b848c5ed3"><code>8b5177c</code></a> Ported zstd v1.5.5</li>
<li><a href="https://github.com/oleg-st/ZstdSharp/commit/e5860f6533a97aac12bb4b243ee2816a33cc4e5b"><code>e5860f6</code></a> Added some tests</li>
<li><a href="https://github.com/oleg-st/ZstdSharp/commit/fd8a0b67b55b8ede0d77e38fa6f58bfae294b505"><code>fd8a0b6</code></a> Update README.md</li>
<li><a href="https://github.com/oleg-st/ZstdSharp/commit/fe1e9e99511c44362c9233b3813dd6ac33279e64"><code>fe1e9e9</code></a> 0.7.0</li>
<li><a href="https://github.com/oleg-st/ZstdSharp/commit/2b79e09d8b1dcd070a09ef6a6bac7fb757cbfa7a"><code>2b79e09</code></a> Improved decompression speed</li>
<li><a href="https://github.com/oleg-st/ZstdSharp/commit/4cfe92fe03609ff4646e383e1e9520596dceb151"><code>4cfe92f</code></a> Fixed &quot;Invalid IL detected&quot; warnings in .NET Native (1.5.4)</li>
<li><a href="https://github.com/oleg-st/ZstdSharp/commit/efc49873eb164bc58e1f7356cbe9cba778d546fd"><code>efc4987</code></a> Optimized fast c loop functions</li>
<li>Additional commits viewable in <a href="https://github.com/oleg-st/ZstdSharp/compare/0.6.7...0.7.2">compare view</a></li>
</ul>
</details>
<br />

[![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=ZstdSharp.Port&package-manager=nuget&previous-version=0.6.7&new-version=0.7.2)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@ dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@ dependabot rebase` will rebase this PR
- `@ dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@ dependabot merge` will merge this PR after your CI passes on it
- `@ dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@ dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@ dependabot reopen` will reopen this PR if it is closed
- `@ dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@ dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency
- `@ dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@ dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@ dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

</details>

Authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
…ache#37077)

Bumps [Google.Protobuf](https://github.com/protocolbuffers/protobuf) from 3.19.3 to 3.24.0.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a href="https://github.com/protocolbuffers/protobuf/releases">Google.Protobuf's releases</a>.</em></p>
<blockquote>
<h2>Protocol Buffers v3.20.3</h2>
<h1>Java</h1>
<ul>
<li>Refactoring java full runtime to reuse sub-message builders and prepare to
migrate parsing logic from parse constructor to builder.</li>
<li>Move proto wireformat parsing functionality from the private &quot;parsing
constructor&quot; to the Builder class.</li>
<li>Change the Lite runtime to prefer merging from the wireformat into mutable
messages rather than building up a new immutable object before merging. This
way results in fewer allocations and copy operations.</li>
<li>Make message-type extensions merge from wire-format instead of building up
instances and merging afterwards. This has much better performance.</li>
<li>Fix TextFormat parser to build up recurring (but supposedly not repeated)
sub-messages directly from text rather than building a new sub-message and
merging the fully formed message into the existing field.</li>
<li>This release addresses a <a href="https://github.com/protocolbuffers/protobuf/security/advisories/GHSA-h4h5-3hr4-j3g2">Security Advisory for Java users</a></li>
</ul>
<h2>Protocol Buffers v3.20.2</h2>
<h1>C++</h1>
<ul>
<li>Reduce memory consumption of MessageSet parsing</li>
<li>This release addresses a <a href="https://github.com/protocolbuffers/protobuf/security/advisories/GHSA-8gq9-2x98-w8hf">Security Advisory for C++ and Python users</a></li>
</ul>
<h2>Protocol Buffers v3.20.1</h2>
<h1>PHP</h1>
<ul>
<li>Fix building packaged PHP extension (<a href="https://redirect.github.com/protocolbuffers/protobuf/issues/9727">#9727</a>)</li>
<li>Fixed composer.json to only advertise compatibility with PHP 7.0+.  (<a href="https://redirect.github.com/protocolbuffers/protobuf/issues/9819">#9819</a>)</li>
</ul>
<h1>Ruby</h1>
<ul>
<li>Disable the aarch64 build on macOS until it can be fixed. (<a href="https://redirect.github.com/protocolbuffers/protobuf/issues/9816">#9816</a>)</li>
</ul>
<h1>Other</h1>
<ul>
<li>Fix versioning issues in 3.20.0</li>
</ul>
<h2>Protocol Buffers v3.20.1-rc1</h2>
<h1>PHP</h1>
<ul>
<li>Fix building packaged PHP extension (<a href="https://redirect.github.com/protocolbuffers/protobuf/issues/9727">#9727</a>)</li>
</ul>
<h1>Other</h1>
<ul>
<li>Fix versioning issues in 3.20.0</li>
</ul>
<h2>Protocol Buffers v3.20.0</h2>
<p>2022-03-25 version 3.20.0 (C++/Java/Python/PHP/Objective-C/C#/Ruby/JavaScript)</p>
<h1>Ruby</h1>
<ul>
<li>Dropped Ruby 2.3 and 2.4 support for CI and releases. (<a href="https://redirect.github.com/protocolbuffers/protobuf/issues/9311">#9311</a>)</li>
<li>Added Ruby 3.1 support for CI and releases (<a href="https://redirect.github.com/protocolbuffers/protobuf/issues/9566">#9566</a>).</li>
<li>Message.decode/encode: Add recursion_limit option (<a href="https://redirect.github.com/protocolbuffers/protobuf/issues/9218">#9218</a>/<a href="https://redirect.github.com/protocolbuffers/protobuf/issues/9486">#9486</a>)</li>
<li>Allocate with xrealloc()/xfree() so message allocation is visible to the
Ruby GC.  In certain tests this leads to much lower memory usage due to more
frequent GC runs (<a href="https://redirect.github.com/protocolbuffers/protobuf/issues/9586">#9586</a>).</li>
<li>Fix conversion of singleton classes in Ruby (<a href="https://redirect.github.com/protocolbuffers/protobuf/issues/9342">#9342</a>)</li>
</ul>

</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a href="https://github.com/protocolbuffers/protobuf/commit/093e258a71caacc053cf5ce86977ba3131361a9a"><code>093e258</code></a> Updating version.json and repo version numbers to: 24.0</li>
<li><a href="https://github.com/protocolbuffers/protobuf/commit/e48f6f75a72ae466e1012ab7e39acabdcd2f5aef"><code>e48f6f7</code></a> Merge pull request <a href="https://redirect.github.com/protocolbuffers/protobuf/issues/13430">#13430</a> from protocolbuffers/24.x-202308011841</li>
<li><a href="https://github.com/protocolbuffers/protobuf/commit/e82fc05571ad03112fa36e656a76a3128944111e"><code>e82fc05</code></a> Updating version.json to: 24.0-dev</li>
<li><a href="https://github.com/protocolbuffers/protobuf/commit/3487ae0c01af9130d2ee6436de142cfff9311aba"><code>3487ae0</code></a> Updating version.json and repo version numbers to: 24.0-rc3</li>
<li><a href="https://github.com/protocolbuffers/protobuf/commit/e916bf6bca6ee8f109f3ec6e2d25221490ed7fb5"><code>e916bf6</code></a> Merge pull request <a href="https://redirect.github.com/protocolbuffers/protobuf/issues/13421">#13421</a> from zhangskz/update-24-x-dep</li>
<li><a href="https://github.com/protocolbuffers/protobuf/commit/fce87eb250c2ecf7174ec2d92df8de058a0bcc65"><code>fce87eb</code></a> Update protobuf repo's upb dependency to latest 24.x commit</li>
<li><a href="https://github.com/protocolbuffers/protobuf/commit/64d9df70c60b02ab7c4d869973cd49cdee4c24c8"><code>64d9df7</code></a> Merge pull request <a href="https://redirect.github.com/protocolbuffers/protobuf/issues/13418">#13418</a> from protocolbuffers/bazel6</li>
<li><a href="https://github.com/protocolbuffers/protobuf/commit/ad916a91e5eff8d22ea4f9d50832911cdebb1483"><code>ad916a9</code></a> Merge pull request <a href="https://redirect.github.com/protocolbuffers/protobuf/issues/13417">#13417</a> from mkruskal-google/bazel6</li>
<li><a href="https://github.com/protocolbuffers/protobuf/commit/bc9002ec75b80c7bc170c2339d0486c002789d69"><code>bc9002e</code></a> bazel: Get rid of exec_tools. (<a href="https://redirect.github.com/protocolbuffers/protobuf/issues/13401">#13401</a>)</li>
<li><a href="https://github.com/protocolbuffers/protobuf/commit/fff490558816802c5b3d51169f797046f369453f"><code>fff4905</code></a> Drop support for Bazel 5.</li>
<li>Additional commits viewable in <a href="https://github.com/protocolbuffers/protobuf/compare/v3.19.3...v3.24.0">compare view</a></li>
</ul>
</details>
<br />

[![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=Google.Protobuf&package-manager=nuget&previous-version=3.19.3&new-version=3.24.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@ dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@ dependabot rebase` will rebase this PR
- `@ dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@ dependabot merge` will merge this PR after your CI passes on it
- `@ dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@ dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@ dependabot reopen` will reopen this PR if it is closed
- `@ dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@ dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency
- `@ dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@ dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@ dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

</details>

Authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
Bumps [memfs](https://github.com/streamich/memfs) from 3.5.3 to 4.2.1.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a href="https://github.com/streamich/memfs/releases">memfs's releases</a>.</em></p>
<blockquote>
<h2>v4.2.1</h2>
<h2><a href="https://github.com/streamich/memfs/compare/v4.2.0...v4.2.1">4.2.1</a> (2023-08-07)</h2>
<h3>Bug Fixes</h3>
<ul>
<li>don't error when watched directory gets renamed (<a href="https://redirect.github.com/streamich/memfs/issues/939">#939</a>) (<a href="https://github.com/streamich/memfs/commit/b431b089636619113e2dd39e9dc4a2c02048270a">b431b08</a>)</li>
</ul>
<h2>memfs v4</h2>
<p><code>memfs</code> v4 has been released, install <code>4.2.0</code> NPM package.</p>
<h2>File System Access API</h2>
<p><code>memfs</code> added adapters for <a href="https://developer.mozilla.org/en-US/docs/Web/API/File_System_Access_API">File System Access</a> (FAS) API, which is a file system API available in browsers. FSA can write to a real user folder, which user picks; or without any permissions can write to a virtual file system, called OPFS (Origin Private File System). <code>memfs</code> implements adapters, which:</p>
<ul>
<li>Construct a Node's <code>fs</code>-like API out of the FSA API.
<ul>
<li>In browser, support for synchronous <code>fs</code> methods is also available using a WebWorker.</li>
</ul>
</li>
<li>Also, the other way around, <code>memfs</code> can provide FSA API on top of any <code>fs</code>-like file system.</li>
</ul>
<h2>Other notable changes</h2>
<ul>
<li>In-memory <code>fs</code> changes
<ul>
<li>A number of in-memory <code>fs</code> bugs were fixed.</li>
<li>Type interfaces of methods and options objects for in-memory <code>fs</code> were improved.</li>
<li><code>mkdirp</code> and <code>mkdripSync</code> were removed, they were deprecated before. (You can pass the <code>&quot;recursive&quot;</code> flag to <code>mkdir</code> and <code>mkdirSync</code>, instead.)</li>
<li>Many re-usable Node.js <code>fs</code> utilities now live in the <code>/src/node</code> folder.</li>
<li>Promises API methods are now bound by default to their <code>this</code> object, just like in native <code>fs</code> module.</li>
</ul>
</li>
<li><code>crudfs</code> and <code>casfs</code>
<ul>
<li><code>crudfs</code> implementation on top of Node <code>fs</code> was added.</li>
<li><code>crudfs</code> implementation on top of File System Access API was added.</li>
<li><code>casfs</code> implementation on top of <code>crudfs</code> was added.</li>
</ul>
</li>
<li><code>print</code> utility was added which allows to recursively print a directory tree to terminal.</li>
<li><code>snapshot</code> utility was added which allows to create recursive binary snapshots of folders and then load them back into some folder.</li>
<li>The <code>/demo</code> folder now contains multiple Webpack demos.</li>
<li>Build changes and deprecations
<ul>
<li>TypeScript was upgraded from version 4 to 5.</li>
<li><code>tslib</code> is now included as peer dependency, instead of TypeScript helpers being emitted into distributable.</li>
<li>TypeScript build target of the distributable is no <code>es2017</code>, instead of previously <code>es5</code>.</li>
<li>The library is now tested on Node v18+ versions.</li>
<li><code>BigInt</code> shim is no longer shipped, <code>memfs</code> will rely on the <code>BigInt</code> provided by the JavaScript environment. You can shim that global, if necessary.</li>
<li><code>fs-monkey</code> dependency was removed.</li>
</ul>
</li>
<li>New features in this major release are marked as <code>experimental</code>, which means those APIs are in preview, their public interface may have breaking changes even across minor releases.</li>
<li>CircleCI was removed, now GitHub Actions power all builds and releases.</li>
<li>The <code>next</code> branch was tested, which deploys pre-releases.</li>
</ul>
<h3>Bug Fixes</h3>

</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a href="https://github.com/streamich/memfs/blob/master/CHANGELOG.md">memfs's changelog</a>.</em></p>
<blockquote>
<h2><a href="https://github.com/streamich/memfs/compare/v4.2.0...v4.2.1">4.2.1</a> (2023-08-07)</h2>
<h3>Bug Fixes</h3>
<ul>
<li>don't error when watched directory gets renamed (<a href="https://redirect.github.com/streamich/memfs/issues/939">#939</a>) (<a href="https://github.com/streamich/memfs/commit/b431b089636619113e2dd39e9dc4a2c02048270a">b431b08</a>)</li>
</ul>
<h1><a href="https://github.com/streamich/memfs/compare/v4.0.0...v4.1.0">4.1.0</a> (2023-06-26)</h1>
<h3>Bug Fixes</h3>
<ul>
<li>🐛 add support for unknown nodes (<a href="https://github.com/streamich/memfs/commit/77786f16ca77a2658d73c3bdb29d5018a1fe9ecc">77786f1</a>)</li>
<li>🐛 allow readin into various kinds of buffers (<a href="https://github.com/streamich/memfs/commit/361812dc7d05b2c8ed1f52cb2181d0f71d9c2f4f">361812d</a>)</li>
<li>🐛 allow readin into various kinds of buffers (<a href="https://github.com/streamich/memfs/commit/e9c70e97dc2e063848baf7e3d307cd30491116a2">e9c70e9</a>)</li>
<li>🐛 allow to seek in file (<a href="https://github.com/streamich/memfs/commit/c04895b50b18996e2b7c9c4ba389baaede57fc1f">c04895b</a>)</li>
<li>🐛 allow to seek in file (<a href="https://github.com/streamich/memfs/commit/b3636899c8091a8ee1443b148fc23ebb1895ce18">b363689</a>)</li>
<li>🐛 correctly handle directory paths (<a href="https://github.com/streamich/memfs/commit/ea909e805781d19f7c3749dab65155f67b119344">ea909e8</a>)</li>
<li>🐛 do not allow empty children names (<a href="https://github.com/streamich/memfs/commit/f014fd8e19aec12163c717eed429c2a6ddc95437">f014fd8</a>)</li>
<li>🐛 do not allow empty children names (<a href="https://github.com/streamich/memfs/commit/43da1d6279e4c32543ebfd0780bf149d27a07265">43da1d6</a>)</li>
<li>🐛 handle root folder better (<a href="https://github.com/streamich/memfs/commit/89bbffde3fc2bd1e41b2c292888023b9b72cf41d">89bbffd</a>)</li>
<li>🐛 handle root folder better (<a href="https://github.com/streamich/memfs/commit/76de78002fa4ae613308227fd03ee2f643c41671">76de780</a>)</li>
<li>🐛 improve file opening and closing logic (<a href="https://github.com/streamich/memfs/commit/403c27140536b27b1137d68d493851d360b7c90f">403c271</a>)</li>
<li>🐛 throw &quot;ENOENT&quot; and &quot;ENOTDIR&quot; when folder or file 404 (<a href="https://github.com/streamich/memfs/commit/5de4faa305748006a45817f6fa8446ed7e4df5b1">5de4faa</a>)</li>
<li>🐛 throw &quot;ENOENT&quot; and &quot;ENOTDIR&quot; when folder or file 404 (<a href="https://github.com/streamich/memfs/commit/ddd5d565b33009959e32e77db8e1705809c4c29a">ddd5d56</a>)</li>
</ul>
<h3>Features</h3>
<ul>
<li>🎸 add .toTree() to Volume (<a href="https://github.com/streamich/memfs/commit/2d5c4cb8097f7b09b223d980efe9e14a2576ed6f">2d5c4cb</a>)</li>
<li>🎸 add .truncate() method (<a href="https://github.com/streamich/memfs/commit/038ab36d1ac8b24428a11135fe9affe95c99e587">038ab36</a>)</li>
<li>🎸 add .truncate() method (<a href="https://github.com/streamich/memfs/commit/085335ca8736b67db05c02bbd11cccf5b9bf000b">085335c</a>)</li>
<li>🎸 add ability to close files (<a href="https://github.com/streamich/memfs/commit/0db56becb255d4fce72fce16fa8cc120c07ed41a">0db56be</a>)</li>
<li>🎸 add ability to close files (<a href="https://github.com/streamich/memfs/commit/d3828a8058808ebdcd055493f4c2f72e3bcb58e7">d3828a8</a>)</li>
<li>🎸 add ability to create sub directories (<a href="https://github.com/streamich/memfs/commit/8f15bd9dd4f6e00360a000aaaf865af984ca2559">8f15bd9</a>)</li>
<li>🎸 add ability to create sub directories (<a href="https://github.com/streamich/memfs/commit/528c807281a0f920d4c819eebef942cd250b4479">528c807</a>)</li>
<li>🎸 add ability to remove all files (<a href="https://github.com/streamich/memfs/commit/76cabc763c280bc23abb8d873f5fa304ce8fcef6">76cabc7</a>)</li>
<li>🎸 add ability to remove all files (<a href="https://github.com/streamich/memfs/commit/566e29b543825e6bc71c9b881ce05e93ee657eca">566e29b</a>)</li>
<li>🎸 add appendFileSync() method (<a href="https://github.com/streamich/memfs/commit/57192fe98112970fcda201fcf240c57da071cdae">57192fe</a>)</li>
<li>🎸 add appendFileSync() method (<a href="https://github.com/streamich/memfs/commit/27411e40125d8fb86e13977735d9122166d55961">27411e4</a>)</li>
<li>🎸 add basenem() utility (<a href="https://github.com/streamich/memfs/commit/8b276956876c270dda1e5f7930392daa9a97acf5">8b27695</a>)</li>
<li>🎸 add basenem() utility (<a href="https://github.com/streamich/memfs/commit/43354e5a024c8be28a897c53e1d4ea5b46b66d39">43354e5</a>)</li>
<li>🎸 add binary serialization to snapshots (<a href="https://github.com/streamich/memfs/commit/c1cd615d7172023c2c7a40b61767d8a3470c9b33">c1cd615</a>)</li>
<li>🎸 add copyFile() method (<a href="https://github.com/streamich/memfs/commit/de2bb0aae0c5380dde78689ac1376862f26c6af9">de2bb0a</a>)</li>
<li>🎸 add copyFile() method (<a href="https://github.com/streamich/memfs/commit/5e207c4a60019f4df187510682d83a0597df2468">5e207c4</a>)</li>
<li>🎸 add copyFileSync() method (<a href="https://github.com/streamich/memfs/commit/7e0137c23c4b0254e1cf40fcad0349f282d4a556">7e0137c</a>)</li>
<li>🎸 add copyFileSync() method (<a href="https://github.com/streamich/memfs/commit/5fc1bacf4a337ca25d0207a0e9f94768c2976528">5fc1bac</a>)</li>
<li>🎸 add createSwapFile() method (<a href="https://github.com/streamich/memfs/commit/dfdb90893bf67b035337fc059b44f7ad9dfba6a7">dfdb908</a>)</li>
<li>🎸 add createSwapFile() method (<a href="https://github.com/streamich/memfs/commit/b07ce795e757cab67ab4b81e50c397486e32ba40">b07ce79</a>)</li>
<li>🎸 add crudfs types (<a href="https://github.com/streamich/memfs/commit/18c0658124a83e7819022ccb415d163b88e7abbb">18c0658</a>)</li>
</ul>

</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a href="https://github.com/streamich/memfs/commit/a16834f7c9a8a24985473f5dab638f60d1410174"><code>a16834f</code></a> chore(release): 4.2.1 [skip ci]</li>
<li><a href="https://github.com/streamich/memfs/commit/b431b089636619113e2dd39e9dc4a2c02048270a"><code>b431b08</code></a> fix: don't error when watched directory gets renamed (<a href="https://redirect.github.com/streamich/memfs/issues/939">#939</a>)</li>
<li><a href="https://github.com/streamich/memfs/commit/cd6c25698536aab8845774c4a0036376a0fd599f"><code>cd6c256</code></a> chore(deps): bump semver from 5.7.1 to 5.7.2 (<a href="https://redirect.github.com/streamich/memfs/issues/935">#935</a>)</li>
<li><a href="https://github.com/streamich/memfs/commit/3356138893ac68619cb671abd10654b63c570ba9"><code>3356138</code></a> Merge pull request <a href="https://redirect.github.com/streamich/memfs/issues/903">#903</a> from streamich/renovate/rimraf-5.x</li>
<li><a href="https://github.com/streamich/memfs/commit/af1e9d1f4d8df206dc5670893a7a390a4bb326f4"><code>af1e9d1</code></a> Release 4.2.0</li>
<li><a href="https://github.com/streamich/memfs/commit/75e60a50621649f4f303427cc5b6d1a9942ffcf5"><code>75e60a5</code></a> docs: remove v4 notice</li>
<li><a href="https://github.com/streamich/memfs/commit/7556e5be4c40b9abd41c25fb687e6efe34f2cbb7"><code>7556e5b</code></a> chore(release): 4.1.0 [skip ci]</li>
<li><a href="https://github.com/streamich/memfs/commit/51c40524034bd4a6180acc6a4e8b9ed8393f6324"><code>51c4052</code></a> chore(deps): update dependency rimraf to v5</li>
<li><a href="https://github.com/streamich/memfs/commit/32dd55af51e8374f98bb6818c9688233d15cc60f"><code>32dd55a</code></a> Merge pull request <a href="https://redirect.github.com/streamich/memfs/issues/926">#926</a> from streamich/next</li>
<li><a href="https://github.com/streamich/memfs/commit/491272bcc0179b005694d59a6dd437445f49ead2"><code>491272b</code></a> chore: 🤖 bump compile target to es2017</li>
<li>Additional commits viewable in <a href="https://github.com/streamich/memfs/compare/v3.5.3...v4.2.1">compare view</a></li>
</ul>
</details>
<br />

[![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=memfs&package-manager=npm_and_yarn&previous-version=3.5.3&new-version=4.2.1)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@ dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@ dependabot rebase` will rebase this PR
- `@ dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@ dependabot merge` will merge this PR after your CI passes on it
- `@ dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@ dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@ dependabot reopen` will reopen this PR if it is closed
- `@ dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@ dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency
- `@ dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@ dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@ dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

</details>

Authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
…ten (apache#35672)

As previously discussed in apache#35176 this is a patch that adds an option `ARROW_ENABLE_THREADING`. When it is turned off, arrow threadpool and serial executors don't spawn threads, and instead run tasks in the main thread when futures are waited for.

It doesn't mess with threading in projects included as dependencies, e.g. multithreaded malloc implementations because if you're building for a non threaded environment, you can't use those anyway.

Basically where this is at is that it runs the test suite okay, and I think should work well enough to be a backend for pandas on emscripten/pyodide.

What this means is:
1) It is possible to use arrow in non-threaded emscripten/webassembly environments (with some build patches specific to emscripten which I'll put in once this is in)
2) Most of arrow just works, albeit slower in parts.

Things that don't work and probably won't:
1) Server stuff that relies on threads. Not a massive problem I think because environments with threading restrictions are currently typically also restricted from making servers anyway (i.e. they are web browsers)
2) Anything that relies on actually doing two things at once (for obvious reasons)

Things that don't work yet and could be fixed in future:
1) use of asynchronous file/network APIs in emscripten which would mean I/O could work efficiently in one thread.
2) asofjoin - right now the implementation relies on std::thread - it needs refactoring to work with threadpool like everything else in arrow, but I'm not sure I am expert enough in the codebase to do it well.
* Closes: apache#35176

Lead-authored-by: Joe Marshall <joe.marshall@nottingham.ac.uk>
Co-authored-by: Sutou Kouhei <kou@cozmixng.org>
Co-authored-by: Weston Pace <weston.pace@gmail.com>
Co-authored-by: Antoine Pitrou <pitrou@free.fr>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
…ting (apache#37020)

### Rationale for this change

Docs were out of data with code after previous changes to returned object type

### What changes are included in this PR?

Update docs to reflect correct return type

### Are these changes tested?

No

### Are there any user-facing changes?

No
* Closes: apache#37019

Authored-by: Nic Crane <thisisnic@gmail.com>
Signed-off-by: Nic Crane <thisisnic@gmail.com>
…or of (name, type) pairs (apache#36915)

### Rationale for this change
Mostly for convenience. It would be nice to be able to write:
```struct_({{"a", int8()}, {"b", utf8()}});```
instead of:
```struct_({field("a", int8()), field("b", utf8())});```
Same with the schema factory.

### What changes are included in this PR?
Add a struct_ overload and two schema overload taking a vector of (name, type) pairs to construct a vector of fields.

### Are these changes tested?
Yes.

### Are there any user-facing changes?
Yes. Add three ARROW_EXPORT functions.

* Closes: apache#36867

Authored-by: jsjtxietian <jsjtxietian@outlook.com>
Signed-off-by: Antoine Pitrou <antoine@python.org>
…pache#36937)

### Rationale for this change

The following types and functions should be in file scope:

IpcReadConext, BatchDataReadRequest, ArrayLoader,
DecompressBuffer(s), LoadRecordBatch*, GetCompression*,
ReadRecordBatchInternal,
GetInclusionMaskAndOutSchmea, UnpackSchemaMessage,
ReadDictionary, AsyncRecordBatchStreamReaderImpl.

### What changes are included in this PR?

Use anonymous namespace around the aforementioned definitions.

### Are these changes tested?

No

### Are there any user-facing changes?

No

Lead-authored-by: pegasas <616672335@qq.com>
Co-authored-by: Antoine Pitrou <antoine@python.org>
Signed-off-by: Antoine Pitrou <antoine@python.org>
…pache#36517)

### Rationale for this change

Async is a long-requested feature.

### What changes are included in this PR?

Just the C++ implementation of async GetFlightInfo for the client.

### Are these changes tested?

Yes.

### Are there any user-facing changes?

Yes, new APIs.

* Closes: apache#36512

Authored-by: David Li <li.davidm96@gmail.com>
Signed-off-by: David Li <li.davidm96@gmail.com>
### Rationale for this change

Add `cumulative_mean` function

### What changes are included in this PR?

Implement `cumulative_mean` function. The current cumulative_* kernel generator can only be based on a simple binary arithmetic op and the state can only be a single value. I refactored it to using of a generic state such that it can handle complex operations such as `mean`, `median`, `var` etc.

### Are these changes tested?

Yes

### Are there any user-facing changes?
No

* Closes: apache#36931

Lead-authored-by: Jin Shang <shangjin1997@gmail.com>
Co-authored-by: Antoine Pitrou <antoine@python.org>
Signed-off-by: Antoine Pitrou <antoine@python.org>
### Rationale for this change

Currently `round` casts integers to floats which causes undesired behavior.

### What changes are included in this PR?

Add round kernels for integer types.

### Are these changes tested?

Yes.

### Are there any user-facing changes?

No.

* Closes: apache#35273

Lead-authored-by: Jin Shang <shangjin1997@gmail.com>
Co-authored-by: Antoine Pitrou <pitrou@free.fr>
Co-authored-by: Weston Pace <weston.pace@gmail.com>
Signed-off-by: Antoine Pitrou <antoine@python.org>
…che#37079)

Bumps [eslint-plugin-jest](https://github.com/jest-community/eslint-plugin-jest) from 27.2.1 to 27.2.3.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a href="https://github.com/jest-community/eslint-plugin-jest/releases">eslint-plugin-jest's releases</a>.</em></p>
<blockquote>
<h2>v27.2.3</h2>
<h2><a href="https://github.com/jest-community/eslint-plugin-jest/compare/v27.2.2...v27.2.3">27.2.3</a> (2023-07-13)</h2>
<h3>Bug Fixes</h3>
<ul>
<li>allow <code>@ typescript-eslint/eslint-plugin</code> v6 as peer dep (<a href="https://redirect.github.com/jest-community/eslint-plugin-jest/issues/1400">#1400</a>) (<a href="https://github.com/jest-community/eslint-plugin-jest/commit/04b2bf29bf086f8ce8173a9c3bc15ce31915dbe2">04b2bf2</a>), closes <a href="https://redirect.github.com/jest-community/eslint-plugin-jest/issues/1398">#1398</a></li>
</ul>
<h2>v27.2.2</h2>
<h2><a href="https://github.com/jest-community/eslint-plugin-jest/compare/v27.2.1...v27.2.2">27.2.2</a> (2023-06-19)</h2>
<h3>Bug Fixes</h3>
<ul>
<li>add missing (optional) peer dependency on Jest (<a href="https://redirect.github.com/jest-community/eslint-plugin-jest/issues/1384">#1384</a>) (<a href="https://github.com/jest-community/eslint-plugin-jest/commit/34c3d32cab726c88dc385a9e7a8998c727f4720c">34c3d32</a>)</li>
</ul>
</blockquote>
</details>
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a href="https://github.com/jest-community/eslint-plugin-jest/blob/main/CHANGELOG.md">eslint-plugin-jest's changelog</a>.</em></p>
<blockquote>
<h2><a href="https://github.com/jest-community/eslint-plugin-jest/compare/v27.2.2...v27.2.3">27.2.3</a> (2023-07-13)</h2>
<h3>Bug Fixes</h3>
<ul>
<li>allow <code>@ typescript-eslint/eslint-plugin</code> v6 as peer dep (<a href="https://redirect.github.com/jest-community/eslint-plugin-jest/issues/1400">#1400</a>) (<a href="https://github.com/jest-community/eslint-plugin-jest/commit/04b2bf29bf086f8ce8173a9c3bc15ce31915dbe2">04b2bf2</a>), closes <a href="https://redirect.github.com/jest-community/eslint-plugin-jest/issues/1398">#1398</a></li>
</ul>
<h2><a href="https://github.com/jest-community/eslint-plugin-jest/compare/v27.2.1...v27.2.2">27.2.2</a> (2023-06-19)</h2>
<h3>Bug Fixes</h3>
<ul>
<li>add missing (optional) peer dependency on Jest (<a href="https://redirect.github.com/jest-community/eslint-plugin-jest/issues/1384">#1384</a>) (<a href="https://github.com/jest-community/eslint-plugin-jest/commit/34c3d32cab726c88dc385a9e7a8998c727f4720c">34c3d32</a>)</li>
</ul>
</blockquote>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a href="https://github.com/jest-community/eslint-plugin-jest/commit/4b354862ec828af9f15c47542b4139290e9a78e5"><code>4b35486</code></a> chore(release): 27.2.3 [skip ci]</li>
<li><a href="https://github.com/jest-community/eslint-plugin-jest/commit/04b2bf29bf086f8ce8173a9c3bc15ce31915dbe2"><code>04b2bf2</code></a> fix: allow <code>@ typescript-eslint/eslint-plugin</code> v6 as peer dep (<a href="https://redirect.github.com/jest-community/eslint-plugin-jest/issues/1400">#1400</a>)</li>
<li><a href="https://github.com/jest-community/eslint-plugin-jest/commit/a1131ff69c86514f881862c24981250dfa42bb7b"><code>a1131ff</code></a> chore(deps): update yarn to v3.6.1 (<a href="https://redirect.github.com/jest-community/eslint-plugin-jest/issues/1392">#1392</a>)</li>
<li><a href="https://github.com/jest-community/eslint-plugin-jest/commit/6034de3169d0b4870f3b280e1784ed2c0d46fffc"><code>6034de3</code></a> chore(deps): lock file maintenance</li>
<li><a href="https://github.com/jest-community/eslint-plugin-jest/commit/6340c2fee6a7c7ecba7d6500dc2074713c03bc5a"><code>6340c2f</code></a> chore(deps): lock file maintenance</li>
<li><a href="https://github.com/jest-community/eslint-plugin-jest/commit/7daaf898683346afc85441d37994ff563dba9093"><code>7daaf89</code></a> chore(deps): lock file maintenance</li>
<li><a href="https://github.com/jest-community/eslint-plugin-jest/commit/c29a775db38b34cb3bbc4fe83c60a13b5122e5a3"><code>c29a775</code></a> chore: upgrade <code>@​tsconfig/node14</code> (<a href="https://redirect.github.com/jest-community/eslint-plugin-jest/issues/1388">#1388</a>)</li>
<li><a href="https://github.com/jest-community/eslint-plugin-jest/commit/9240ecf68f4196cc5da625e1ad64a35958d4b731"><code>9240ecf</code></a> chore(deps): lock file maintenance</li>
<li><a href="https://github.com/jest-community/eslint-plugin-jest/commit/59e213ab8d0d4a0b56461fca4090fae772fe645e"><code>59e213a</code></a> chore: refer directly to index.js file</li>
<li><a href="https://github.com/jest-community/eslint-plugin-jest/commit/b161c26176764712328303db5b54824be09a048c"><code>b161c26</code></a> chore: remove test files from published tarball</li>
<li>Additional commits viewable in <a href="https://github.com/jest-community/eslint-plugin-jest/compare/v27.2.1...v27.2.3">compare view</a></li>
</ul>
</details>
<br />

[![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=eslint-plugin-jest&package-manager=npm_and_yarn&previous-version=27.2.1&new-version=27.2.3)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@ dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@ dependabot rebase` will rebase this PR
- `@ dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@ dependabot merge` will merge this PR after your CI passes on it
- `@ dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@ dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@ dependabot reopen` will reopen this PR if it is closed
- `@ dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@ dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency
- `@ dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@ dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@ dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

</details>

Authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
[//]: # (dependabot-start)
⚠️  **Dependabot is rebasing this PR** ⚠️ 

Rebasing might not happen immediately, so don't worry if this takes some time.

Note: if you make any changes to this PR yourself, they will take precedence over the rebase.

---

[//]: # (dependabot-end)

Bumps [jest](https://github.com/facebook/jest/tree/HEAD/packages/jest) and [@ types/jest](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/jest). These dependencies needed to be updated together.
Updates `jest` from 29.5.0 to 29.6.2
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a href="https://github.com/facebook/jest/releases">jest's releases</a>.</em></p>
<blockquote>
<h2>v29.6.2</h2>
<h2>Fixes</h2>
<ul>
<li><code>[jest-circus]</code> Fix snapshot matchers in concurrent tests when nr of tests exceeds <code>maxConcurrency</code> (<a href="https://redirect.github.com/jestjs/jest/pull/14335">#14335</a>)</li>
<li><code>[@ jest/core]</code> When running global setup and teardown, do not try to change the <code>message</code> property of the thrown error object when the <code>message</code> property is unwritable (<a href="https://redirect.github.com/jestjs/jest/pull/14113">#14113</a>)</li>
<li><code>[jest-snapshot]</code> Move <code>@ types/prettier</code> from <code>dependencies</code> to <code>devDependencies</code> (<a href="https://redirect.github.com/jestjs/jest/pull/14328">#14328</a>)</li>
<li><code>[jest-snapshot]</code> Throw an explicit error if Prettier v3 is used (<a href="https://redirect.github.com/jestjs/jest/pull/14367">#14367</a>)</li>
<li><code>[jest-reporters]</code> Add &quot;skipped&quot; and &quot;todo&quot; symbols to Github Actions Reporter (<a href="https://redirect.github.com/jestjs/jest/pull/14309">#14309</a>)</li>
</ul>
<h2>Chore &amp; Maintenance</h2>
<ul>
<li><code>[@ jest/core]</code> Use <code>pluralize</code> from <code>jest-util</code> rather than own internal (<a href="https://redirect.github.com/jestjs/jest/pull/14322">#14322</a>)</li>
</ul>
<h2>New Contributors</h2>
<ul>
<li><a href="https://github.com/Kloen"><code>@​Kloen</code></a> made their first contribution in <a href="https://redirect.github.com/jestjs/jest/pull/14328">jestjs/jest#14328</a></li>
<li><a href="https://github.com/eryue0220"><code>@​eryue0220</code></a> made their first contribution in <a href="https://redirect.github.com/jestjs/jest/pull/14322">jestjs/jest#14322</a></li>
<li><a href="https://github.com/david-szabo97"><code>@​david-szabo97</code></a> made their first contribution in <a href="https://redirect.github.com/jestjs/jest/pull/14113">jestjs/jest#14113</a></li>
</ul>
<p><strong>Full Changelog</strong>: <a href="https://github.com/jestjs/jest/compare/v29.6.1...v29.6.2">https://github.com/jestjs/jest/compare/v29.6.1...v29.6.2</a></p>
<h2>v29.6.1</h2>
<h2>Fixes</h2>
<ul>
<li><code>[jest-circus]</code> Revert <a href="https://redirect.github.com/jestjs/jest/pull/14110">#14110</a> as it was a breaking change (<a href="https://redirect.github.com/jestjs/jest/pull/14304">#14304</a>)</li>
</ul>
<p><strong>Full Changelog</strong>: <a href="https://github.com/jestjs/jest/compare/v29.6.0...v29.6.1">https://github.com/jestjs/jest/compare/v29.6.0...v29.6.1</a></p>
<h2>v29.6.0</h2>
<h2>Features</h2>
<ul>
<li><code>[jest-circus, jest-snapshot]</code> Add support for snapshot matchers in concurrent tests (<a href="https://redirect.github.com/jestjs/jest/pull/14139">#14139</a>)</li>
<li><code>[jest-cli]</code> Include type definitions to generated config files (<a href="https://redirect.github.com/facebook/jest/pull/14078">#14078</a>)</li>
<li><code>[jest-snapshot]</code> Support arrays as property matchers (<a href="https://redirect.github.com/facebook/jest/pull/14025">#14025</a>)</li>
<li><code>[jest-core, jest-circus, jest-reporter, jest-runner]</code> Added support for reporting about start individual test cases using jest-circus (<a href="https://redirect.github.com/jestjs/jest/pull/14174">#14174</a>)</li>
</ul>
<h2>Fixes</h2>
<ul>
<li><code>[jest-circus]</code> Prevent false test failures caused by promise rejections handled asynchronously (<a href="https://redirect.github.com/jestjs/jest/pull/14110">#14110</a>)</li>
<li><code>[jest-config]</code> Handle frozen config object (<a href="https://redirect.github.com/facebook/jest/pull/14054">#14054</a>)</li>
<li><code>[jest-config]</code> Allow <code>coverageDirectory</code> and <code>collectCoverageFrom</code> in project config (<a href="https://redirect.github.com/jestjs/jest/pull/14180">#14180</a>)</li>
<li><code>[jest-core]</code> Always use workers in watch mode to avoid crashes (<a href="https://redirect.github.com/facebook/jest/pull/14059">#14059</a>).</li>
<li><code>[jest-environment-jsdom, jest-environment-node]</code> Fix assignment of <code>customExportConditions</code> via <code>testEnvironmentOptions</code> when custom env subclass defines a default value (<a href="https://redirect.github.com/facebook/jest/pull/13989">#13989</a>)</li>
<li><code>[jest-matcher-utils]</code> Fix copying value of inherited getters (<a href="https://redirect.github.com/facebook/jest/pull/14007">#14007</a>)</li>
<li><code>[jest-mock]</code> Tweak typings to allow <code>jest.replaceProperty()</code> replace methods (<a href="https://redirect.github.com/facebook/jest/pull/14008">#14008</a>)</li>
<li><code>[jest-mock]</code> Improve user input validation and error messages of <code>spyOn</code> and <code>replaceProperty</code> methods (<a href="https://redirect.github.com/facebook/jest/pull/14087">#14087</a>)</li>
<li><code>[jest-runtime]</code> Bind <code>jest.isolateModulesAsync</code> to <code>this</code> (<a href="https://redirect.github.com/facebook/jest/pull/14083">#14083</a>)</li>
<li><code>[jest-runtime]</code> Forward <code>wrapperLength</code> to the <code>Script</code> constructor as <code>columnOffset</code> for accurate debugging (<a href="https://redirect.github.com/facebook/jest/pull/14148">#14148</a>)</li>
<li><code>[jest-runtime]</code> Guard <code>_isMockFunction</code> access with <code>in</code> (<a href="https://redirect.github.com/facebook/jest/pull/14188">#14188</a>)</li>
<li><code>[jest-snapshot]</code> Fix a potential bug when not using prettier and improve performance (<a href="https://redirect.github.com/facebook/jest/pull/14036">#14036</a>)</li>
</ul>

</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a href="https://github.com/jestjs/jest/blob/main/CHANGELOG.md">jest's changelog</a>.</em></p>
<blockquote>
<h2>29.6.2</h2>
<h3>Fixes</h3>
<ul>
<li><code>[jest-circus]</code> Fix snapshot matchers in concurrent tests when nr of tests exceeds <code>maxConcurrency</code> (<a href="https://redirect.github.com/jestjs/jest/pull/14335">#14335</a>)</li>
<li><code>[@ jest/core]</code> When running global setup and teardown, do not try to change the <code>message</code> property of the thrown error object when the <code>message</code> property is unwritable (<a href="https://redirect.github.com/jestjs/jest/pull/14113">#14113</a>)</li>
<li><code>[jest-snapshot]</code> Move <code>@ types/prettier</code> from <code>dependencies</code> to <code>devDependencies</code> (<a href="https://redirect.github.com/jestjs/jest/pull/14328">#14328</a>)</li>
<li><code>[jest-snapshot]</code> Throw an explicit error if Prettier v3 is used (<a href="https://redirect.github.com/jestjs/jest/pull/14367">#14367</a>)</li>
<li><code>[jest-reporters]</code> Add &quot;skipped&quot; and &quot;todo&quot; symbols to Github Actions Reporter (<a href="https://redirect.github.com/jestjs/jest/pull/14309">#14309</a>)</li>
</ul>
<h3>Chore &amp; Maintenance</h3>
<ul>
<li><code>[@ jest/core]</code> Use <code>pluralize</code> from <code>jest-util</code> rather than own internal (<a href="https://redirect.github.com/jestjs/jest/pull/14322">#14322</a>)</li>
</ul>
<h2>29.6.1</h2>
<h3>Fixes</h3>
<ul>
<li><code>[jest-circus]</code> Revert <a href="https://redirect.github.com/jestjs/jest/pull/14110">#14110</a> as it was a breaking change (<a href="https://redirect.github.com/jestjs/jest/pull/14304">#14304</a>)</li>
</ul>
<h2>29.6.0</h2>
<h3>Features</h3>
<ul>
<li><code>[jest-circus, jest-snapshot]</code> Add support for snapshot matchers in concurrent tests (<a href="https://redirect.github.com/jestjs/jest/pull/14139">#14139</a>)</li>
<li><code>[jest-cli]</code> Include type definitions to generated config files (<a href="https://redirect.github.com/facebook/jest/pull/14078">#14078</a>)</li>
<li><code>[jest-snapshot]</code> Support arrays as property matchers (<a href="https://redirect.github.com/facebook/jest/pull/14025">#14025</a>)</li>
<li><code>[jest-core, jest-circus, jest-reporter, jest-runner]</code> Added support for reporting about start individual test cases using jest-circus (<a href="https://redirect.github.com/jestjs/jest/pull/14174">#14174</a>)</li>
</ul>
<h3>Fixes</h3>
<ul>
<li><code>[jest-circus]</code> Prevent false test failures caused by promise rejections handled asynchronously (<a href="https://redirect.github.com/jestjs/jest/pull/14110">#14110</a>)</li>
<li><code>[jest-config]</code> Handle frozen config object (<a href="https://redirect.github.com/facebook/jest/pull/14054">#14054</a>)</li>
<li><code>[jest-config]</code> Allow <code>coverageDirectory</code> and <code>collectCoverageFrom</code> in project config (<a href="https://redirect.github.com/jestjs/jest/pull/14180">#14180</a>)</li>
<li><code>[jest-core]</code> Always use workers in watch mode to avoid crashes (<a href="https://redirect.github.com/facebook/jest/pull/14059">#14059</a>).</li>
<li><code>[jest-environment-jsdom, jest-environment-node]</code> Fix assignment of <code>customExportConditions</code> via <code>testEnvironmentOptions</code> when custom env subclass defines a default value (<a href="https://redirect.github.com/facebook/jest/pull/13989">#13989</a>)</li>
<li><code>[jest-matcher-utils]</code> Fix copying value of inherited getters (<a href="https://redirect.github.com/facebook/jest/pull/14007">#14007</a>)</li>
<li><code>[jest-mock]</code> Tweak typings to allow <code>jest.replaceProperty()</code> replace methods (<a href="https://redirect.github.com/facebook/jest/pull/14008">#14008</a>)</li>
<li><code>[jest-mock]</code> Improve user input validation and error messages of <code>spyOn</code> and <code>replaceProperty</code> methods (<a href="https://redirect.github.com/facebook/jest/pull/14087">#14087</a>)</li>
<li><code>[jest-runtime]</code> Bind <code>jest.isolateModulesAsync</code> to <code>this</code> (<a href="https://redirect.github.com/facebook/jest/pull/14083">#14083</a>)</li>
<li><code>[jest-runtime]</code> Forward <code>wrapperLength</code> to the <code>Script</code> constructor as <code>columnOffset</code> for accurate debugging (<a href="https://redirect.github.com/facebook/jest/pull/14148">#14148</a>)</li>
<li><code>[jest-runtime]</code> Guard <code>_isMockFunction</code> access with <code>in</code> (<a href="https://redirect.github.com/facebook/jest/pull/14188">#14188</a>)</li>
<li><code>[jest-snapshot]</code> Fix a potential bug when not using prettier and improve performance (<a href="https://redirect.github.com/facebook/jest/pull/14036">#14036</a>)</li>
<li><code>[@ jest/transform]</code> Do not instrument <code>.json</code> modules (<a href="https://redirect.github.com/facebook/jest/pull/14048">#14048</a>)</li>
<li><code>[jest-worker]</code> Restart a shut down worker before sending it a task (<a href="https://redirect.github.com/facebook/jest/pull/14015">#14015</a>)</li>
</ul>
<h3>Chore &amp; Maintenance</h3>
<ul>
<li><code>[*]</code> Update <code>semver</code> dependency to get vulnerability fix (<a href="https://redirect.github.com/jestjs/jest/pull/14262">#14262</a>)</li>
<li><code>[docs]</code> Updated documentation for the <code>--runTestsByPath</code> CLI command (<a href="https://redirect.github.com/facebook/jest/pull/14004">#14004</a>)</li>
</ul>

</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a href="https://github.com/jestjs/jest/commit/0fd5b1c37555f485c56a6ad2d6b010a72204f9f6"><code>0fd5b1c</code></a> v29.6.2</li>
<li><a href="https://github.com/jestjs/jest/commit/1f019afdcdfc54a6664908bb45f343db4e3d0848"><code>1f019af</code></a> v29.6.1</li>
<li><a href="https://github.com/jestjs/jest/commit/c1e5b8a38ef54bb138409f89831942ebf6a7a67e"><code>c1e5b8a</code></a> v29.6.0</li>
<li><a href="https://github.com/jestjs/jest/commit/6ffa48d1cd7d85189f0dbc1e37fd0efafa5c221c"><code>6ffa48d</code></a> chore: upgrade TypeScript to v5 (<a href="https://github.com/facebook/jest/tree/HEAD/packages/jest/issues/14155">#14155</a>)</li>
<li><a href="https://github.com/jestjs/jest/commit/a95eeb6c2c8145a81190149a52a30fc177417ecc"><code>a95eeb6</code></a> chore: update tsd runner (<a href="https://github.com/facebook/jest/tree/HEAD/packages/jest/issues/14020">#14020</a>)</li>
<li>See full diff in <a href="https://github.com/facebook/jest/commits/v29.6.2/packages/jest">compare view</a></li>
</ul>
</details>
<br />

Updates `@ types/jest` from 29.5.2 to 29.5.3
<details>
<summary>Commits</summary>
<ul>
<li>See full diff in <a href="https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/jest">compare view</a></li>
</ul>
</details>
<br />

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@ dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@ dependabot rebase` will rebase this PR
- `@ dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@ dependabot merge` will merge this PR after your CI passes on it
- `@ dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@ dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@ dependabot reopen` will reopen this PR if it is closed
- `@ dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@ dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency
- `@ dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@ dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@ dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

</details>

Authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
Bumps [xml2js](https://github.com/Leonidas-from-XIV/node-xml2js) from 0.6.0 to 0.6.2.
<details>
<summary>Commits</summary>
<ul>
<li><a href="https://github.com/Leonidas-from-XIV/node-xml2js/commit/cf3e061e22e98152b88068c2345bc02581f4d6c7"><code>cf3e061</code></a> New release, 0.6.2</li>
<li><a href="https://github.com/Leonidas-from-XIV/node-xml2js/commit/cb2f77e25c1999fdce952e127d9bed6d87786bb8"><code>cb2f77e</code></a> Fix read-only constraint via mistyped key name</li>
<li><a href="https://github.com/Leonidas-from-XIV/node-xml2js/commit/8e9a1209235406fe10cf96f4d458ce46c94bf412"><code>8e9a120</code></a> Update version number for release 0.6.1</li>
<li><a href="https://github.com/Leonidas-from-XIV/node-xml2js/commit/30f9d61d6fcf42a4361539a81037a3b5bbf2373c"><code>30f9d61</code></a> Replace filtering of names with <code>defineProperty</code></li>
<li><a href="https://github.com/Leonidas-from-XIV/node-xml2js/commit/ba46e543a494eb72eabc8161db135467c4f5394f"><code>ba46e54</code></a> Update package lock</li>
<li>See full diff in <a href="https://github.com/Leonidas-from-XIV/node-xml2js/compare/0.6.0...0.6.2">compare view</a></li>
</ul>
</details>
<br />

[![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=xml2js&package-manager=npm_and_yarn&previous-version=0.6.0&new-version=0.6.2)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@ dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@ dependabot rebase` will rebase this PR
- `@ dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@ dependabot merge` will merge this PR after your CI passes on it
- `@ dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@ dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@ dependabot reopen` will reopen this PR if it is closed
- `@ dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@ dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency
- `@ dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@ dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@ dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

</details>

Authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
…not provided (apache#37083)

### Are these changes tested?

Yes 

### Are there any user-facing changes?

Provided token authentication will now take precedence over username/password.
* Closes: apache#37073

Authored-by: Diego Fernandez <aiguo.fernandez@gmail.com>
Signed-off-by: David Li <li.davidm96@gmail.com>
…ons (apache#36906)

### Rationale for this change

Dense unions are already supported in Take, Filter and DropNull but sparse ones are not.

### What changes are included in this PR?

Add kernels for sparse unions to those functions.

### Are these changes tested?

Yes.

### Are there any user-facing changes?

No. 

* Closes: apache#36905

Lead-authored-by: Jin Shang <shangjin1997@gmail.com>
Co-authored-by: Antoine Pitrou <antoine@python.org>
Signed-off-by: Antoine Pitrou <antoine@python.org>
…tion. (apache#36966)

### Rationale for this change

file: light_array.h

The length of the buffers array is 3 (kMaxBuffers).

- buffers_[kValidityBuffer]
- buffers_[kFixedLengthBuffer]
- buffers_[kVariableLengthBuffer]

So when we do the check, the asserted index should be less than 3, not equal to.

In addition, fix the comment line break format problem.

### What changes are included in this PR?

- KeyColumnArray

data and mutable_data ARROW_DCHECK.

- ResizableArrayData class 

Comment line break formatting for mutable_data functions

### Are these changes tested?

no, just change assert bound.

### Are there any user-facing changes?

no
* Closes: apache#36949

Authored-by: light-city <455954986@qq.com>
Signed-off-by: Antoine Pitrou <antoine@python.org>
…called with mismatched column lengths (apache#36654)

### Rationale for this change

If a `RecordBatch` is created with column lengths that don't match the provided `num_rows` (technically invalid), then there are some circumstances where `ToStructArray` will successfully return an array whose length doesn't match `num_rows`. Instead, we should return an error.

### What changes are included in this PR?

* Add a small validation check to `ToStructArray` before constructing the output array
* Add a test

### Are these changes tested?

Yes (tests are included)

### Are there any user-facing changes?

No

* Closes: apache#35450

Authored-by: benibus <bpharks@gmx.com>
Signed-off-by: Antoine Pitrou <antoine@python.org>
…pache#37109)

### Rationale for this change

The valid range of 8 and 16 bit integers is too small, which causes failures on `round` benchmarks.

### What changes are included in this PR?

`Round` benchmarks for <32 bit integers are removed. Arithmetic on small int widths is probably uncommon.

### Are these changes tested?

The benchmark is now running successfully on my machine.

### Are there any user-facing changes?

No.

* Closes: apache#37106

Authored-by: Jin Shang <shangjin1997@gmail.com>
Signed-off-by: Antoine Pitrou <antoine@python.org>
@Tom-Newton
Copy link
Owner Author

Tom-Newton commented Oct 14, 2023

This has been merged upstream

@Tom-Newton Tom-Newton closed this Oct 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment