Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARROW-1760: [Java] Add Apache Mnemonic (incubating) as alternative backed allocator #36

Closed
wants to merge 1,183 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1183 commits
Select commit Hold shift + click to select a range
c2fb9cb
ARROW-1356: [Website] Add new committers
kou Aug 16, 2017
b78e2ef
ARROW-1353: [Website] Update website for 0.6.0 release and add short …
wesm Aug 16, 2017
4471dc9
[C++] DOC: Fix a typo in plasma.md
Aug 16, 2017
c0fa8e0
[Python] DOC: Fix Parquet docs to use pyarrow.parquet namespace for w…
rgbkrk Aug 16, 2017
3c5290a
ARROW-1365: [Python] Remove outdated pyarrow.jemalloc_memory_pool exa…
wesm Aug 17, 2017
4ef7c89
ARROW-1355: [Java] Make Arrow buildable with jdk9
laurentgo Aug 17, 2017
c9805d6
ARROW-1373: Implement getBuffer() methods for ValueVector
siddharthteotia Aug 19, 2017
e1bad9f
[C++] Fix a typo in in plasma.md
Aug 19, 2017
652fd36
ARROW-1366: [Plasma] Define entry point for the plasma store
pcmoritz Aug 19, 2017
10f7158
ARROW-1372: [Plasma] enable HUGETLB support on Linux to improve plasm…
pcmoritz Aug 20, 2017
b50f235
ARROW-759: [Python] Serializing large class of Python objects in Apac…
pcmoritz Aug 20, 2017
de7c671
ARROW-1357: [Python] Account for chunked arrays when converting lists…
wesm Aug 20, 2017
6ad976e
ARROW-1375: [C++] Remove dependency on msvc version for Snappy build
maxhora Aug 20, 2017
4e0aa3c
ARROW-1387: [C++] Set up GPU leaf library, add unit test module for C…
wesm Aug 21, 2017
5303594
ARROW-1395: [C++/Python] Remove APIs deprecated from 0.5.0 onward
wesm Aug 22, 2017
3c70ff1
ARROW-1384: [C++] Add SerializeRecordBatch API for writing a record b…
wesm Aug 22, 2017
2c3a5f4
ARROW-1392: [C++] Add GPU IO interfaces for CUDA
wesm Aug 23, 2017
b312697
ARROW-1386: [C++] Unpin CMake version in MSVC toolchain builds
wesm Aug 24, 2017
750b77d
ARROW-786: [Format] In-memory format for 128-bit Decimals, handling o…
cpcloud Aug 24, 2017
f50f2ea
ARROW-1408: [C++] IPC public API cleanup, refactoring. Add SerializeS…
wesm Aug 25, 2017
a3607d2
ARROW-1410: Remove MAP_POPULATE flag when mmapping files in Plasma st…
robertnishihara Aug 25, 2017
ea503a5
ARROW-1379: [Java] adding maven-dependency-plugin and fixing all repo…
antonymayi Aug 26, 2017
b36aab5
ARROW-1411: [Python] Booleans in Float Columns cause Segfault
cpcloud Aug 26, 2017
26d4e3f
ARROW-1399: [C++] Add CUDA build version defines in public headers
wesm Aug 27, 2017
6cd2a17
ARROW-1419: [GLib] Suppress sign-conversion warnings
kou Aug 28, 2017
f250d46
ARROW-1416: Clarify memory layout documentation
fritzo Aug 28, 2017
32e2668
ARROW-1414: [GLib] Cast after status check
kou Aug 28, 2017
c027a03
ARROW-1412: [Plasma] Add higher level API for putting and getting Pyt…
pcmoritz Aug 28, 2017
0728148
ARROW-1364: [C++] IPC support machinery for record batch roundtrips t…
wesm Aug 28, 2017
c0beb87
ARROW-1415: [GLib] Support date32 and date64
kou Aug 29, 2017
0ced74e
ARROW-1363: [C++] Use buffer layout from dictionary index type in IPC…
wesm Aug 29, 2017
e6456b6
ARROW-1344: [C++] Do not permit writing to closed BufferOutputStream
wesm Aug 29, 2017
a009aab
ARROW-1421: [Python] Extend Python serialization API to accept non-li…
pcmoritz Aug 29, 2017
5cda693
ARROW-1402: [C++] Deprecate APIs which return std::shared_ptr<Mutable…
wesm Aug 29, 2017
254078e
ARROW-1426: [Site] Fix the title of the top page.
wagavulin Aug 29, 2017
441f965
ARROW-1418: [Python] Introduce SerializationContext to register custo…
pcmoritz Aug 29, 2017
59fb8d0
ARROW-1427: [GLib] Add arrow cpp link to readme
tetsutaroendo Aug 29, 2017
19bbf12
ARROW-1428: [C++] Append steps to clone source code to README.mb
mnc Aug 29, 2017
6af2931
ARROW-1302: C++: Set MAKE to make if not defined
xhochy Aug 29, 2017
af78293
ARROW-1429: [Python] Open common Parquet metadata file using passed f…
brechtm Aug 30, 2017
7510ae6
ARROW-837: [Python] Add public pyarrow.allocate_buffer API. Rename Fi…
wesm Aug 30, 2017
d8c651c
ARROW-1433: [C++] Simplify Array::Slice to be non-virtual
wesm Aug 30, 2017
f450025
ARROW-1381: [Python] Use FixedSizeBufferWriter in SerializedPyObject.…
wesm Aug 30, 2017
6b391f0
ARROW-1432: [C++] Build bundled jemalloc functions with private prefix
xhochy Aug 30, 2017
78c952d
ARROW-1351: Update CHANGELOG.md in 00-prepare.sh when creating releas…
wesm Aug 31, 2017
9ab0c95
ARROW-1441: [Site] Add Ruby to Flexible section
Aug 31, 2017
c6295f3
ARROW-1438: [Python] Pull serialization context through PlasmaClient …
pcmoritz Sep 1, 2017
8344f28
ARROW-1434: [Python] Support datetime64[D] numpy arrays
xhochy Sep 1, 2017
28553b4
ARROW-1443: [Java] Fixed a small bug on ArrowBuf.setBytes with unslic…
gortiz Sep 1, 2017
75d1f61
ARROW-1413: [C++] Add include-what-you-use configuration
Sep 1, 2017
4956e90
ARROW-1407: Fix bug where DictionaryEncoder can only encode vector le…
icexelloss Sep 1, 2017
848a0f7
ARROW-1444: [JAVA] fix last byte copy in BitVector splitAndTransfer
siddharthteotia Sep 2, 2017
1a8dafb
ARROW-1447: [C++] Fix many include-what-you-use warnings
wesm Sep 2, 2017
ebca1af
ARROW-1452: [C++] Make macros in arrow/util/macros.h more unique
wesm Sep 3, 2017
016c45a
ARROW-1450: [Python] Raise proper error if custom serialization handl…
pcmoritz Sep 3, 2017
08b41f9
ARROW-1238: [Java] Adding Decimal type JSON read and write support
BryanCutler Sep 3, 2017
6f2fd8d
ARROW-1449: Implement Decimal using only Int128
cpcloud Sep 3, 2017
9968d95
ARROW-1400: [Python] Adding parquet.write_to_dataset() method for wri…
wesm Sep 4, 2017
e5aeb90
ARROW-1383: [C++] Add vector append variant to primitive array builde…
wesm Sep 4, 2017
cc30512
ARROW-1390: [Python] Add more serialization tests
pcmoritz Sep 4, 2017
f391950
ARROW-1452: [C++] Restore DISALLOW_COPY_AND_ASSIGN usages removed in …
wesm Sep 4, 2017
0e0da74
ARROW-1460: [C++] Pin clang-format at LLVM 4.0
wesm Sep 4, 2017
b1e56a2
ARROW-1453: [C++/Python] Support non-contiguous Tensors in WriteTensor
pcmoritz Sep 4, 2017
ec32013
ARROW-1417: [Python] Allow more generic filesystem objects to be pass…
Sep 4, 2017
338a187
ARROW-1461: [C++] Disable builds using LLVM apt repo until installati…
wesm Sep 5, 2017
ab328ec
ARROW-1401: [C++] Add ARROW_EXTRA_ERROR_CONTEXT option
wesm Sep 5, 2017
df0ca4e
ARROW-1461: [C++] Restore LLVM apt usage
wesm Sep 5, 2017
3283d2a
ARROW-1458: [Python] Document that create_parents=False is unsupporte…
wesm Sep 5, 2017
1ba19c2
ARROW-1401: [C++] Add note to readme about ARROW_EXTRA_ERROR_CONTEXT
wesm Sep 5, 2017
bea5ab0
ARROW-1442: [Website] Add note about nightly builds to /install
wesm Sep 5, 2017
2433289
ARROW-696: [C++] Support decimals in IPC and JSON reader/writer to en…
wesm Sep 5, 2017
2660dda
ARROW-1377: [Python] Add ParquetFile.scan_contents function to use fo…
wesm Sep 5, 2017
f355354
ARROW-1317: [Python] Attempt to set Hadoop CLASSPATH when using JNI
wesm Sep 5, 2017
9634f4b
ARROW-1462: [GLib] Add GArrowTime32Array and GArrowTime64Array
kou Sep 5, 2017
e9f3a12
ARROW-695: Add decimal integration test.
icexelloss Sep 6, 2017
a3514a3
ARROW-1396: [C++] Add PrettyPrint for schemas that outputs dictionaries
wesm Sep 6, 2017
5abd123
ARROW-1468: [C++] Add primitive Append variants that accept std::vect…
wesm Sep 6, 2017
54d624b
ARROW-1405: [Python] Expose LoggingMemoryPool in Python API
wesm Sep 6, 2017
3d285c6
ARROW-1451: [C++] Add public API file for IO section in arrow/io/api.h
wesm Sep 6, 2017
d9f895e
ARROW-1446: [Python] Add (very slow) large memory unit test for int32…
wesm Sep 6, 2017
3033eac
ARROW-1466: [C++] Implement PrettyPrint for DecimalArray
wesm Sep 6, 2017
6e5f7be
ARROW-1435: [Python] Properly handle time zone metadata in Parquet ro…
wesm Sep 7, 2017
a9a80fe
ARROW-941: Add "cold start" instructions for running integration tests
wesm Sep 7, 2017
b0b125f
ARROW-229: [C++] Implement cast functions for numeric types, booleans
wesm Sep 7, 2017
3f2fa03
ARROW-1430: [Python] Python CI build outside of a bash function scope…
wesm Sep 7, 2017
b698227
ARROW-622 [Python] deprecate timestamps_to_ms in .from_pandas()
jreback Sep 7, 2017
6f27a64
ARROW-1467: [JAVA] Fix reset() and allocateNew() in Nullable Value Ve…
siddharthteotia Sep 8, 2017
fe45c2b
ARROW-1490: [Java] Allow failures for JDK9 for now
wesm Sep 8, 2017
de2edc8
ARROW-1156: [C++/Python] Expand casting API, add UnaryKernel callable…
wesm Sep 8, 2017
11ebe93
ARROW-1494: [C++] Improve doxygen comments in arrow/table.h, note tha…
wesm Sep 8, 2017
5aca7b6
ARROW-1480: [Python] Improve performance of serializing sets
pcmoritz Sep 8, 2017
8911a34
ARROW-1493: [C++] Flush stream in PrettyPrint functions
wesm Sep 8, 2017
0c8853f
ARROW-1479: [JS] Expand JavaScript implementation
trxcllnt Sep 8, 2017
8b70ab0
ARROW-1507: [C++] Include arrow/array.h for arrow::internal::ArrayData
kou Sep 9, 2017
875be96
ARROW-1504: [GLib] Add GArrowTimestampArray
kou Sep 9, 2017
1706aab
ARROW-1505: [GLib] Simplify arguments check
kou Sep 9, 2017
675e251
ARROW-1506: [C++] Add .pc for compute modules
kou Sep 9, 2017
b5d510f
ARROW-1358: Update sha{1, 256, 512} checksums per latest ASF release …
wesm Sep 10, 2017
947ca87
ARROW-594: [C++/Python] Write arrow::Table to stream and file writers
wesm Sep 10, 2017
4a6a6cb
ARROW-1359: [C++] Add flavor='spark' option to write_parquet that san…
wesm Sep 10, 2017
f211463
ARROW-1514: [C++] Fix a typo in document
kou Sep 10, 2017
ce623a9
ARROW-1512: [C++] Fix API change in documentation
rvernica Sep 10, 2017
c1492bf
ARROW-1510: [GLib] Support cast
kou Sep 10, 2017
0ac81b5
ARROW-1515: [GLib] Detect version directly
kou Sep 10, 2017
a534e5d
ARROW-1516: [GLib] Update document
kou Sep 10, 2017
840b687
ARROW-1517: Remove unnecessary temporary in DecimalUtil::ToString fun…
cpcloud Sep 10, 2017
a45b047
ARROW-1307: [Python] Expand IPC section to include object serializati…
wesm Sep 11, 2017
94f6247
ARROW-1508: C++: Add support for FixedSizeBinaryType in DictionaryBui…
xhochy Sep 11, 2017
7e95764
ARROW-1513: C++: Add cast from Dictionary to plain arrays
xhochy Sep 11, 2017
9ede7fb
ARROW-1527: Fix Travis CI JDK9 build
laurentgo Sep 12, 2017
b590c24
ARROW-1519: [C++] Move DecimalUtil functions to methods on the Int128…
cpcloud Sep 12, 2017
18388d6
ARROW-1331: [JAVA] include package statement
siddharthteotia Sep 12, 2017
4c008c2
ARROW-1511: [C++] Promote ArrayData, MakeArray to public API, depreca…
wesm Sep 12, 2017
6a020a1
ARROW-1459: [Python] Use list values length to advance offset when re…
wesm Sep 12, 2017
b77af1a
ARROW-1528: [GLib] Resolve recursive include dependency
kou Sep 12, 2017
3fbf760
ARROW-1530: [C++] Install arrow/util/parallel.h
wesm Sep 12, 2017
cf1ac9c
ARROW-1531: [C++] Return ToBytes by value from Decimal128
cpcloud Sep 12, 2017
576fb66
ARROW-1532: [Python] Referencing an Empty Schema causes a SegFault
cpcloud Sep 12, 2017
b671dcc
[Release] Update CHANGELOG.md for 0.7.0
wesm Sep 12, 2017
97f9029
[maven-release-plugin] prepare release apache-arrow-0.7.0
wesm Sep 12, 2017
d0b0b74
ARROW-1529: [GLib] Use Xcode 8.3 on Travis CI
kou Sep 13, 2017
96d451f
ARROW-1537: [C++] Support building with full path install_name on macOS
kou Sep 15, 2017
72ad07e
ARROW-1542: [C++] Install packages in temporary directory in MSVC bui…
wesm Sep 15, 2017
59b24ba
ARROW-559: Add release verification script for Linux
wesm Sep 15, 2017
bf73d27
ARROW-1545: Remove deprecated args of builder
rvernica Sep 17, 2017
bfe6579
ARROW-1546: [GLib] Support GLib 2.40 again
kou Sep 17, 2017
e093772
ARROW-1544: [JS] Export Vector types
trxcllnt Sep 17, 2017
b635d4c
Remove garbage ")"
kou Sep 17, 2017
63e7966
ARROW-1464: [GLib] Add "Common build problems" section into the READM…
wagavulin Sep 18, 2017
4a65fea
ARROW-1548: [GLib] Support bulk append in builder
kou Sep 18, 2017
e1d9c7f
ARROW-1550: [Python] Explicitly close owned file handles in ParquetWr…
wesm Sep 19, 2017
0d5e699
ARROW-1551: [Website] Website updates, blog post for 0.7.0
wesm Sep 19, 2017
b448f66
ARROW-1550: [Python] Followup: fix flake8 warning
wesm Sep 19, 2017
aebc412
ARROW-1551: [Website] Add 0.7.0 changelog
wesm Sep 19, 2017
2706b7f
ARROW-1533: [JAVA] realloc should consider the existing buffer capaci…
siddharthteotia Sep 19, 2017
d4685f4
ARROW-1547: [JAVA] Fix 8x memory over-allocation in BitVector
siddharthteotia Sep 19, 2017
c4f5a12
ARROW-1536:[C++] Do not transitively depend on libboost_system
Sep 20, 2017
2551050
ARROW-1554: [Python] Update Sphinx install page to note that VC14 run…
wesm Sep 20, 2017
903d03b
ARROW-1553: [JAVA] Implement setInitialCapacity for MapWriter
siddharthteotia Sep 20, 2017
9997a1a
ARROW-1557 [Python] Validate names length in Table.from_arrays
TomAugspurger Sep 20, 2017
975f32b
ARROW-1497: [Java] Fix JsonReader to initialize count correctly
icexelloss Sep 20, 2017
203fb63
ARROW-1500: [C++] Do not ignore return value from truncate in MemoryMa…
amirma Sep 21, 2017
d154c10
ARROW-1578: [C++] Run lint checks in Travis CI much earlier at before…
wesm Sep 21, 2017
c470c9c
ARROW-1591: C++: Xcode 9 is not correctly detected
xhochy Sep 21, 2017
cfcee74
ARROW-1347: [JAVA] Return consistent child field name for List Vectors
BryanCutler Sep 21, 2017
8fd73b4
ARROW-1595: [Python] Fix package dependency resolution issue causing …
wesm Sep 21, 2017
8996a4f
ARROW-1590: [JS] Flow TS Table method generics
trxcllnt Sep 22, 2017
c0a5019
ARROW-1592: [GLib] Add GArrowUIntArrayBuilder
kou Sep 22, 2017
b41a4ee
ARROW-1598: [C++] Fix diverged code comment in plasma tutorial
kenhys Sep 22, 2017
096b877
ARROW-1601: [C++] Do not read extra byte from validity bitmap, add in…
wesm Sep 25, 2017
39e487c
ARROW-1608: Support Release verification script on macOS
xhochy Sep 26, 2017
b640cc0
ARROW-1610: C++/Python: Only call python-prefix if the default PYTHON…
xhochy Sep 26, 2017
5da6b87
ARROW-1606: [Python] Copy .lib files in addition to .dll when bundlin…
wesm Sep 26, 2017
f9d1e1b
ARROW-1611: [C++] Add BitmapWriter, do not perform out of bounds read…
renesugar Sep 27, 2017
808a143
ARROW-1612:[GLib] Update readme for mac os
m-nakamura145 Sep 27, 2017
3a53f93
[Release] Update version to 0.7.1-SNAPSHOT
wesm Sep 27, 2017
fbabde5
[Release] Update CHANGELOG.md for 0.7.1
wesm Sep 27, 2017
0e21f84
[maven-release-plugin] prepare release apache-arrow-0.7.1
wesm Sep 27, 2017
686a8f7
ARROW-1607: [C++] Implement DictionaryBuilder for Decimals
cpcloud Sep 28, 2017
c358154
ARROW-1609: [Plasma] Xcode 9 compilation workaround
pcmoritz Sep 28, 2017
bdfa65e
ARROW-1620: Python: Download Boost in manylinux1 build from bintray
xhochy Sep 28, 2017
ac997fb
ARROW-1618: [JAVA] Reduce Heap Usage (Phase 1)
siddharthteotia Sep 29, 2017
545496c
ARROW-1619: [Java] Set lastSet in JsonFileReader
BryanCutler Sep 29, 2017
7045b42
ARROW-1615 Added BUILD_WARNING_LEVEL and BUILD_WARNING_FLAGS to Setup…
renesugar Sep 29, 2017
a03e093
ARROW-1600: [C++] Add Buffer constructor that wraps std::string
wesm Sep 30, 2017
ccbf644
ARROW-838: [Python] Expand pyarrow.array to handle NumPy arrays not o…
wesm Sep 30, 2017
cc3b27c
ARROW-1626 Add make targets to run the inter-procedural static analys…
renesugar Sep 30, 2017
9aa6eb5
ARROW-1624: [C++] Fix build on LLVM 4.0, remove some clang warning su…
wesm Sep 30, 2017
811e668
ARROW-1629: [C++] Add miscellaneous DCHECKs and minor changes based o…
wesm Oct 2, 2017
af167fd
[Python] Update README.md to reflect that wheels are available on all…
ofek Sep 26, 2017
c905783
ARROW-1625: [Serialization] Support OrderedDict and defaultdict seria…
pcmoritz Oct 2, 2017
82eea49
[Java] Update pom versions to 0.8.0-SNAPSHOT
wesm Oct 3, 2017
988338c
ARROW-1634: [Website] Add release page for 0.7.1, update front page
wesm Oct 3, 2017
ff39cb5
ARROW-1640: Fix HTTPS failures in cmake / libcurl caused by ca-certif…
wesm Oct 4, 2017
8ceee56
ARROW-1543: [C++] Correct C++ tutorial to use std::unique_ptr instead…
wesm Oct 4, 2017
67c6317
ARROW-950: [Website] Add Google Analytics tag to site
wesm Oct 4, 2017
592c4e8
[Website] jekyll must be run with JEKYLL_ENV=production
wesm Oct 4, 2017
87fc577
ARROW-1584: [C++/Python] Support Null type in IPC round trips, fix se…
wesm Oct 4, 2017
31d33e0
[Website] Update website with new committers
wesm Oct 4, 2017
dc129d6
ARROW-1627: New class to handle collection of BufferLedger(s) within …
Oct 5, 2017
81319d9
ARROW-1647: [Plasma] Make sure to read length header as int64_t inste…
robertnishihara Oct 5, 2017
8b5b22b
ARROW-1525: [C++] New compare functions that return boolean instead o…
amirma Oct 5, 2017
0f819fa
ARROW-1603: [C++] Add BinaryArray::GetString helper method
wesm Oct 5, 2017
7511cfd
ARROW-226: [C++] If opening an HDFS file fails and it does not exist,…
wesm Oct 5, 2017
f0873a9
ARROW-942: Support running integration tests with both Python 2.7 and…
wesm Oct 5, 2017
9805ada
ARROW-1633: [Python] Support NumPy string and unicode types in pyarro…
wesm Oct 5, 2017
ab6aa9a
ARROW-1486: [C++] Make Column, RecordBatch, and Table non-copyable
wesm Oct 5, 2017
909a6f6
ARROW-1616: [Python] Add unit test for RecordBatchWriter.write dispat…
wesm Oct 5, 2017
bd73166
ARROW-1526: [Python] Add unit test for fix in PARQUET-1100
wesm Oct 5, 2017
51905e5
ARROW-1498: Add CONTRIBUTING.md to .github special directory
wesm Oct 5, 2017
bea3495
ARROW-1539: [C++] Remove APIs deprecated as of 0.7.0 or prior releases
wesm Oct 5, 2017
eaa9538
ARROW-1649: C++: Print number of nulls in PrettyPrint for NullArray
xhochy Oct 5, 2017
3ae4355
ARROW-1653: [Plasma] Use static cast to avoid compiler warning.
robertnishihara Oct 5, 2017
f8cdafa
ARROW-1541: [C++] Fix race conditions in arrow_gpu with generated Fla…
wesm Oct 6, 2017
ac1b66d
ARROW-1540: Add NO_VALGRIND option to ADD_ARROW_TEST and disable valg…
wesm Oct 6, 2017
898f5e2
ARROW-1602: [C++] Add IsValid method to pair with IsNull
wesm Oct 6, 2017
0a4c5b1
ARROW-1226: [C++] Docs cleaning in arrow/ipc. Doxyfile fixes, move ip…
wesm Oct 6, 2017
8309556
ARROW-1556: [C++] Move verbose AssertArraysEqual function used in PAR…
wesm Oct 6, 2017
b29b065
ARROW-1641: [C++] Hide std::mutex from public headers
wesm Oct 7, 2017
eaeb5d4
ARROW-1250: [Python] Add pyarrow.types module with useful type checki…
wesm Oct 7, 2017
e31c2e3
ARROW-1585/ARROW-1586: [PYTHON] serialize_pandas roundtrip loses colu…
cpcloud Oct 7, 2017
208e798
ARROW-1594: [Python] Multithreaded conversions to Arrow in from_pandas
wesm Oct 8, 2017
33d446d
ARROW-1656: [C++] Endianness Macro is Incorrect on Windows And Mac
cpcloud Oct 8, 2017
81a0e67
ARROW-1657: [C++] Multithreaded Read Test Failing on Arch Linux
cpcloud Oct 8, 2017
a0555c0
ARROW-1535: [Python] Enable sdist tarballs to be installed
wesm Oct 9, 2017
bf2e3ab
ARROW-1593: [Python] Pass through preserve_index to RecordBatch.from_…
wesm Oct 10, 2017
166f0a8
ARROW-1635: Add release management guide
wesm Oct 10, 2017
ee78cdc
ARROW-1503: [Python] Add default serialization context, callbacks for…
wesm Oct 10, 2017
4cb3e97
ARROW-1662: Move to using Homebrew/bundle and Brewfile
stephengroat Oct 11, 2017
60cb1c3
ARROW-905 [Docs] Dockerize document generation
heimir-sverrisson Oct 12, 2017
0d1e69c
ARROW-1630: [Serialization] Support Python datetime objects
pcmoritz Oct 12, 2017
434df8a
ARROW-1488: [C++] Implement ArrayBuilder::Finish in terms of FinishIn…
wesm Oct 12, 2017
47e6ff6
ARROW-1665: [Serialization] Support more custom datatypes in the defa…
pcmoritz Oct 12, 2017
dc53321
ARROW-1648: C++: Add cast from Dictionary[NullType] to NullType
xhochy Oct 13, 2017
894f740
ARROW-1670: [Serialization] Speed up deserialization by getting rid o…
pcmoritz Oct 14, 2017
a6a97a9
ARROW-1631 [C++] Add GRPC to ThirdpartyToolchain
maxhora Oct 14, 2017
e39b479
ARROW-1667: [GLib] Support Meson
kou Oct 16, 2017
1571fb4
ARROW-1677: [Blog] Post on ray and arrow serialization
pcmoritz Oct 16, 2017
2f2a0c1
ARROW-1676: [C++] Only pad null bitmap up to a factor of 8 bytes in F…
wesm Oct 16, 2017
1926bdc
ARROW-1613: [Java] Alternative ArrowReader close to free resources bu…
BryanCutler Oct 16, 2017
8eb2b0e
ARROW-1679: [GLib] Add garrow_record_batch_reader_read_next()
kou Oct 17, 2017
a043018
ARROW-1678: [Python] Implement numpy.float16 SerDe
Licht-T Oct 17, 2017
a4813bd
ARROW-1685: [GLib] Add GArrowTableBatchReader
kou Oct 18, 2017
298e343
ARROW-1673: [Python] Add support for numpy 'bool' type
pcmoritz Oct 18, 2017
d7bf5f2
ARROW-1690: [GLib] Add garrow_array_is_valid()
kou Oct 19, 2017
a8f5185
ARROW-1666: [GLib] Enable gtk-doc on Travis CI Mac environment
wagavulin Oct 20, 2017
971e99d
ARROW-1695: [Serialization] Fix reference counting of numpy arrays cr…
pcmoritz Oct 20, 2017
deaa0cf
ARROW-1686: [Docs] rsync contents of apidocs directory into site java…
wesm Oct 21, 2017
989aba6
ARROW-1698: [JS] File reader attempts to load the same dictionary bat…
Oct 21, 2017
2ee900c
ARROW-1702: Update jemalloc in manylinux1 build
xhochy Oct 21, 2017
3549fa8
ARROW-1683: [Python] Restore TimestampType to pyarrow namespace
wesm Oct 21, 2017
9d12c7c
ARROW-1697: [GitHub] Add ISSUE_TEMPLATE.md
wesm Oct 21, 2017
05788d0
ARROW-1701: [Serialization] Support zero copy PyTorch Tensor serializ…
pcmoritz Oct 21, 2017
fbeaeea
ARROW-1704: [GLib] Fix Go example failure
kou Oct 22, 2017
9ee5508
ARROW-1522: [Python] Zero copy buffer deserialization
pcmoritz Oct 22, 2017
61d8a76
ARROW-641: [C++] Do not build io-hdfs-test if ARROW_HDFS is off
wesm Oct 22, 2017
53dd0c8
ARROW-1087: [Python] Add pyarrow.get_include function. Bundle include…
wesm Oct 23, 2017
f40618d
ARROW-1671: [C++] Deprecate arrow::MakeArray that returns Status, ref…
wesm Oct 23, 2017
6209489
ARROW-1708: [JS] Fix linter error
xhochy Oct 23, 2017
8eb2a1b
ARROW-1707: Update dev README after movement to GitBox
xhochy Oct 23, 2017
4eb38a2
ARROW-571: [Python] Add unit test for incremental Parquet file buildi…
wesm Oct 23, 2017
2b77b7c
ARROW-507: [C++] Complete ListArray::FromArrays implementation, add u…
wesm Oct 23, 2017
8e00ee9
ARROW-1114: [C++] Add simple RecordBatchBuilder class
wesm Oct 23, 2017
935a3cf
ARROW-1654: [Python] Implement pickling for DataType, Field, Schema
wesm Oct 23, 2017
e876e17
ARROW-1720: [Python] Implement bounds check in chunk getter
Licht-T Oct 24, 2017
b08f7e3
ARROW-1711: [Python] Fix flake8 calls to lint the right directories
wesm Oct 24, 2017
ecb7605
ARROW-1134: [C++] Support for C++/CLI compilation, add NULLPTR define…
wesm Oct 25, 2017
b2596f6
ARROW-1588: [C++/Format] Harden Decimal Format
cpcloud Oct 25, 2017
8148b6d
ARROW-1726: [GLib] Add setup description to verify C GLib build
kou Oct 25, 2017
c03c4d2
added Mnemonic infra. as an alternative backed allocation mechanism, …
Mar 21, 2016
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -29,3 +29,4 @@ cpp/.idea/
python/.eggs/
.vscode
.idea/

2 changes: 2 additions & 0 deletions java/.gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -20,4 +20,6 @@ CMakeFiles
Makefile
cmake_install.cmake
install_manifest.txt
*.dat
?/

4 changes: 4 additions & 0 deletions java/memory/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -40,6 +40,10 @@
<groupId>org.slf4j</groupId>
<artifactId>slf4j-api</artifactId>
</dependency>
<dependency>
<groupId>org.apache.mnemonic</groupId>
<artifactId>mnemonic-core</artifactId>
</dependency>
</dependencies>

<build>
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,72 @@
/*
* Copyright 2012 The Netty Project
*
* The Netty Project licenses this file to you under the Apache License,
* version 2.0 (the "License"); you may not use this file except in compliance
* with the License. You may obtain a copy of the License at:
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
* WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
* License for the specific language governing permissions and limitations
* under the License.
*/
package io.netty.buffer;

import io.netty.util.internal.PlatformDependent;

import org.apache.mnemonic.CommonAllocator;

/**
* Simplistic {@link ByteBufAllocator} implementation that does not pool anything.
*/
public final class MnemonicUnpooledByteBufAllocator<A extends CommonAllocator<A>> extends AbstractByteBufAllocator {

private A mcalloc;

/**
* Default instance
*/
// public static final UnpooledByteBufAllocator DEFAULT =
// new UnpooledByteBufAllocator(PlatformDependent.directBufferPreferred());

/**
* Create a new instance
*
* @param preferDirect {@code true} if {@link #buffer(int)} should try to allocate a direct buffer rather than
* a heap buffer
*/
public MnemonicUnpooledByteBufAllocator(boolean preferDirect, A mcallocator) {
super(preferDirect);
this.mcalloc = mcallocator;
}

public A getAllocator() {
return this.mcalloc;
}

@Override
protected ByteBuf newHeapBuffer(int initialCapacity, int maxCapacity) {
return new UnpooledHeapByteBuf(this, initialCapacity, maxCapacity);
}

@Override
protected ByteBuf newDirectBuffer(int initialCapacity, int maxCapacity) {
assert null != this.mcalloc;
ByteBuf buf;
if (PlatformDependent.hasUnsafe()) {
buf = new MnemonicUnpooledUnsafeDirectByteBuf<A>(this, initialCapacity, maxCapacity);
} else {
buf = new MnemonicUnpooledDirectByteBuf<A>(this, initialCapacity, maxCapacity);
}

return toLeakAwareBuffer(buf);
}

@Override
public boolean isDirectBufferPooled() {
return false;
}
}
Loading