Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

XML compression #27022

Merged
merged 42 commits into from
Apr 21, 2020
Merged
Changes from 1 commit
Commits
Show all changes
42 commits
Select commit Hold shift + click to select a range
adbdc3a
XML compression
satyaakam Apr 1, 2020
1851c6d
Changes made as per the suggestions in PR 27022
satyaakam Apr 3, 2020
6ff7e25
Resolving conflits
satyaakam Apr 3, 2020
55fd72e
merged master into compress-xml
satyaakam Apr 3, 2020
787604b
Merge branch 'master' of https://github.com/dimagi/commcare-hq into c…
satyaakam Apr 10, 2020
c843658
Changes to the compress xml as review
satyaakam Apr 10, 2020
ed006c5
Merge branch 'master' of https://github.com/dimagi/commcare-hq into c…
satyaakam Apr 10, 2020
071b011
Fixing fucntion call
satyaakam Apr 10, 2020
5511232
Missing steps to make Bower work as normal user
satyaakam Apr 14, 2020
233f255
Merge branch 'master' of https://github.com/dimagi/commcare-hq
satyaakam Apr 15, 2020
8f63335
Updated Tests and custom exceptions added
satyaakam Apr 15, 2020
1ea2d13
Merge branch 'master' into compress-xml
satyaakam Apr 15, 2020
7a43156
Fixed Lint issues
satyaakam Apr 15, 2020
b8a190b
simplify validate_args
snopoke Apr 16, 2020
acb621f
nits
snopoke Apr 16, 2020
7756fad
add missing type_code kwargs
snopoke Apr 16, 2020
2f569c3
remove unused imports
snopoke Apr 16, 2020
027d73c
Merge branch 'master' into compress-xml
snopoke Apr 16, 2020
e0d7c55
handle exception
snopoke Apr 16, 2020
95d2da0
more type_code args + test fixes
snopoke Apr 16, 2020
52c51c9
make meta.content_length = uncompressed size
snopoke Apr 16, 2020
1e0a50d
uncompressed content_length when copying a blob
snopoke Apr 16, 2020
557264f
test with compression
snopoke Apr 16, 2020
1853cbc
store compressed length and always return a BlobStream instance
snopoke Apr 17, 2020
b13480f
simplify `blobmeta.open()`
snopoke Apr 17, 2020
5f6e847
reusue util to get sizes
snopoke Apr 17, 2020
a4a90a8
minor simplication
snopoke Apr 17, 2020
f4bc531
prefer using meta for lookup if it's available
snopoke Apr 17, 2020
77ed3e5
better test
snopoke Apr 17, 2020
820f81d
Update corehq/blobs/interface.py
snopoke Apr 17, 2020
70a4090
merging upstream changes
satyaakam Apr 20, 2020
48c9e0e
Merging upstream changes
satyaakam Apr 20, 2020
aa7348f
fix argument order
snopoke Apr 17, 2020
6d2f0c0
remove GzipCompressReadStream.Buffer.content_length
snopoke Apr 20, 2020
6f6466f
Merge branch 'master' into compress-xml
snopoke Apr 20, 2020
468bdb1
GzipCompressReadStream -> GzipStream
millerdev Apr 20, 2020
d83f529
GzipStreamAttrAccessBeforeRead -> GzipStreamError
millerdev Apr 20, 2020
4e6677f
Move IO buffer out of GzipStream class
millerdev Apr 20, 2020
3b3c00f
Fix bugs in GzipStream
millerdev Apr 20, 2020
470f2ca
Merge pull request #1 from dimagi/dm/compress-xml
snopoke Apr 21, 2020
7c5d4bf
save to file before extracting in test
snopoke Apr 21, 2020
05cadf1
fallback to partial read if seek not supported
snopoke Apr 21, 2020
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion corehq/blobs/mixin.py
Original file line number Diff line number Diff line change
Expand Up @@ -195,7 +195,7 @@ def fetch_attachment(self, name, stream=False):
type_code = meta_ref.type_code
if type_code is None:
type_code = self._blobdb_type_code
meta = MetaDB.get(parent_id=self._id, type_code=type_code, name=name, key=meta_ref.key)
meta = MetaDB().get(parent_id=self._id, key=meta_ref.key)
snopoke marked this conversation as resolved.
Show resolved Hide resolved
blob = db.get(meta=meta)
except NotFound:
raise ResourceNotFound(
Expand Down