-
-
Notifications
You must be signed in to change notification settings - Fork 2.5k
/
NEWS
11207 lines (9300 loc) · 576 KB
/
NEWS
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
= GDAL/OGR 3.0.1 Release Notes =
The 3.0.1 release is a bug fix release.
== Build ==
* configure: fix detection of libpq in a non-standard place (3.0 regression) (#1542)
* Fix MSVC linking issue related to TransformWithOptionsCache class (#1639)
== Port ==
* /vsitar/: support >100 character file names (#1559)
* /vsicurl/: fix CPL_VSIL_CURL_ALLOWED_EXTENSIONS with query string (#1614)
* /vsicurl/: allow 'Connection timed out' CURL errors as candidate for HTTP retry
* /vsicurl/: GetFileSize(): when HEAD request does not return Content-Length header, retry with GET
* /vsis3/: for a long living file handle, refresh credentials coming from EC2/AIM (#1593)
== GDAL algorithms ==
* GDALReprojectImage(): properly take into account source/target alpha bands
* GDALCreateReprojectionTransformerEx(): do not emit error if reverse transformation fails, and fix crash when trying to use null reverse transformation
* Warper: fix GDAL 2.3 regression in a situation with source nodata value, multiple bands and nearest resampling where the logic to detect which source pixels are nodata was inverted (#1656)
* Contour generator: fix SegmentMerger list iterator skipping and out of bounds error. (#1670)
== GDAL core ==
* GDALInvGeoTransform(): make it work with scale and rotation/skew coefficients of small absolute value (#1615)
* GDALCopyWholeRasterGetSwathSize(): fix potential int overflows for big values of GDAL_SWATH_SIZE or GDAL_CACHEMAX
== GDAL utliities ==
* gdal_translate: Make 'gdal_translate foo.tif foo.tif.ovr -outsize 50% 50% -of GTiff' work
* gdalwarp: fix wrong axis order when using source/target CRS being a geographic3D CRS such as EPSG:4979, and with vertical shift grid application (#1561, 3.0 regression)
* gdal_calc.py: Fixed NaN-streaking in output images when the --allBands option is given to tiled images, and removed redundant calculation of nXValid.
* gdal_polygonize.py: fix outputing to geojson without explicit -f switch (#1533)
* gdallocationinfo: emit verbose error when dataset canot be opened (#1684)
== GDAL drivers ==
ENVI driver:
* fix potential use of invalid pointer on some unusual std::string implementations (#1527)
* add read support for reading GCPs (#1528), and fix off-by-one offset on line,pixel on reading GCP
GTiff driver:
* make WEBP_LEVEL to be honored in Create() mode (#1594)
* reset m_bGeoTIFFInfoChanged flag in FlushDirectory()
* PushMetadataToPam(): early exit when PAM is disabled, to avoid error messages
GXF driver:
* avoid closing the file pointer before being sure this is a GXF driver, otherwise this can prevent the opening of some raw format files (#1521)
HDF5 driver:
* Make GH5_FetchAttribute(CPLString) more robust and able to cope with variable-length string
ISIS3 driver:
* fix parsing of lists in JSon metadata, and quote string items when writing lists when needed (#1510)
KEA driver:
* return error when deleting metadata item rather than crashing (#1681)
NITF driver:
* fix parsing of SENSRB TRE (#1520)
RS2 driver:
* add half-pixel shift to reported GCP line and column numbers (#1666)
TileDB driver:
* removed ambiguous use of size_t
* TILEDB_LIBS added for windows build
VRT driver:
* Python pixel functions: also probe libpython3.Xm.so.1.0 (#1660)
== OGRSpatialReference ==
* EPSG:4326 to EPSG:3857: fix invalid output with some input coordinates (3.0 regression)
* GetAxis(): make it work with a compound CRS (#1604)
* importFromWkt(): emit a CPLError() in case of import failure (refs #1623)
== OGR drivers ==
EEDA driver:
* fix startTime / endTime comparisons that were incomplete in #1506
GeoJSON driver:
* fix recognizing some documents with members sorted alphabetically (#1537)
* avoid SetFeature() to repeat first feature when looping over features (#1687)
ElasticSearch driver:
* set 'application/json' in RunRequest() with POST (#1628)
* GeoJSON type field should be mapped as text in ES>=5
GPKG driver:
* change default value of OGR_GPKG_FOREIGN_KEY_CHECK to NO, so as to avoid issues in downstream software
* insert more accurate spatial extent in gpkg_contents
* fix memory leak in case of corrupted database. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=14683.
KML driver:
* set OAMS_TRADITIONAL_GIS_ORDER for SRS returned on returned layers
MapInfo driver:
* TAB: don't left truncate numeric values in the .dat when the field formatting is incompatible, but error out (#1636)
MSSQLSpatial driver:
* Fix handling empty geometries (#1674)
* Fix handling mixed geometries (#1678)
MVT driver:
* make CONF option accept a filename as well
PostgreSQL driver:
* do not attempt to create VARCHAR(n) columns with n >= 10485760 (#1508)
Shapefile driver:
* better deal with empty .shp+.shx and SHAPE_RESTORE_SHX (#1525)
* fix crash when creating a layer with a wkbNone geometry type but a SRS (3.0 regression)
* launder layer name to get Windows compatible filename
WaSP driver:
* on creation, make sure the layer geometry type set on the feature definition is wkbLineString25D
== SWIG bindings ==
* add osr.SetPROJSearchPath(path) that can be used since setting PROJ_LIB from C# does no work (#1647)
== Python bindings ==
* honour gdal.UseExceptions() in numpy related methods (gdalnumeric module) (#1515)
= GDAL/OGR 3.0.0 Release Notes =
== In a nutshell... ==
* Implement RFC 73: Integration of PROJ6 for WKT2, late binding capabilities, time-support and unified CRS database. PROJ >= 6 is now a build requirement
https://trac.osgeo.org/gdal/wiki/rfc73_proj6_wkt2_srsbarn
* New GDAL drivers:
- DAAS: read driver for Airbus DS Intelligence Data As A Service
- TileDB: read/write driver for https://www.tiledb.io (#1402)
* New OGR drivers:
- MongoDBv3: read/write driver using libmongocxx v3.4.0 client (for MongoDB >= 4.0)
* Improved drivers:
- FITS: read/write support for scale, offset and CRS
- netCDF: read support for groups
- PDF: add a COMPOSITION_FILE creation option to generate a complex document
- PDS4: subdataset creation support, read/write table/vector support
* Support for minimal builds on Unix (#1250)
* Add a docker/ directory with Dockerfile for different configurations
* Continued code linting
== New installed files ==
* Resource file: pdfcomposition.xsd
== Removed installed files ==
* Removal of resource files related to EPSG and ESRI CRS databases: compdcs.csv, coordinate_axis.csv, datum_shift.csv, ellipsoid.csv, esri_epsg.wkt, esri_extra.wkt, esri_Wisconsin_extra.wkt, gcs.csv, gcs.override.csv, gdal_datum.csv, geoccs.csv, pcs.csv, pcs.override.csv, prime_meridian.csv, projop_wparm.csv, unit_of_measure.csv, vertcs.csv, vertcs.override.csv
== Backward compatibility issues ==
See MIGRATION_GUIDE.txt
== GDAL/OGR 3.0.0 - General Changes ==
Build(Unix):
* Allow internal drivers to be disabled (#1250)
* Fix build with OpenBSD which doesn't support RLIMIT_AS (#1163)
* Fix MacOS build failures due to json-c
* Poppler: require pkg-config
* PostgreSQL: Switch from pg_config to pkg-config (#1418)
* fix build --without-lerc (#1224)
* fix netcdf_mem.h detection in netcdf 4.6.2 (#1328)
* Fix build --with-curl --without-threads (#1386)
Build(Windows):
* nmake.opt: remove unicode character at line starting with '# 4275' that apparently cause build issues with some MSVC versions (#1169)
All:
* PROJ >= 6.0 is a required external dependency
* libgeotiff >= 1.5 should be used for builds with external libgeotiff
* Poppler: drop support for Poppler older than 0.23.0
* Poppler: add support for 0.72.0, 0.73.0, 0.75.0, 0.76.0
== GDAL 3.0.0 - Overview of Changes ==
Port:
* Add capability to define external VSI virtual file systems from C API (#1289)
* MiniXML: Fix wrong node order when calling CPLAddXMLAttributeAndValue() after CPLCreateXMLElementAndValue()
* /vsicurl/: ReadMultiRange(): use default implementation if there is a single range (#1206)
* /vsicurl/: ignore proxy CONNECT response headers (#1211)
* /vsicurl/: automatically detect signed URLs where host ends with a port number; also detect signed URLs as created with the AWS4-HMAC-SHA256 method (#1456)
* /vsizip/: Add config option to create zip64 extra fields by default (#1267)
* /vsis3/, /vsigs/, /vsiaz/: add HTTP retry logic in writing code paths
* Fix data race in VSIFileManager::Get
* cpl_zipOpenNewFileInZip3: fix memory leak in error code path. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=13103.
* VSIGZipWriteHandleMT: avoid potential deadlock in case of error
* Fix assertion in CPLGetValueType when testing non-ASCII chars
* /vsihdfs/: fix Read() when more than one hdfsRead call is needed (#1349)
* Fix potential buffer overflow in CPLODBCSession::Failed (#1390)
* /vsitar/: handle .tar file header with space padding instead of 0 for file size (#1396)
Core:
* Support blocks larger than 2 billion pixels/bytes
* Make CPLHaveRuntimeSSSE3() and CPLHaveRuntimeAVX() use GCC constructor functions
* Move RawDataset base class to gcore/ (#1268)
* RasterBand/Dataset::RasterIO(): enforce access mode on write
* PAM: preserve existing metadata when setting new one (#1430)
* RawDataset: use generic RasterIO() implementation when non-nearest resampling is asked (#1301)
* DumpJPK2CodeStream(): dump PLT and POC markers
Algorithms:
* RPC transformer: test success code of GDALRPCTransform() in GDALCreateRPCTransformer()
* RPC transformer: add a RPC_FOOTPRINT transformer option to provide a polygon in long/lat space where the RPC is valid, and also make gdalwarp use GDALSuggestedWarpOutput2() to restrict the bounding box of the output dataset
* GDALFillNodata(): fix wrong comparison in QUAD_CHECK() macro: nNoDataVal is only assigned to target_y values (#1228)
* GDALFillNodata(): reinitialize panLastY array to nNoDataVal before bottom to top pass (#1228)
* GDALFillNodata(): do an extra iteration to reach the maximum search distance in all quadrants (#1228)
* GDALRasterizeLayersBuf():support any GDAL data type for buffer,and pixel and line spaceing arguments
* GDALResampleChunk32R_Mode: performance improvement
* Rasterize with MERGE_ALG=ADD: avoid burning several times intermediate points of linestrings (#1307)
* rasterize: fix crash when working buffer is larger than 2GB (#1338)
Utilities:
* gdal_translate: add "-nogcp" option (#1469)
* gdal_contour: remove explicit width/precision=12/3 of the elev field (#1487)
* gdaldem hillshade: add -igor option (#1330)
* gdalwarp -crop_to_cutline: do not round computed target extent to be aligned on the grid of the source raster if -tr is set (restore partially pre 2.4 behaviour) (#1173)
* gdalwarp: assume -tap when using -crop_to_cutline, -tr and -wo CUTLINE_ALL_TOUCHED=TRUE, so as to avoid issues with polygons smaller than 1x1 pixels (#1360)
* gdal2tiles: give local tile layer and basemap layers same min/max zoom levels as generated tile cache
* gdal2tiles: fix breakage of openlayers.html getURL() javascript function, introduced in GDAL 2.3.3 / 2.4.0 (#1127)
* gdal2tiles: prevent accidental copy of full GeoTIFF into temporary .vrt file
gdal2tiles: Refactor and fix multiprocessing completion handling
* gdal_fillnodata.py: preserve color interpretation and table
* gdal_fillnodata.py: do not set geotransform if source doesn't have one
* gdalsrsinfo: do not silence errors when calling SetFromUserInput()
* gdal_retile: Use nodata value from origin dataset
* gdal_edit.py: allow setting band-specific scale and offset values (#1444)
* validate_cloud_optimized_geotiff.py: check if file is only greater than 512px (#1403)
* validate_cloud_optimized_geotiff.py: report headers size
Multidriver fixes:
* GTiff, GPKG, MBTiles, PostgisRaster drivers: ensure that main dataset and overviews share the same lock, so as to avoid crashing concurrent access (#1488)
ADRG driver:
* modified to ensure that there is no confliction between ADRG and SRP when opening a .gen file (#953)
AIGRID / AVCBin:
* fix filename case adjustment that failed on /vsi filesystems (#1385)
BAG driver:
* fix potential nullptr deref on corrupted file
COSAR driver:
* avoid out-of-bound write on corrupted dataset. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=12360.
EEDA driver:
* switch to v1alpha API (#1506)
GPKG driver:
* allow negative srs_id values in gpkg_spatial_ref_sys
* reduce memory requirements for cached tiles
GTiff diver:
* supports tiles/strips larger than 2GB
* add APPEND_SUBDATASET=YES capability to create subdataset / new TIFF page to an existing file
* only report scale/offset deduced from ModelTiepointTag and ModelPixelScaleTag if the SRS has a vertical component (and thus currently if GTIFF_REPORT_COMPD_CS is set) (https://issues.qgis.org/issues/20493)
* TIFF Lerc: properly initialize state after Create() so that BuildOverviews() succeed (#1257)
* emit merged consecutive multi-range reads (#1297)
* add warnings when using unsupported combination of internal mask+external overview, and fix COPY_SRC_OVERVIEWS=YES so that it does not copy ALL_VALID masks (#1455)
* do not generate a TIFFTAG_GDAL_METADATA with color interpretation information for JPEG YCbCr compression
* Internal libtiff and libgeotiff: resync with upstream
FITS driver:
* new functions for Scale Offset and FITS World Coordinate System read and write (#1298)
GeoRaster driver:
* Fix memory leaks
HDF5 driver:
* support reading blocks larger than 2GB
* fix handling of attributes of type SCHAR, UCHAR, USHORT and UINT (https://github.com/mapbox/rasterio/issues/1663)
* detect nodata from netCDF _FillValue (#1451)
* add more strict checks for accepting datasets for GCP, and handle nodata in GCP too (#1451)
IGNFHeightAsciiGrid driver:
* add support for RAF18.mnt
JPEG driver:
* fix GDAL 2.3.0 performance regression when decoding JPEG (or GPKG using JPEG) images (#1324)
KEA driver:
* add support for /vsi file systems
KMLSuperOverlay driver:
* report color table of single overlay datasets, and also handle some variation in the KML structure (https://issues.qgis.org/issues/20173)
MRF driver:
* sparse index and internal resampling fixes
* fix integer overflow. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=13974
MrSID driver:
* fix potential crash when a zoom level cannot be opened
netCDF driver:
* implement support for NetCDF-4 groups on reading (#1180)
* support complex data types (#1218)
* fix crash when opening a dataset with an attribute of length 0 (#1303)
* fix IWriteBlock() to support non-scanline blocks, and use the chunk size
* better deal with datasets indexed with unusual order for x/y dimensions
* avoid inappropriate shift by -360 when attribute axis=X is set (#1440)
NGW driver:
* Add CreateCopy function
NITF driver:
* avoid harmless floating point division by zero. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=12844.
PCIDSK driver:
* avoid uint overflow and too big memory allocation attempt. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=12893
PDF driver:
* Add a COMPOSITION_FILE creation option to generate a complex document
* And a gdal_create_pdf.py sample script
* Fix selection of Poppler PDF layers with duplicate names (#1477)
* avoid division by zero when generating from vector content whose bounding box is almost a horizontal or vertical line. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=13408
PDS3:
* fix decoding of band interleaved images (such as for CRISM HSP) (#1239)
* add support for ENCODING_TYPE=DCT_DECOMPRESSED (#1457)
PDS4 driver:
* add subdataset creation support, and getting/setting the band unit
* update template and code to PDS v1B00 schema versions
VRT driver:
* Python pixel functions: add shared object name for python 3.7
* VRT: in case of no SourceProperties, do not use global shared datasets, but only shared to the owning VRTDataset, to avoid potential reference cycles and annoying related issues. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=13476.
WCS driver:
* avoid potential out-of-bound access
WMS driver:
* use proper JSon parsing for ESRI MapServer document (#1416)
* Add url parameters escaping to ArcGIS Server minidriver
* avoid warning when a wms cache doesn't exist
XPM driver:
* fix read heap buffer overflow on corrupted image. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=13455.
XYZ driver:
* add creation options DECIMAL_PRECISION and SIGNIFICANT_DIGITS like with AAIGrid
* fix regression regarding header lines that are not X,Y,Z (#1472)
== OGR 3.0.0 - Overview of Changes ==
Core:
* Add OGR_G_MakeValid() (requires GEOS 3.8)
* change prototye of OGRFeature::SetField( int iField, int nBytes, GByte *pabyData ) to ( ... , const void* pabyData), and same for OGR_F_SetFieldBinary().
* Polyhedral surface: fix importFromWKT to properly fix Z/M flag
* OGRBuildPolygonFromLines: avoid generating effectively duplicate points
* OGRBuildPolygonFromEdges(): improve performance. https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=13798
* OGRGeometryFactory::transformWithOptions(): if WRAPDATELINE=YES, test that the geometry SRS is geographic
* OGRGeometryFactory::GetCurveParmeters(): fix assertion when coordinates are very near 0
* Expat XML parsing: add OGR_EXPAT_UNLIMITED_MEM_ALLOC=YES config option to workaround failure for very specific cases
* OGRLineString::segmentize(): fix issues when segment length is divisible by maxlength (#1341)
* OGR SQL: limit recursion in swq_expr_node::Check(). Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=13540
* OGRGeometry / SFCGAL: fix dead code, memory leaks and potential nullptr deref.
OGRSpatialReference:
* Deep rework due to RFC 73 integration
* SRS_WKT_WGS84 macro replaced by SRS_WKT_WGS84_LAT_LONG
* Add OSRSetPROJSearchPaths(), OSRExportToWktEx(), OSRGetName(), OSRIsSameEx(), OSRGetCRSInfoListFromDatabase(), OSRGetAreaOfUse(),OSRGetAxisMappingStrategy(), OSRSetAxisMappingStrategy(), OSRGetDataAxisToSRSAxisMapping()
* Add OCTNewCoordinateTransformationOptions(), OCTCoordinateTransformationOptionsSetOperation(), OCTCoordinateTransformationOptionsSetAreaOfInterest(), OCTDestroyCoordinateTransformationOptions(), OCTNewCoordinateTransformationEx(), OCTTransform4D()
* Remove OSRFixupOrdering(), OSRFixup(), OSRStripCTParms(), OCTProj4Normalize(), OCTCleanupProjMutex(), OPTGetProjectionMethods(), OPTGetParameterList(), OPTGetParameterInfo()
Utilities:
* ogrinfo: report TITLE metadata in summary layer listing
* ogr2ogr: for drivers supporting ODsCCreateGeomFieldAfterCreateLayer, do not create geometry column if -nlt none
* ogrmerge.py: add shared='1' to speed-up -single mode with many layers
CARTO driver:
* Overwrite tables in single transactions
* Improve documentation and warnings around CARTODBFY (#1445)
CSW driver:
* fix crash when geometry parsing fails (#1248)
DODS driver:
* fixes related to memory leaks and null pointer dereferences
DXF driver:
* support RGB true color values
* fix the coloring of ByBlock entities inserted via a ByLayer INSERT
* fix double-free issue in case of writing error. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=13516.
FileGDB/OpenFileGDB drivers:
* be robust when winding order of outer ring is incorrect (#1369)
Elasticsearch driver:
* Fixed index comparison bug when a index have at least one mapping
* Fix _mapping url for Elasticsearch 7 compatibility
GeoJSON driver:
* speed-up random reading with GetFeature() by storing a map FID->(start,size) to retrieve performance similar to GDAL 2.2 or before (https://issues.qgis.org/issues/21085)
* report 3D layer geometry types (#1495)
GeoJSONSeq driver:
* be more robust to invalid objects, and fixes performance issue on corrupted files. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=13770.
GML driver:
* write SRSName element in .gfs when parsing a GML file with srsName only on top-level boundedBy element (#1210)
* Add "FeatureType" to list of suffixes recognized by XSD parser (#1313)
* GML/WFS: add minimum support for 'hexBinary' type (as string) (#1375)
GMLAS driver:
* avoid null pointer dereference on some schemas
* do not use space as separator for schema filename in XSD open option (#1452)
GMT driver:
* use file extension based detection to accept files without header (#1461)
MongoDB driver:
* fix releated to filters in GetFeature()
MITAB driver:
* Add encode/decode feature labels to/from UTF-8 encoding while MIF file read/write (#1151)
* .tab: fix deleting a feature without geometry (#1232)
* adapt dynamically default projection bounds to false_easting/false_northing values (#1316)
* avoid potential assertion or stack buffer overflow on corrupted .ind files. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=11999
* prevent potential infinite recursion on broken indexes. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=12739.
* TAB_CSLLoad(): fix performance issue. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=13588
* avoid long processing on corrupted .mif files. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=13152
MSSQLSpatial driver:
* Add support for curve geometries (#1299)
* Add option to expose the FID column as a feature attribute (#1227)
* Adding improved extent queries
* Fix extent calculation for geography type, take care of invalid geometries
NGW driver:
* Fix get children API. Add authorization support to create dataset options
* Add support for feature extensions in OGRFeature native data
* Add feature query via chunks, attribute and spatial filter support
* Add resource type and parent identifier to metadata
* Fix batch update features
* Add JSON_DEPTH open option
* Add check forbidden field names, check duplicate field names.
OCI driver:
* Add MULTI_LOAD to open options (#1233)
* Fix memory leaks
ODS driver:
* allow opening tables with empty cells with huge values of columns-repeated attribute at end of line (#1243)
* avoid potential null pointer dereference when writing to corrupted filename. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=12976.
OGDI driver:
* switch incorrect order for east/west bounds of spatial filter
PDS4 driver:
* add read/write support for tables (vector support)
PGDump driver:
* in WRITE_EWKT_GEOM=YES non-default mode, export geometries to ISO WKT so as to be able to export XYZM (#1327)
* Fix emitted SQL when UNLOGGED=ON
PLScenes driver:
* update plscenesconf.json with SkySatCollect and add missing fields for PSOrthoTile
SDTS driver:
* error out if too many errors are raised to avoid timeout in oss-fuzz. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=13819.
Selafin driver:
* avoid null pointer dereference on corrupted files. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=12356.
Shapefile driver:
* DeleteLayer(): make it delete .cpg, .sbn, .sbx, .qpj and other sidecar files (#1405)
* speed-up creation of lots of fields with name collisions. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=13065
SQLite driver:
* set sqlite3_busy_timeout, handle SQLITE_BUSY during tile read (#1370)
* close database before freeing the spatialite context. Fix crashes on dataset closing, with VirtualShape and recent spatialite versions
* Spatialite: fix update of geometry_columns_statistics when extent goes to infinity (#1438)
S57 driver:
* avoid long procession on corrupted datasets. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=13238
SXF driver:
* Fix wrong EPSG codes range (#1278)
* Fix memory leaks in SetVertCS()
VFK driver:
* fix curved geometries being ignored (#1351)
WFS3 driver:
* handle paging wth missing type for rel:next, and better deal with user:pwd in URL
* use 'id' attribute of collection items, if 'name' not available
== SWIG Language Bindings ==
All bindings:
* add Geometry::MakeValid()
Python bindings:
* fix Dataset.ReadAsRaster() on CInt16 data type (#82)
* adding overviewLevel option to WarpOptions
* add noGCP options to gdal.Translate()
= GDAL/OGR 2.4.0 Release Notes =
== In a nutshell... ==
* New GDAL drivers:
- BYN: read/write support for Natural Resources Canada's Geoid binary format
- EEDAI: read-only driver for Google Earth Engine Data API
- IGNFHeightASCIIGrid: read-only driver to read IGN-France height correction ASCII grids
- NGW: NextGIS Web read-only driver
- NTv1: read-only driver for NTv1 datum shift grids
* New OGR drivers:
- EEDA: read-only driver for Google Earth Engine Data API
- GeoJSONSeq: read/creation support of new-line or record-separator separated GeoJSON features (#378)
- NGW: NextGIS Web read-write driver
* Improved drivers:
- BAG: add read support for variable-resolution grids, and write support for single-resolution grids
- GTiff driver: add Lerc and WebP codecs
- PostgisRaster: add support for out-db rasters
- RMF
- MSSQLSpatial
* RFC 72: Make GDAL Python autotest suite use pytest framework
* Add /vsihdfs/ virtual file system handler for Hadoop File System (via libhdfs)
* Add /vsiwebhdfs/ read-write virtual file system for Web Hadoop File System REST API
* gdal_contour rewriting: speed optimizations and capability to compute polygon isosurfaces.
* Remove PHP and Ruby bindings.
* Continued code linting in C++, Python scripts, Shell scripts and autotest
== Backward compatibility issues ==
* The value of COMPRESSION_ZSTD used for ZStd-in-TIFF compression has been changed. ZStd-compressed TIFF files produced by GDAL 2.3.0 will not be readable
== GDAL/OGR 2.4.0 - General Changes ==
Build(Unix):
* configure: error out when --enable-pdf-plugin is used with --with-libtool since frmts/pdf/GNUmakefile isn't ready for that (#556)
* Fix compilation in C++17 mode with older ogdi headers
* Fix the datadir in gdal.pc.
* re-install cpl_vsi_error.h
* update GRASS drivers to support GRASS 7.4.0 (#639, #633)
* configure: use CXXFLAGS when CXX is used (#693)
* GNUmakfile: fix dependency of install target (#707)
* configure: fix 12 bit JPEG-in-TIFF support (#716)
* configure: Remove additionnal '$' in front of '${CXX}' to fix ECW5 detection
* configure: use ogdi.pc if available
* Set minimum pkg-config version to 0.21
* fix potential link errors when using internal libgif and internal libpng but headers of those libraries are available in the system in different versions than our internal ones (#938)
Build(Windows):
* nmake.opt: allow install into paths with spaces
* MBTiles driver: fix issue in Makefile
* Fix HDF4 Plugin build for Visual C++ (#624)
* NMAKE: copy gdal pdb to $(LIBDIR) in libinstall target
* NMAKE: Enable friendlier static library builds to allow an external `DLLBUILD = 0`
* nmake.opt: allow DEBUG=0 to be set (#703)
* Do not include DllMain() in static library builds
* add support for JPEGLS driver
All:
* Add support for Poppler 0.64, 0.69, 0.71
* avoid compilation error when compiling GMT's gmtdigitize.c that defines _XOPEN_SOURCE to empty (#590)
* Fix build against PDFium (#612)
* Add support for MySQL 8.0
== GDAL 2.4.0 - Overview of Changes ==
Port:
* Add multi-threaded compression to /vsigzip/ and /vsizip/
* /vsizip/: create ZIP64 when needed
* /vsizip/: encode filename in Unicode when needed also in local file header
* /vsigzip/: allow seeking to beginning of file, despite decompression error
* /vsicurl/: extend retry logic to HTTP 500 and HTTP 400 with RequestTimeout, emit a CE_Warning if code != 400 and != 404
* /vsicurl/: fix parsing of HTML file listing that got broken in GDAL 2.3.0
* /vsicurl/ and derived: implement a LRU cache for file properties (instead of ever growing cache)
* /vsicurl/ and derived: implement a LRU cache for directory content listing
* /vsicurl/: make GetCurlMultiHandleFor() more thread-safe
* HTTP: added curl cookiefile and cookiejar variables (fixes #1000)
* /vsioss/: fix support of filenames with spaces
* /vsizip/: output explicit error message when encountering a unsupported file compression method
* /vsis3/: fix VSIStatL() on a directory (#603)
* /vsis3/: take into account AWS_CONTAINER_CREDENTIALS_RELATIVE_URI for ECS instances (#673)
* /vsis3/: honour CPL_VSIL_CURL_ALLOWED_EXTENSIONS configuration option (#995)
* /vsis3/: ignores files with GLACIER storage class in directory listing, unless CPL_VSIL_CURL_IGNORE_GLACIER_STORAGE=NO
* /vsiaz/: support BlobEndpoint element in AZURE_STORAGE_CONNECTION_STRING such as found in Azurite (#957)
* Add a VSICurlPartialClearCache(const char* filenameprefix) function to partially clear the /vsicurl/ and related caches; and bind it to SWIG
* Add VSISync() to synchronize source and target files/directories
* /vsitar/: support headers with fields using star base-256 coding (#675)
* Add VSIOpenDir/VSIGetNextDirEntry/VSICloseDir and provide efficient recursive implementation for /vsis3/, /vsigs/, /vsioss/ and /vsiaz/
* Detect Amazon EC2 instances that use the newer hypervisor. Deprecates CPL_AWS_CHECK_HYPERVISOR_UUID and replaces with CPL_AWS_AUTODETECT_EC2
* CPLString class: rework visibility of exported symbols for Visual Studio (rework of #321) (#636)
* CPLGetPhysicalRAM(): take into account cgroup limitation (Docker use case), and rlimit (#640)
* CPLGetNumCPUs(): take into account cgroup limitation.
* ODBC: Improve Fetch() error handling.
* ODBC: get multiple ODBC error messages.
* ODBC: Fetch wide-char strings on UNIX (#839)
* Fix buffer overflow in GDALDefaultCSVFilename with GDAL_NO_HARDCODED_FIND (#683)
* VSIZipFilesystemHandler::Open: Fix leaks of poVirtualHandle (#699)
* Fix date-time formatting for /vsigs/, /vsiaz/ and /vsioss/ protocols with non-C locales
* CPLQuadTreeGetAdvisedMaxDepth(): avoid int overflow. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=9248
* CPLJSonStreamingParser: make it error on invalid array constructs (#970)
* Add a GDAL_HTTPS_PROXY configuration option to selectively setup proxy for https only connections (#972)
* Add template class CPLAutoClose (#952)
* Make VSIToCPLError() handle the generic VSIE_AWSError (#1007)
* Propagate error handler user data correctly (#1098)
* CPLOpenSSLCleanup(): reset callbacks to nullptr to avoid potential segfault
Core:
* SetStatistics(): write a STATISTICS_APPROXIMATE=YES metadata item if bApproxOK=true, and take it into account in GetStatistics() (trac #4857, trac #4576)
* Add percentage of valid pixels to metadata when computing raster band statistics (#698)
* Overview creation: avoid creating too many levels, and fix related heap buffer overflow (#557,#561)
* Overview: fix wrong computation of source pixel indices for AVERAGE and pixel-interleave bands
* Lanczos rasterio/overview/warp: do not compute target pixel if there are too many missing source pixels, to avoid weird visual effects depending on if valid source pixels match positive or negative kernel weights
* Overview / RasterIO resampling: do not use nodata value as a valid output value
* RawRasterBand: only accept VSILFILE*
* Add alpha mask flag for alpha band in Uint16 One band dataset (#742)
* GetMaskBand(): do not use a GDALNoDataMaskBand when nodata value is out of range (#754)
* Pleiades metadata reader: Add more strict check (#431)
* Statistics/minmax computation: on a float32 raster, be more tolerant when the nodata is slightly larger than +/- FLOAT_MAX
* GDALNoDataMaskBand: improve performance in downsampling cases
* GDALDestroy(): no longer call it automatically on GCC/CLang (non-MSVC) builds
* GDALGetJPEG2000Structure(): avoid excessive memory allocation. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8268
* Implement GDALAllValidMaskBand::ComputeStatistics(). Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=9309
* PAMDataset: avoid illegal down_cast to GDALPamRasterBand. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=9358
* GDALOpenEx(): improve anti recursion detection. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=9391
* GDALResampleChunk32R_Convolution: avoid invalid left shift. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=9477
* Gauss resampling: fix potential read heap buffer overflow in corner cases. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=9783
* GDALDefaultOverviews::OverviewScan(): avoid potential infinite recursion. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=10153
* GDALPamRasterBand::CloneInfo(): do not clone empty RAT
Algorithms:
* OpenCL wrapper: fix memory leak
* Warper: add complex nodata handling in average/min/max modes
* TPS solver: improve numerical stability, for non Armadillo builds, for points not centered on (0,0)
* GCP polynomial interpolation: fix bug where worst_oultier always assumed polynomial order 2
* GCP polynomial interpolation: fix bug where remove_ouliers used the parameters of the reverse transformation
* GDALGridLinear(): speed-up search of triangle for points outside of the triangulation
* gdal_grid linear: avoid artifacts with degenerate triangles (#638)
* GDALPansharpenOperation::Initialize(): validate value of GDAL_NUM_THREADS (CID 1393944)
* GDALFillNodata(): add NODATA option
* GDALDEMProcessing(): fix null pointer dereference if psOptionsIn == nullptr (#931)
Utilities:
* gdal_translate: make -stats option work with -co COPY_SRC_OVERVIEWS=YES (#792)
* gdal_translate: fix RPC correction when using -srcwin with negative offsets (#827)
* gdalwarp: automatically enable SKIP_NOSOURCE=YES when it is safe to do so
* gdalwarp: make -crop_to_cutline stick to source pixel boundaries when no raster reprojection is involved, to avoid unnecessary resampling or resolution change
* gdalwarp -r average: better deal with south-up oriented datasets (#778)
* gdalwarp: improve robustness of computation of source raster window for a given target raster window (#862)
* gdalwarp: allow to create bottom-up grid with -te xmin ymax ymin ymin
* gdalwarp: fix crash when warping on an existing dataset with less bands as needed
* gdal_contour: speed optimizations and capability to compute polygon isosurfaces.
* gdal_contour: add amin and amax parameter for gdal_contour to be used with option -p
* gdal_contour: avoid out-of-memory situation (#594)
* gdal_contour: fix GDAL 2.3 regression with fixed interval contouring that resulted in discontinuities in contour lines (#889)
* gdal_merge.py: deal with NaN values
* gdal_retile.py: fix rounding issues when computing source and target regions (#670)
* gdal_calc.py: add --optfile switch
* gdal2tiles: fix wrong computation of min zoom level in some cases (#730)
* gdal2tiles: add -x option for skipping transparent tile generation
* gdal2tiles: fix performance issue by caching source dataset; GDALAutoCreateWarpedVRT()
* gdal2tiles: fix issue with out-of-range nodata values (#770)
* gdal2tiles: restore GDAL < 2.3 behaviour when output directory is not explicitly specified (#795)
* gdal2tiles: fix --force-kml (#809)
* gdal_edit.py: add -setstats to set "fake" statistics (#819)
* gdal_edit.py: add -unsetrpc option to gdal_edit.py, and fix GTiff driver to be able to clear RPC
* gdal_grid: fix -clipsrc from a vector datasource (broken at least since GDAL 2.1)
* gdalenhance: avoid potential nullptr dereference (CID 1394096)
* make sure that --config is early evaluated for config options such as CPL_VSIL_CURL_CHUNK_SIZE that are read early
Multi driver changes:
* HFA and KEA: better support for writing RATs (trac #4903)
* Fix creation of large enough datasets with drivers EHdr, ENVI and ISCE that failed due to inappropriate check on file size whereas the file wasn't filled yet (#705, 2.3.0 regression)
BAG driver:
* avoid warnings when reading georeferencing
* get datetime
* safer retrieval of variable extents
* add read support for variable-resolution grids, and write support for single-resolution grids
E00GRID driver:
* correctly parse projection sections that have lines with tildes (#894)
EHdr driver:
* only write .stx if bApproxOK=false (#514)
ENVI driver:
* support reading truncated datasets (#915)
ERS driver:
* fix quadratic performance in parsing .ers header. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8404
* avoid excessive memory allocation. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8497
* avoid potential stack overflow. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8614
* prevent infinite recursion. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8744
* avoid potential bad cast. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8745
FIT driver:
* avoid excessive block size on creation. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8292
* error out in CreateCopy() on failed I/O on source dataset. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8338
GeoRaster driver:
* Fix the issue by freeing the temporary lobs created by readCLob() and writeCLOB().
GPKG driver:
* fix memleak if I/O error occurs on write
* retrieve original raster file when using gdal_translate -co APPEND_SUBDATASET=YES with other gdal_translate switches
* copy source metadata when using TILING_SCHEME
* properly delete gridded coverage raster layers
GRIB driver:
* replace DataSource and derived classes with VSILFILE directly for > 4GB file support on Windows
* turn printf() warning as CPLDebug() messages
* read and write missing data values correctly for complex packing when original data is integer (#1063)
* g2clib: avoid int overflow. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8194
* g2clib: avoid potential out of bound access (CID 1393528)
* degrib: fix floating point division by zero. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=9407.
* degrib: avoid potential floating point division by zero. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=10291
* add UNIT[] node to SRS on reading, so that is valid
GTiff driver:
* Add TIFF Lerc codec (in GTiff driver itself)
* Add TIFF WebP codec (in libtiff)
* save XMP on field TIFFTAG_XMLPACKET (#767)
* fix retrieving mask band of overview band when the mask is external. Fixes -co COPY_SRC_OVERVIEWS=YES of such datasets (#754)
* improve progress report in CreateCopy() when there is a mask (#935)
* improve performance reading multi-band 1-bit data. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=7840.
* internal libtiff: updated to libtiff 4.0.10
* internal libgeotiff: resync with upstream.
* workaround bug in currently released libgeotiff versions, where when rewriting a ASCII key with a string value longer than the original value (#641)
* allow the use of PREDICTOR with ZSTD compression
* avoid various memory corruptions in case of some corrupted file. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8488
* load PAM if not already done when GetDefaultRAT() is called
* fix missing #ifdef causing compilation failure due to missing bTryCopy (#946)
HDF4 driver:
* quote swath and field names if needed (if they contain spaces, column, quotes) in HDF4_EOS subdataset names
HDF5 driver:
* add VSI functionality (#786)
* fix reading variable names with single character (#622)
* fix HDF5 object leak (thus preventing file closing) on datasets with variable length attributes (#933)
HFA driver:
* fix floating point division by zero. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=9201
* fix division by zero. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=10190
HTTP driver:
* do not immediately delete a file used by the JP2OpenJPEG driver
ILWIS driver:
* Fix performance issue on creation with big number of bands. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=9062
IRIS driver:
* add UNIT[] node to SRS on reading, so that is valid
* avoid infinite loop. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8256 and 8439
ISCE driver:
* do not try to stat() mainfile.xml if mainfile does not exist
ISIS3 driver:
FITS driver:
* allow reading/writing beyond 2 billion pixels limit
JP2OpenJPEG driver:
* allow YCC for non-Byte datasets; and allow 4-band MCT with openjpeg >= 2.2
* add CODEBLOCK_STYLE creation option for OpenJPEG >= 2.3
* add support for generating and using external overviews
JPEG driver:
* slightly improve performance of whole RGB image loading with pixel-interleaved buffer
* Internal libjpeg: Avoid integer overflow on corrupted image in decode_mcu_DC_first() (https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=9447)
JPEGLS driver:
* Add support for CharLS 2 (#632)
MRF driver:
* Add TestBlock(), skip empty areas when building overviews
* Fix detection of Lerc2 data
* Resync with upstream LercLib and put it in third_party/LercLib
NetCDF driver:
* add VSI functionality on Linux (#786)
* add support for longitude values wrapping at 180deg of longitude (#1114)
* avoid use of uninitialized variable when reading blocks in creation mode
NGSGEOID driver:
* report a CRS that conforms to the official publications for GEOID2012 and USGG2012 datasets (#1103)
NITF driver:
* avoid excessive processing time on corrupted files. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8972
* avoid heap-buffer-overflow for VQ compression. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=9467
PCIDSK driver:
* add back support for creating external overviews, removed years ago when switching to the new PCIDSK SDK (#887)
PCRaster driver:
* libcsf: avoid potential out of bound access (CID 1074445)
PDF driver:
* Remove forced use of libstdc++ for macOS when building plugin (#888)
PDS driver:
* deal with detached labels whose line spacing is not a multiple of record size (#955)
* add support for reading CRISM images
* add support for ^QUBE = number for multi-band images
PDS4 driver:
* fix georeferencing reading/writing to use pixel corner convention (#735)
* add UNIT[] node to SRS on reading, so that is valid
PostgisRaster driver:
* add support for out-db rasters (Trac #3234)
* use ST_BandFileSize of PostGIS 2.5 when available for outdb_resolution=client_side_if_possible
* improve performance of line by line reading; add performance hints section in the doc
* fix CreateCopy() when PostGIS is not in public schema
* add quoting of identifiers
PRF driver:
* Fix Photomod x-dem files georeference
RasterLite2 driver:
* fail on Create() that is not supported
RDA driver:
* enable support for DG RDA Image Reference string
RMF driver:
* Add support JPEG compressed RMF datasets (#691)
* Add optional projection import/export from EPSG code (#701)
* Create compressed datasets: LZW, DEM, JPEG (#732)
* Cache decoded tile to improve performance of interleaved access
* Parallelize data compression, add internal tile write-cache, add compressed overviews support (#748)
* Fix 4-bit dataset reading
* Expose NBITS to metadata
RS2 driver:
* avoid potential memleak (CID 1393537, CID 1393534, CID 1074387)
SENTINEL2 driver:
* Add support of S2x_MSIL2A files (#1069)
SGI driver:
* writer: avoid out-of-bound buffer access. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8889
SIGDEM driver:
* be more robust against excessive memory allocation attempt
* avoid floating point division by zero. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=11220
SDTS driver:
* avoid long processing time on corrupted dataset. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=11219
SRP driver:
* ASRP/USRP: allow opening files padded with 0x5E / ^ character without emitting error (#838)
USGSDEM driver:
* fix reading of Benicia.dem and Novato.dem (trac #4901, #583)
* optimize I/O access a bit
* avoid potential out-of-bounds access (CID 1393532)
* avoid int overflow. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=9475
VRT driver:
* GDALCreateWarpedVRT(): automatically set GCI_AlphaBand on the alpha band
* data/gdalvrt.xsd: add GDALRasterAttributeTable (#818)
* VRTComplexSource: make sure that min and max values in case of exponential resampling are properly computed
* ComputeStatistics(): optimize when nodata is set on a single SimpleSource
* Fix issue when opening VRT with large number of bands (#1048)
* deal with serialized nodata value that is slightly outside Float32 validity range (#1071)
* fix source window computation that caused sub-pixel shift with non-nearest resampling
* fix potential int overflow on invalid VRT
WCS driver:
* Parse envelopes with time periods. Improve error reporting. Fix one SUBDATASETS metadata thing. More metadata from Capabilities to metadata. Print some URLs in debug mode. Unique subset params in URLs. Add time domain interval to metadata.
* GeoServer does not like primary subsets to have postfixes. Fix service dirty issue. Add GeoServer TimeDomain coverage metadata. Do not put service parameter into subdataset name and use generic coverage parameter
* deal with GDALPamDataset::GetMetadata returning nullptr. (#648)
WMTS driver:
* avoid issue with reprojection of layer extent into TileMatrixSet SRS
* fix issue with inappropriate zoom level being selected causing integer overflow in raster dimension computation
* fix potential off-by-one pixel when compositing the underlying WMS/TMS source into the final raster
== OGR 2.4.0 - Overview of Changes ==
Core:
* Add JSON field subtype for String fields
* OGR SQL: avoid int overflow on -(-9223372036854775808) evaluation. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8717
* OGR SQL: evaluation modulo operator on floating point values as a floating point modulo. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8761.
* OGR SQL: swq_expr_node::Evaluate(): avoid too deep recursion. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8836
* OGRLineString::TransferMembersAndDestroy(): fix crashing issue with M component. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8773.
* OGRGeometry::exportToGEOS(): fix potential out-of-bounds write on some GeometryCollection with TIN/PolyhedralSurface (#688)
* OGRGeometryFactory::organizePolygons(): improve performance for polygons with many consecutive identical nodes. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=9618
* Fix IsValid() for a TRIANGLE with GEOS, but without SFCGAL
* morphToESRI(): fix a heap user-after-free.
* OGRFeature::SetField( int iField, const char * const * papszValues ): avoid potential invalid access to pauFields[iField].StringList.paList
* SQLite dialect: fix when ROWID is used in WHERE clause and the source layer has a real FID column name
* GML geometry parser: recognize MultiGeometry.geometryMembers syntax (refs https://issues.qgis.org/issues/19571)
* OGRGetXMLDateTime(): Interpret TZFlag correctly (#996)
* OGRFeatureStyle: Restore font field at OGRStyleSymbol
OGRSpatialReference:
* importFromEPSG(): append ' (deprecated)' at end of deprecated GCS and GEOCCS (#646)
* ogr_opt.cpp: fix wrong values and add missing values in papszProjectionDefinitions[]
* importFromProj4/exportToProj4: fix typo in the PROJ method name of InternalMapOfTheWorldPolyconic which is imw_p
* Krovak: explicit that alpha and Pseudo_standard_parallel_1 are hardcoded in PROJ
* SetNormProjParm(): avoid division by zero. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=10588
* FindMatches(): if the input SRS has a EPSG code, check that its definition and the EPSG one actually matches (#990)
Utilities:
* ogr2ogr: reject -append, -select options together
* ogr2ogr: speed-up in case of big number of field name clashes. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8960
* ogr2ogr: make -clipsrc work when output dataset has no geometry field (#943)
* ogrlineref: fix tolerance for not geographic spatial reference
* ogrmerge.py: avoid exception in error code path of GetOutputDriverFor()
* ogrmerge.py: fix issue with non-ASCII characters (fixes #1067)
Multi driver changes:
* KML/LIBKML: robustify for out-of-memory conditions (fixes https://issues.qgis.org/issues/19989)
* XLSX / ODS: avoid harmless warning in some cases when guessing column data types
AVCE00 driver:
* avoid perforance issues on huge lines. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8284
* fix performance issue on reading PRJ section. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=9061
BNA driver:
* refuse to open existing file in update mode, since it causes later crashes when attempting to add new features (https://issues.qgis.org/issues/18563)
* avoid long processing. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8754
* more efficient building of polygons. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=10951
CAD driver:
* Fix read objects map. Upgrade version of libopencad to 0.3.4. (#677)
* Fix wrong OGRCircularString construction from CADCircle. (#736)
* avoid integer overflow. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8385
* Fix buffer overflow on skip read. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=9107
Carto driver:
* Use new /sql/copy-from end point for writing (#715)
* fix ICreateFeatureCopy() with unset fields
CSV driver:
* in writing, use WKT instead of actual geometry column name if GEOMETRY=AS_WKT mode is used without CREATE_CSVT=YES (fixes #660)
* writer: limit to 10000 fields to avoid performance issues. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=9336 (8449 as well)
* avoid endless loop when iterating and updating features (#919)
DXF driver:
* add PaperSpace field (Trac #7121)
* allow attributes with spaces in the tag
* Correctly handle non-uniformly-weighted spline HATCH boundaries (#1011)
* avoid null pointer dereference when DXF_MAX_BSPLINE_CONTROL_POINTS is hit. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=8254.
* Fix reporting of wrong line numbers in errors (fixes #726)
* Don't crash when spline control point limit is reached
* fix memory leak in case of attempt to write GeometryCollection of unsupported type
EDIGEO driver:
* reading multipolygons (trac #6955, #711)
ElasticSearch driver:
* add compatibility with ES v6.0
* add a USERPWD open option
* add lazy loading of layers
* add a LAYER open option
* skip xpack indices, and do not emit 503 error when listing unauthorized layers
* add a INDEX_DEFINITION layer creation option
*allow several geometry fields of type GEO_POINT to be created
ESRIJson driver:
* parse documents that lack 'geometryType' member (#914)
GeoJSON driver:
* fix type deduction when there is a Feature.id of type string and Feature.properties.id of type int. The later has precedence over the former (arbitrary decision) (#669)
* properly flush the file in SyncToDisk() in append situations (https://issues.qgis.org/issues/18596)
* parse '{"type": "GeometryCollection", "geometries": []}' as empty geometrycollection
* increase max memory allowed to parse a single feature (#807)
* remore topojson from extensions recognized by the driver
* add partial support for field names differing by case (#1057)
* RFC7946 writer: clip and offset geometries outside [-180,180] (#1068)
* no longer write NaN/Infinity values by default (#1109)
GeoRSS driver:
* avoid excessive processing time. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=9263
GML driver:
* avoid fetching SRS from http
* fix potential memory leak in case of duplicated name of geometry fields in .gfs
* improve performance for large number of attributes. Fixes https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=9038.
GPKG driver:
* add read/write support for JSON field subtype
* speed up GetExtent() on huge tables with rtree. Refs https://issues.qgis.org/issues/18402
* take into ROLLBACK TO SAVEPOINT to invalidate cached feature count
* make sure to not invalidate POSIX advisory locks
* remove useless check that encoding is UTF-8 (#793)
* fix typo in gpkg_metadata_reference_column_name_update trigger definition
* optimize table renaming by avoiding to drop the spatial index, but just renaming it
IDF driver:
* use a temporary SQLite database (when driver available) for files larger than 100 MB
* add support for Z coordinate (#964)