mirror
/
planetiler
kopia lustrzana https://github.com/onthegomap/planetiler
1
0
Forkuj 0
Kod Zgłoszenia Projekty Wydania Wiki Aktywność
873 Commity
87 Gałęzie
10 Tagi
57 MiB
Wykres commitów

168 Commity (main)

Autor SHA1 Wiadomość Data
Michael Barry 8f9b750789
Log more details on feature processing errors (#884) 2024-05-07 06:53:50 -04:00
Michael Barry 1cb3050f39
Expose osm element type to yaml configs (#879) 2024-05-05 14:39:53 -04:00
Michael Barry ef1702ec73
ignore duplicate relation members (#876) 2024-05-02 06:21:01 -04:00
Michael Barry 978c64f0c6
Add polygon index intersection utility (#866) 2024-04-10 07:12:29 -04:00
Michael Barry f69882addb
Fix tile size stats memory leak (#861) 2024-04-02 20:34:42 -04:00
Michael Barry 9f0f513dd7
Safer natural earth unzip (#825) 2024-03-03 18:47:44 -05:00
Peter Hanecak 40e64a2fd3
filter out null entries, allowing skipping of OSM read when no profile needs OSM data (#822) 2024-02-28 20:58:22 -05:00
Peter Hanecak d703b626ad
Attempt to fix IOException/GOAWAY happening within parseResults() (#818) 2024-02-16 07:46:17 -05:00
Michael Barry f7a3b62170
Add `firstCoordinate` vector tile feature helper (#814) 2024-02-03 09:35:20 -05:00
Michael Barry 7c03592358
Add tile post-process hook to forwarding profile (#813) 2024-02-03 06:14:08 -05:00
Michael Barry 384f84f51a
omit() feature collector api and --refresh-sources arg (#810) 2024-01-30 07:40:02 -05:00
Michael Barry fa7bffb04f
Add whole-tile postprocess hook (#802) 2024-01-23 07:08:18 -05:00
Michael Barry 328e1b4d53
Small benchmarks (#801) 2024-01-20 09:10:38 -05:00
Brandon Liu 67d530a526
add extraMetadata to profile interface [#794] (#795) 2024-01-17 06:03:17 -05:00
Brandon Liu 0cb2645639
Fix comparison of multipolygons bounds check [#780] (#793) 2024-01-16 08:11:03 -05:00
Michael Barry bf24ef3961
Check for deterministic output in CI (#792) 2024-01-15 14:14:17 -05:00
Michael Barry 5a7757435d
Deterministic IDs on SimpleFeatures (#791) 2024-01-15 06:22:30 -05:00
Michael Barry 14b217d6f6
Fix feature merge consistent ordering (#789) 2024-01-14 12:08:20 -05:00
Michael Barry 062528b1ee
Make OSM polygon construction deterministic (#788) 2024-01-12 09:01:09 -05:00
Michael Barry 0dc2ee82e1
Deterministic merging (#785) 2024-01-11 08:42:16 -05:00
Michael Barry 96eae6110b
Archive compare (#780) 2024-01-10 05:21:03 -05:00
Björn Bilger df804879ef
remove log4j-CloseShieldOutputStream usage (#779) 2024-01-09 18:14:28 -05:00
cmahnke f692124168
Remove log4j usage (#776) 2024-01-09 05:04:44 -05:00
Björn Bilger c480b35f1c
Add support for "files"-archive (#761) 
* Add support for "files"-archive

i.e. write individual pbf-files to disk in the format <base>/z/x/y.pbf

in order to use that format it must be passed as "--ouput=/path/to/tiles?format=files"

Fixes #536

* default to files format

...if no explict format query param given, path ends with a slash, or no extension given

* output metadata.json in files-archive

and refactor TileArchiveMetadata
1. put zoom into center (CoordinateXY->Coordinate) - in sync with mbtiles-format
2. add (De-)Serializer for Coordinate+Envelop => avoid duplication and cleaner
3. change the json and proto output for TileArchiveMetadata to be (more) in sync with mbtiles-format

* add support for custom tile scheme in files-archive

{z}/{x}/{y}.pbf is the default and can be configured as needed - e.g.:
- different order: {x}/{y}/{z}.pbf
- with intermediate dirs: {x}/a/{y}/b/{z}.pbf
- with different extension: {z}/{y}/{y}.pbf.gz

instead of {x} and {y}, {xs} and {xy} can be used which breaks up
x and y into 2 directories each and ensures that each directory has <1000 children

* fix issues with multiple writers

1. call finish archive only once after all writers are finished
   ...and not every time a writer finishes
2. log "zoom-progress" for the first tile write only
   (Finished z11 ... now starting z12)
3. remove file/dir-size progress logger bottleneck for files archive
   => each archive now reports the bytes written, which also fixes
   the issues of stream-archives reporting the size incorrectly
4. introduce printStats-hook on archive-level

* add async file write support to files archive

...allow to use virtual threads ExecturService (bound only!) for tile writing

also add some benchmark for writing tiles to disk: fixed, bound virtual, async, unbound virtual

* Revert "add async file write support to files archive"

This reverts commit b8cfa56977d98520aa8b62252c3a2726d440afe0.

* few improvements

- extract TileSchemeEncoding
- use Counter.MultithreadCounter rather than LongAdder to count bytes written
- add some JavaDoc

* simplify files archive usage

1. allow to pass tile scheme directly via output: --output=tiles/{x}/{y}/{z}.pbf
2. auto-encode { (%7B) and } (%7D) => no need to encode it the URI on CLI

* few more adjustments according to PR feeback

1. use WriteableTileArchive#bytesWritten in summmary as well
2. call WriteableTileArchive#init in a safer manner

..and a few more adjustments

* more PR feedback
 2024-01-02 20:37:49 -05:00
Brandon Liu a233e683bd
fix center coordinates of pmtiles writer (#769) 2023-12-28 06:43:00 -05:00
Michael Barry a78e6284a8
Use push-down bbox filter for shapefiles (#757) 2023-12-18 07:06:00 -05:00
Michael Barry cbb092a1f7
Compute layer attr stats from actual vector tile features (#752) 2023-12-14 19:26:27 -05:00
Michael Barry 40bf33e887
Access OSM metadata in yaml profiles (#739) 2023-12-02 15:34:35 -05:00
Mike Barry 699277b17f clearStage at start 2023-11-20 08:53:01 -05:00
Michael Barry 1df1bf04e4
Add `setAttrWithMinSize` to feature API (#725) 2023-11-20 06:15:52 -05:00
dependabot[bot] c22d379734
Bump jackson.version from 2.15.3 to 2.16.0 (#726) 2023-11-17 04:47:38 -05:00
Michael Barry ae7261246f
Add API for maximum inscribed circle/pole of inaccessibility centerpoint of a polygon (#723) 2023-11-14 07:44:47 -05:00
Michael Barry ec6430dc49
Min polygon area centroid (#720) 2023-11-13 07:16:55 -05:00
Michael Barry 517851435d
Fix buffer union unbuffer exceptions (#713) 2023-11-07 07:28:00 -05:00
Michael Barry 44f22b27c5
Rewrite downloader using virtual threads (#702) 2023-11-01 19:30:28 -04:00
Michael Barry a94ac0ddd8
Add detailed jts debugging info (#703) 2023-10-30 22:14:46 -04:00
Michael Barry 9f960022b8
Logging fix (#699) 2023-10-27 20:40:45 -04:00
Michael Barry 1be2fca45f
Use some new Java 21 features (#695) 2023-10-27 20:29:26 -04:00
Michael Barry 2bb05a0797
fix log4j log format (#697) 2023-10-26 07:30:56 -04:00
dependabot[bot] 015f418405
Bump geotools.version from 29.2 to 30.0 (#685) 
* Bump geotools.version from 29.2 to 30.0

Bumps `geotools.version` from 29.2 to 30.0.

Updates `org.geotools:gt-shapefile` from 29.2 to 30.0

Updates `org.geotools:gt-epsg-hsql` from 29.2 to 30.0

---
updated-dependencies:
- dependency-name: org.geotools:gt-shapefile
  dependency-type: direct:production
  update-type: version-update:semver-major
- dependency-name: org.geotools:gt-epsg-hsql
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

* fix geotools breaking changes

* fix tests

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Mike Barry <msb5014@gmail.com>
 2023-10-20 06:59:28 -04:00
Michael Barry e7e18d5f17
Sort merged vector tile features by hilbert order (#673) 2023-09-26 20:56:04 -04:00
Michael Barry 1b53493ac7
Upgrade omt to pull in tile size optimizations (#672) 2023-09-25 06:04:53 -04:00
Michael Barry 2f86ea12ae
Utilities to reduce tile size (#669) 2023-09-24 08:10:47 -04:00
Michael Barry 0a241e17e1
Fix downloading tile weights in CI (#668) 2023-09-22 06:30:17 -04:00
Michael Barry 1f23b55274
Tile stats (#656) 2023-09-21 21:44:09 -04:00
Björn Bilger db796e1720
Add support for simple file output streams: CSV, JSON, protobuf (#639) 2023-08-23 20:24:27 -04:00
Björn Bilger a1c33dc5d5
remove the old TileEncodingResult (#642) 
* remove the old TileEncodingResult

...only to be merged once planetiler-openmaptile has been updated

* update pt-omt

---------

Co-authored-by: Mike Barry <msb5014@gmail.com>
 2023-08-03 21:52:42 -04:00
Mikael Gueck 04239ff564
Escape regex string (#627) 
Escape the character once for the regex, and a second time for Java.
 2023-07-16 07:18:19 -04:00
Michael Barry a48a9c8391
Page through S3 index (#608) 2023-06-21 20:43:37 -04:00
Erik Price cced1920d4
Add support for Overture maps downloads. (#599) 2023-06-08 09:01:01 -07:00