mirror
/
planetiler
kopia lustrzana https://github.com/onthegomap/planetiler
1
0
Forkuj 0
Kod Zgłoszenia Projekty Wydania Wiki Aktywność
886 Commity
91 Gałęzie
10 Tagi
57 MiB
Wykres commitów

176 Commity (main)

Autor SHA1 Wiadomość Data
Michael Barry 2f86ea12ae
Utilities to reduce tile size (#669) 2023-09-24 08:10:47 -04:00
Michael Barry 0a241e17e1
Fix downloading tile weights in CI (#668) 2023-09-22 06:30:17 -04:00
Michael Barry 1f23b55274
Tile stats (#656) 2023-09-21 21:44:09 -04:00
Björn Bilger db796e1720
Add support for simple file output streams: CSV, JSON, protobuf (#639) 2023-08-23 20:24:27 -04:00
Björn Bilger a1c33dc5d5
remove the old TileEncodingResult (#642) 
* remove the old TileEncodingResult

...only to be merged once planetiler-openmaptile has been updated

* update pt-omt

---------

Co-authored-by: Mike Barry <msb5014@gmail.com>
 2023-08-03 21:52:42 -04:00
Mikael Gueck 04239ff564
Escape regex string (#627) 
Escape the character once for the regex, and a second time for Java.
 2023-07-16 07:18:19 -04:00
Michael Barry a48a9c8391
Page through S3 index (#608) 2023-06-21 20:43:37 -04:00
Erik Price cced1920d4
Add support for Overture maps downloads. (#599) 2023-06-08 09:01:01 -07:00
Michael Barry bf86516fab
Fallback to lenient shapefile parsing (#570) 2023-04-27 08:30:55 -04:00
Michael Barry 8d0e06c667
Fix invalid polygons before snapping to tile coordinates (#566) 2023-04-27 08:19:31 -04:00
Erik Price 2450c9d9f7
Exclude relations with invalid multipolygon geometry (#564) 2023-04-25 19:16:01 -04:00
dependabot[bot] 9b76c849e0
Bump jackson.version from 2.14.2 to 2.15.0 (#563) 
* Bump jackson.version from 2.14.2 to 2.15.0

Bumps `jackson.version` from 2.14.2 to 2.15.0.

Updates `jackson-core` from 2.14.2 to 2.15.0
- [Release notes](https://github.com/FasterXML/jackson-core/releases)
- [Changelog](https://github.com/FasterXML/jackson-core/blob/jackson-core-2.15.0/release.properties)
- [Commits](https://github.com/FasterXML/jackson-core/compare/jackson-core-2.14.2...jackson-core-2.15.0)

Updates `jackson-databind` from 2.14.2 to 2.15.0
- [Release notes](https://github.com/FasterXML/jackson/releases)
- [Commits](https://github.com/FasterXML/jackson/commits)

Updates `jackson-datatype-jdk8` from 2.14.2 to 2.15.0

Updates `jackson-dataformat-xml` from 2.14.2 to 2.15.0
- [Release notes](https://github.com/FasterXML/jackson-dataformat-xml/releases)
- [Commits](https://github.com/FasterXML/jackson-dataformat-xml/compare/jackson-dataformat-xml-2.14.2...jackson-dataformat-xml-2.15.0)

---
updated-dependencies:
- dependency-name: com.fasterxml.jackson.core:jackson-core
  dependency-type: direct:production
  update-type: version-update:semver-minor
- dependency-name: com.fasterxml.jackson.core:jackson-databind
  dependency-type: direct:production
  update-type: version-update:semver-minor
- dependency-name: com.fasterxml.jackson.datatype:jackson-datatype-jdk8
  dependency-type: direct:production
  update-type: version-update:semver-minor
- dependency-name: com.fasterxml.jackson.dataformat:jackson-dataformat-xml
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* fix JsonAnySetter

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Mike Barry <msb5014@gmail.com>
 2023-04-25 06:05:09 -04:00
Michael Barry 738e181657
handle empty geopackage geometries (#561) 2023-04-24 06:43:03 -04:00
Michael Barry 72ea82cd50
Fall back to slower transliterator (#543) 2023-03-31 06:33:12 -04:00
Michael Barry 509795401e
Fix geometry errors (#526) 2023-03-20 16:41:18 -04:00
Michael Barry 97231d18ef
Add --keep-unzipped option to avoid unzipping sources each time (#522) 2023-03-19 14:01:17 -04:00
Michael Barry 74db638dbc
Expose pmtiles writer (#520) 2023-03-18 14:38:04 -04:00
Michael Barry c5d6daf671
metadataTable alias (#517) 2023-03-15 13:15:57 -04:00
Brandon Liu 93af11bb26
Expose setId in FeatureCollector [#377] (#514) 2023-03-15 10:28:16 -04:00
Brandon Liu d5b404d8e2
Finish PMTiles write implementation and basic reader (#502) 2023-03-13 13:56:11 -04:00
Michael Barry 1375ee7abb
Support disabling colors in terminal output (#501) 2023-02-25 07:45:45 -05:00
Michael Barry f4d07ea141
Detect certain kinds of invalid polygons when slicing into tiles (#499) 2023-02-24 13:14:50 -05:00
Michael Barry 9c318e45b0
Update ReadableTileArchive.java (#486) 2023-02-14 05:41:28 -05:00
Brandon Liu 9bf62d5644
Pmtiles package low level header and directory serialization/deserialization [#98] (#466) 2023-02-08 06:44:04 -05:00
Michael Barry 9a704e773e
Convert get all tile coords to iterator (#463) 2023-02-05 14:16:05 -05:00
Michael Barry 78129905e5
Add `--download-max-bandwidth` option (#467) 2023-01-30 13:38:09 -05:00
Brandon Liu 88daeb4d0b
Speed up VarInt encoding, remove emitTilesInOrder option [#98] (#460) 2023-01-27 08:12:54 -05:00
Brandon Liu 9ce9d1f5b2
FeatureGroup can emit in either TMS or Hilbert order. [#98] (#455) 2023-01-26 21:43:07 -05:00
Michael Barry 723f44e236
Improve is convex logic (#459) 2023-01-26 12:03:58 -05:00
Erik Price 4f43f1127a
Revert "fix is convex negated (#241)" (#458) 
This reverts commit f93e5221f8.
 2023-01-26 04:59:37 -05:00
Brandon Liu f772180fb7
refactor VectorLayers from mbtiles into util.LayerStats [#98] (#456) 2023-01-25 21:15:43 -05:00
Erik Price a0f8c67c78
Support unzipping GeoPackage sources at runtime (#430) 2023-01-25 20:56:30 -05:00
Brandon Liu b97d9d0e79
fix CloseableConsumer class name (#454) 2023-01-23 06:06:57 -05:00
Brandon Liu 1afb5de820
add VarInt encoder for unsigned longs [#98] (#449) 2023-01-23 05:58:23 -05:00
Brandon Liu 09fd4ba2ba
Tile archive refactor (#443) 2023-01-17 07:05:45 -05:00
Peter Hanecak 4a622a8ef0
Tile hashing fix (#436) 2023-01-14 16:03:50 -05:00
Erik Price ef24e91f0b
Add basic support for reading GeoPackage files. (#413) 2023-01-02 12:19:05 -05:00
Michael Barry aea309e094
add layer to shapefile (#429) 2023-01-02 11:41:12 -05:00
Michael Barry dad2073f61
Add planetiler-specific metadata (#428) 2023-01-02 11:26:00 -05:00
Erik Price 184f950051
Extract ZIP file walker out of ShapefileReader. (#423) 2023-01-01 17:29:00 -05:00
Erik Price ea8589bd6f
Add shapefile directory source (#406) 2022-12-15 14:19:22 -05:00
Michael Barry 926bc9210b
Switch ordering of translation providers (#403) 2022-12-01 17:26:04 -05:00
Erik Price 9e4eb45baa
Fix max tile size in stats output. (#399) 2022-11-30 20:18:45 -05:00
Erik Price 762d052b10
Remove outdated reference to "relation_member" type (#397) 2022-11-29 18:15:35 -05:00
ttomasz 6a893a4787
Cli add version argument (#376) 2022-11-26 06:59:13 -05:00
Erik Price ccf098115e
Move NumberFormat to thread-local variable (#387) 
* Move NumberFormat to thread-local variable

The NumberFormat class isn't thread safe, and sharing one instance
across threads allowed for races which resulted in otherwise valid OSM
tags not being parsed correctly.

* Add supression for ThreadLocal use

* Use ThreadLocal for NumberFormat objects in `Format`

* Wrap `NumberFormat` instances rather than hashmap
 2022-11-21 20:34:28 -05:00
Erik Price 7f6032b641
Fix NPE for `OsmReader#estimateMemoryUsageBytes()` (#389) 
A `NullPointerException` was thrown when this method was called after
calling `close()` (which happens when using the `PrometheusStats`
client).
 2022-11-21 15:13:29 -05:00
Michael Barry 0eb148ee3c
Expose arguments via config (#363) 2022-10-04 19:57:59 -04:00
Michael Barry 5296d1772e
Shortbread schema (#323) 2022-09-23 06:49:09 -04:00
Michael Barry 9e0eec93c8
Add `quickstart.sh` script to run with recommended settings (#318) 2022-08-10 05:09:33 -04:00
Michael Barry 4cc139a603
Improve geofabrik area search (#317) 2022-08-09 07:13:45 -04:00
dependabot[bot] 9648ea83a7
Bump sqlite-jdbc from 3.36.0.3 to 3.39.2.0 (#315) 
* Bump sqlite-jdbc from 3.36.0.3 to 3.39.2.0

Bumps [sqlite-jdbc](https://github.com/xerial/sqlite-jdbc) from 3.36.0.3 to 3.39.2.0.
- [Release notes](https://github.com/xerial/sqlite-jdbc/releases)
- [Changelog](https://github.com/xerial/sqlite-jdbc/blob/master/CHANGELOG)
- [Commits](https://github.com/xerial/sqlite-jdbc/compare/3.36.0.3...3.39.2.0)

---
updated-dependencies:
- dependency-name: org.xerial:sqlite-jdbc
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* disable failing test on windows

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Mike Barry <msb5014@gmail.com>
 2022-08-07 20:20:46 -04:00
Michael Barry 93fe75782e
Improve shapefile zip reads (#314) 2022-07-31 07:17:42 -04:00
Michael Barry 7fa51c1c02
Generate protobuf during build (#310) 2022-07-29 08:31:26 -04:00
Adam Laža 88c7f5650f
Move basemap profile into OpenMapTiles submodule (#258) 2022-07-29 06:40:15 -04:00
Michael Barry 8a8db0005d
Lazy primitive group deserialization (#309) 2022-07-28 07:56:41 -04:00
Michael Barry 621a8ed759
Support zoom levels up to 15 (#303) 2022-07-26 07:51:31 -04:00
Brandon Liu a50c43835d
TileCoord supports up to zoom 15 using alternate ordering (#266) 2022-07-24 06:40:43 -04:00
Mike Barry aa40e083c5 rm unnecessary main 2022-07-22 06:54:36 -04:00
farfromrefuge 7818634774
feat: `--polygon` argument to constrain mbtiles to a poly shape (#280) 2022-07-22 06:48:04 -04:00
Michael Barry d1d68cf753
Memory-mapped lazy reads by default (#300) 2022-07-20 08:06:08 -04:00
Michael Barry 0e6394036c
Fix bounds check on dense nodes (#301) 2022-07-20 07:44:15 -04:00
Michael Barry c6ad30cc9a
OSM QA Tiles Example Profile (#278) 2022-07-14 05:26:53 -04:00
Michael Barry 52432b815b
Fix memoize bug (#279) 2022-06-20 07:32:55 -04:00
farfromrefuge 76c7880d6b
feat: added `maxzoomForRendering` and `minzoomForRendering` (#272) 2022-06-20 06:31:50 -04:00
Brian Sperlongano 3fd094ddae
Allow more than 256 attribute keys (#275) 2022-06-20 05:37:40 -04:00
farfromrefuge b9d91e47cf
fix: merge line if it needs to be simplified (#244) 2022-06-10 06:45:12 -04:00
Michael Barry 6300b47897
Fix flaky windows test (#264) 2022-06-07 20:40:46 -04:00
Brian Sperlongano da12fef79f
Declarative schema from configuration file (#160) 2022-06-07 17:34:21 -04:00
Michael Barry bed2220e83
Cheap isFill check and add `--skip-filled-tiles` option (#234) 2022-06-03 21:04:17 -04:00
Michael Barry b0f634bcaf
Use fnv1a64 for tile hash (#253) 2022-06-03 20:44:49 -04:00
Michael Barry 4ba36655d4
Fall back to parsing bounds from all nodes (#251) 2022-06-03 05:25:17 -04:00
Michael Barry 2ccef9f7f6
Unsynchronize ICU4j transliterate (#246) 2022-06-01 21:31:49 -04:00
Björn Bilger 97642fc096
Improve DB Indexes and Fix Deferred Index Logging in Compact DB Mode (#245) 2022-06-01 21:29:59 -04:00
Michael Barry f93e5221f8
fix is convex negated (#241) 2022-05-30 08:15:40 -04:00
Michael Barry 4ecc96e9d9
enable by default (#236) 2022-05-28 05:23:36 -04:00
Michael Barry 99c0f8ae9c
Add `--feature-read-threads` option to read features in parallel when writing tiles (#225) 2022-05-24 18:46:52 -04:00
Björn Bilger f5206b3a73
add compact DB mode (--compact-db) to de-duplicate mbtiles output (#219) 2022-05-24 17:46:56 -04:00
Michael Barry dab37f572e
Handle elevations in units besides meters (#226) 2022-05-17 20:23:11 -04:00
Michael Barry a8bec7a56d
Run nested tests (#218) 2022-05-08 21:12:31 -04:00
Michael Barry 9062e6b79b
Use custom min-heap to improve k-way merge by 30-50% (#217) 2022-05-08 20:00:13 -04:00
Michael Barry 726e6d0107
Parallel temp feature writes using `--write-threads` argument (#213) 2022-05-05 22:02:18 -04:00
Michael Barry 3589fc61f3
More robust multiexpression filtering (#206) 2022-05-04 20:30:47 -04:00
Michael Barry 01b52f9812
Add `--mmap-temp` option to use memory-mapped IO for temp feature files (#209) 2022-05-03 08:59:15 -04:00
Brian Sperlongano 891537e2bc
Implement matchField testing for Expression.not (#201) 2022-04-30 09:42:24 -04:00
Michael Barry 186af36c42
Minimize number of temp feature chunk files (#199) 2022-04-28 20:14:44 -04:00
Brian Sperlongano ffb157414e
Data type support for Expression / MultiExpression (#190) 2022-04-28 07:08:00 -04:00
Michael Barry b04f4cde0b
Review thread local warnings (#196) 2022-04-27 07:24:14 -04:00
Michael Barry 2db49fc76f
Fix sonar issues with unclosed resources (#195) 2022-04-26 06:26:05 -04:00
Michael Barry 29a50f59e4
fix sonar warnings in tests (#191) 2022-04-23 06:36:24 -04:00
Michael Barry 5341d4d712
Fix sonar warnings (#181) 2022-04-23 05:58:49 -04:00
Michael Barry 4983bbc04e
0.4.0 tweaks (#153) 
* tweaks from running on planet

* add no building merge log

* table format

* update maven descriptions
 2022-03-31 06:42:28 -04:00
Yuri Astrakhan bc66bbd352
Linting - spelling, tiny cleanups (#150) 
* Linting - spelling, tiny cleanups

Grammar fixes, marked one place as `final`, etc.

* formatting
 2022-03-27 05:49:58 -04:00
Mike Barry 96b6f200c6 fix multipolygon size estimate 2022-03-25 19:47:49 -04:00
Mike Barry 11cb4ade2e fix --madvise flag 2022-03-25 19:47:31 -04:00
Michael Barry 2a8ac32350
Improve name:latin logic (#147) 
* name:latin improvements

* improve latin letter regex

* allow region codes and x-extension's on localized names
 2022-03-25 05:39:12 -04:00
Mike Barry 724c451f5c fix hasTag variants 2022-03-23 05:37:20 -04:00
Michael Barry e20b41c88d
Offload multipolygon storage to disk (reduce memory usage by 10-15gb) (#141) 2022-03-22 20:34:54 -04:00
Michael Barry 313a695abb
Handle more than one centerline for a lake (#139) 2022-03-19 15:16:11 -04:00
Michael Barry bf081692ce
Node location cache: off-heap storage and “array” implementation that supports parallel inserts (#131) 
* Add --nodemap-type=array option for 2-3x faster osm pass 1 imports
* Add --nodemap-storage=direct option to experiment with direct (off-heap) memory usage
* Extract ResourceUsage and OsmPhaser utilities
 2022-03-19 05:46:03 -04:00