rserver:
cd ~/openmaptiles/localpython
source bin/activate
opal4:
cd ~/openmaptiles/vmpython
source bin/activate
1) download planet.xxx.pbf from osu or other usa mirror
cd ~... data
./crop_to_conus.sh
which is:
#!/bin/bash -x
# left: -126.30
# bottom: 23.24
# right: -64.86
# top: 50.01
~/openmaptiles/pkgs/osmctools/src/osmconvert planet-latest.osm.pbf -b=-126.30,23.24,-64.86,50.01 -o=conus.osm.pbf
setup & create d.b.
source ~/pglocal.sh
psql
# create database openmapconus;
CREATE DATABASE
\q
then:
psql openmapconus
create extension postgis;
create extension hstore;
create extension fuzzystrmatch;
create extension unaccent;
create extension osml10n;
create extension gzip;
grant all privileges on database openmapconus to tiles;
and the d.b. looks like this when new & empty:
$ psql openmapconus
openmapconus=# \d
List of relations
Schema | Name | Type | Owner
--------+-------------------+-------+---------
public | country_languages | table | wturner
public | country_osm_grid | table | wturner
public | geography_columns | view | wturner
public | geometry_columns | view | wturner
public | raster_columns | view | wturner
public | raster_overviews | view | wturner
public | spatial_ref_sys | table | wturner
(7 rows)
openmapconus=# \l+ openmapconus
List of databases
Name | Owner | Ctype | Access privileges | Size |
--------------+---------+-------------+---------------------+---------+
openmapconus | wturner | en_US.UTF-8 | =Tc/wturner +| 67 MB |
| | | wturner=CTc/wturner+| |
| | | tiles=CTc/wturner | |
USING terminal window within rstudio to rserver:
vim config/env.config
POSTGRES_DB=openmapconus
vim load_conus.sh
PBF=conus.osm.pbf
~/openmaptiles/pg_pkgs/openmaptiles-tools/bin/generate-imposm3 $LAYER_FILE > $IMPOSM3_MAPPING
vim config/generated/imposm.json
"connection": "postgis://tiles:opentiles@localhost:5432/openmaptiles",
export PGDATABASE=openmapconus
export POSTGRES_DB=openmapconus
here goes (third time):
./load_conus.sh
====> : Start importing Planet OpenStreetMap data: data/conus.osm.pbf -> imposm3[./config/mapping.yaml] -> PostgreSQL
Importing in diff mode
+ tools/imposm3/bin/imposm import -config /home/wturner/openmaptiles/wdb-map-gen/config/generated/imposm.json -overwritecache -read data/conus.osm.pbf -deployproduction -write -diff
[2021-10-09T18:10:03Z] 0:00:00 [info] removing existing cache /home/wturner/openmaptiles/wdb-map-gen/data/imposm3_cache
[2021-10-09T18:10:05Z] 0:00:02 [step] Starting: Imposm
[2021-10-09T18:10:05Z] 0:00:02 [step] Starting: Reading OSM data
[2021-10-09T18:10:05Z] 0:00:02 [info] reading data/conus.osm.pbf with data till 2021-09-05 23:59:59 +0000 UTC
[2021-10-09T18:11:05Z] 0:01:02 [progress] 1m0s C: 3090000/s (180182142) N: 16500/s (974429) W: 0/s (0) R: 0/s (0)
[2021-10-09T18:12:05Z] 0:02:02 [progress] 2m0s C: 2517000/s (297806426) N: 21400/s (2549657) W: 0/s (0) R: 0/s (0)
[2021-10-09T18:13:05Z] 0:03:02 [progress] 3m0s C: 2331000/s (415755907) N: 23300/s (4170288) W: 0/s (0) R: 0/s (0)
[2021-10-09T18:14:05Z] 0:04:02 [progress] 4m0s C: 2475000/s (589876593) N: 26200/s (6265218) W: 0/s (0) R: 0/s (0)
[2021-10-09T18:15:05Z] 0:05:02 [progress] 5m0s C: 2574000/s (767972010) N: 25400/s (7604361) W: 0/s (0) R: 0/s (0)
[2021-10-09T18:16:05Z] 0:06:02 [progress] 6m0s C: 2653000/s (950654594) N: 28400/s (10223902) W: 0/s (0) R: 0/s (0)
[2021-10-09T18:17:05Z] 0:07:02 [progress] 7m0s C: 2739000/s (1145770354) N: 37900/s (15917723) W: 0/s (0) R: 0/s (0)
[2021-10-09T18:18:05Z] 0:08:02 [progress] 8m0s C: 2444000/s (1169158428) N: 33400/s (16032687) W: 288500/s (15089032) R: 0/s (0)
[2021-10-09T18:19:05Z] 0:09:02 [progress] 9m0s C: 2444000/s (1169158428) N: 33400/s (16032687) W: 281900/s (31660323) R: 0/s (0)
[2021-10-09T18:20:05Z] 0:10:02 [progress] 10m0s C: 2444000/s (1169158428) N: 33400/s (16032687) W: 292100/s (50345468) R: 0/s (0)
[2021-10-09T18:21:05Z] 0:11:02 [progress] 11m0s C: 2444000/s (1169158428) N: 33400/s (16032687) W: 290300/s (67460195) R: 0/s (0)
[2021-10-09T18:22:05Z] 0:12:02 [progress] 12m0s C: 2444000/s (1169158428) N: 33400/s (16032687) W: 299300/s (87513722) R: 0/s (0)
[2021-10-09T18:23:05Z] 0:13:02 [progress] 13m0s C: 2444000/s (1169158428) N: 33400/s (16032687) W: 308900/s (108843293) R: 535950/s (154639)
[2021-10-09T18:23:07Z] 0:13:04 [progress] 13m2s C: 2444000/s (1169158428) N: 33400/s (16032687) W: 308900/s (108843293) R: 2137930/s (616860)
[2021-10-09T18:23:07Z] 0:13:04 [step] Finished: Reading OSM data in 13m2.172610177s
[2021-10-09T18:23:08Z] 0:13:05 [step] Starting: Importing OSM data
[2021-10-09T18:23:08Z] 0:13:05 [step] Starting: Writing OSM data
[2021-10-09T18:24:08Z] 0:14:05 [progress] 1m0s C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 0/s ( 0.0%) R: 410/s ( 3.8%)
[2021-10-09T18:25:08Z] 0:15:05 [progress] 2m0s C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 0/s ( 0.0%) R: 330/s ( 6.3%)
...
[2021-10-09T18:40:08Z] 0:30:05 [progress] 17m0s C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 0/s ( 0.0%) R: 590/s (97.3%)
[2021-10-09T18:41:08Z] 0:31:05 [progress] 18m0s C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 5400/s ( 0.2%) R: 570/s (100.0%)
[2021-10-09T18:42:08Z] 0:32:05 [progress] 19m0s C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 6500/s ( 0.6%) R: 570/s (100.0%)
[2021-10-09T18:43:08Z] 0:33:05 [progress] 20m0s C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 8100/s ( 1.2%) R: 570/s (100.0%)
[2021-10-09T18:44:08Z] 0:34:05 [progress] 21m0s C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 9600/s ( 1.9%) R: 570/s (100.0%)
[2021-10-09T18:45:08Z] 0:35:05 [progress] 22m0s C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 10800/s ( 2.8%) R: 570/s (100.0%)
...
[2021-10-09T19:56:08Z] 1:46:05 [progress] 1h33m0s C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 11900/s (49.7%) R: 570/s (100.0%)
[2021-10-09T19:57:08Z] 1:47:05 [progress] 1h34m0s C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 11800/s (50.2%) R: 570/s (100.0%)
[2021-10-09T19:58:08Z] 1:48:05 [progress] 1h35m0s C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 11900/s (51.2%) R: 570/s (100.0%)
[2021-10-09T20:30:08Z] 2:20:05 [progress] 2h7m0s C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 12200/s (73.9%) R: 570/s (100.0%)
[2021-10-09T20:31:08Z] 2:21:05 [progress] 2h8m0s C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 12200/s (74.5%) R: 570/s (100.0%)
[2021-10-09T20:32:08Z] 2:22:05 [progress] 2h9m0s C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 12200/s (75.3%) R: 570/s (100.0%)
[2021-10-09T21:03:08Z] 2:53:05 [progress] 2h40m0s C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 12400/s (97.9%) R: 570/s (100.0%)
[2021-10-09T21:04:08Z] 2:54:05 [progress] 2h41m0s C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 12400/s (98.4%) R: 570/s (100.0%)
[2021-10-09T21:05:08Z] 2:55:05 [progress] 2h42m0s C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 12400/s (99.1%) R: 570/s (100.0%)
[2021-10-09T21:06:08Z] 2:56:05 [progress] 2h43m0s C: 0/s ( 0.0%) N: 0/s ( 0.0%) W: 12400/s (99.9%) R: 570/s (100.0%)
[2021-10-09T21:07:08Z] 2:57:05 [progress] 2h44m0s C: 0/s ( 0.0%) N: 123100/s (39.2%) W: 12300/s (100.0%) R: 570/s (100.0%)
[2021-10-09T21:08:08Z] 2:58:05 [progress] 2h45m0s C: 0/s ( 0.0%) N: 121600/s (84.1%) W: 12300/s (100.0%) R: 570/s (100.0%)
[2021-10-09T21:08:27Z] 2:58:23 [progress] 2h45m18s C: 0/s ( 0.0%) N: 144500/s (100.0%) W: 12300/s (100.0%) R: 570/s (100.0%)
[2021-10-09T21:08:28Z] 2:58:25 [step] Finished: Writing OSM data in 2h45m20.469651366s
[2021-10-09T21:08:28Z] 2:58:25 [step] Starting: Creating generalized tables
[2021-10-09T21:08:28Z] 2:58:25 [step] Starting: Generalizing osm_park_polygon into osm_park_polygon_gen_z13
[2021-10-09T21:08:28Z] 2:58:25 [step] Starting: Generalizing osm_landuse_polygon into osm_landuse_polygon_gen_z13
[2021-10-09T21:08:28Z] 2:58:25 [step] Starting: Generalizing osm_aerialway_linestring into osm_aerialway_linestring_gen_z12
[2021-10-09T21:08:28Z] 2:58:25 [step] Starting: Generalizing osm_aeroway_polygon into osm_aeroway_polygon_gen_z13
[2021-10-09T21:08:29Z] 2:58:25 [step] Finished: Generalizing osm_aerialway_linestring into osm_aerialway_linestring_gen_z12 in 72.194458ms
[2021-10-09T21:08:29Z] 2:58:25 [step] Starting: Generalizing osm_water_polygon into osm_water_polygon_gen_z11
[2021-10-09T21:08:30Z] 2:58:27 [step] Finished: Generalizing osm_aeroway_polygon into osm_aeroway_polygon_gen_z13 in 1.871532222s
[2021-10-09T21:08:30Z] 2:58:27 [step] Starting: Generalizing osm_railway_linestring into osm_railway_linestring_gen_z12
[2021-10-09T21:08:40Z] 2:58:37 [step] Finished: Generalizing osm_railway_linestring into osm_railway_linestring_gen_z12 in 9.380720547s
[2021-10-09T21:08:40Z] 2:58:37 [step] Starting: Generalizing osm_highway_linestring into osm_highway_linestring_gen_z11
[2021-10-09T21:09:32Z] 2:59:29 [step] Finished: Generalizing osm_park_polygon into osm_park_polygon_gen_z13 in 1m3.299320936s
[2021-10-09T21:09:32Z] 2:59:29 [step] Starting: Generalizing osm_shipway_linestring into osm_shipway_linestring_gen_z12
[2021-10-09T21:09:32Z] 2:59:29 [step] Finished: Generalizing osm_shipway_linestring into osm_shipway_linestring_gen_z12 in 289.903714ms
[2021-10-09T21:09:32Z] 2:59:29 [step] Starting: Generalizing osm_border_disp_relation into osm_border_disp_linestring
[2021-10-09T21:09:32Z] 2:59:29 [step] Finished: Generalizing osm_border_disp_relation into osm_border_disp_linestring in 72.791081ms
[2021-10-09T21:09:32Z] 2:59:29 [step] Starting: Generalizing osm_aeroway_linestring into osm_aeroway_linestring_gen_z12
[2021-10-09T21:09:34Z] 2:59:31 [step] Finished: Generalizing osm_aeroway_linestring into osm_aeroway_linestring_gen_z12 in 2.176999242s
[2021-10-09T21:10:24Z] 3:00:21 [step] Finished: Generalizing osm_landuse_polygon into osm_landuse_polygon_gen_z13 in 1m55.850123352s
[2021-10-09T21:11:38Z] 3:01:35 [step] Finished: Generalizing osm_highway_linestring into osm_highway_linestring_gen_z11 in 2m58.281267049s
[2021-10-09T21:17:23Z] 3:07:20 [step] Finished: Generalizing osm_water_polygon into osm_water_polygon_gen_z11 in 8m54.760873011s
[2021-10-09T21:17:23Z] 3:07:20 [step] Starting: Generalizing osm_aeroway_polygon into osm_aeroway_polygon_gen_z12
[2021-10-09T21:17:23Z] 3:07:20 [step] Starting: Generalizing osm_shipway_linestring into osm_shipway_linestring_gen_z11
[2021-10-09T21:17:23Z] 3:07:20 [step] Starting: Generalizing osm_park_polygon into osm_park_polygon_gen_z12
[2021-10-09T21:17:23Z] 3:07:20 [step] Starting: Generalizing osm_highway_linestring into osm_highway_linestring_gen_z10
[2021-10-09T21:17:23Z] 3:07:20 [step] Finished: Generalizing osm_shipway_linestring into osm_shipway_linestring_gen_z11 in 41.714205ms
[2021-10-09T21:17:23Z] 3:07:20 [step] Starting: Generalizing osm_railway_linestring into osm_railway_linestring_gen_z11
[2021-10-09T21:17:24Z] 3:07:21 [step] Finished: Generalizing osm_aeroway_polygon into osm_aeroway_polygon_gen_z12 in 633.502754ms
[2021-10-09T21:17:24Z] 3:07:21 [step] Starting: Generalizing osm_border_disp_relation into osm_border_disp_linestring_gen_z13
[2021-10-09T21:17:24Z] 3:07:21 [step] Finished: Generalizing osm_border_disp_relation into osm_border_disp_linestring_gen_z13 in 12.926885ms
[2021-10-09T21:17:24Z] 3:07:21 [step] Starting: Generalizing osm_water_polygon into osm_water_polygon_gen_z10
[2021-10-09T21:17:28Z] 3:07:25 [step] Finished: Generalizing osm_railway_linestring into osm_railway_linestring_gen_z11 in 4.271254434s
[2021-10-09T21:17:28Z] 3:07:25 [step] Starting: Generalizing osm_landuse_polygon into osm_landuse_polygon_gen_z12
[2021-10-09T21:17:52Z] 3:07:49 [step] Finished: Generalizing osm_park_polygon into osm_park_polygon_gen_z12 in 29.087817565s
[2021-10-09T21:17:52Z] 3:07:49 [step] Starting: Generalizing osm_aeroway_linestring into osm_aeroway_linestring_gen_z11
[2021-10-09T21:17:53Z] 3:07:50 [step] Finished: Generalizing osm_aeroway_linestring into osm_aeroway_linestring_gen_z11 in 1.028963749s
[2021-10-09T21:17:55Z] 3:07:52 [step] Finished: Generalizing osm_highway_linestring into osm_highway_linestring_gen_z10 in 31.545143789s
[2021-10-09T21:18:12Z] 3:08:09 [step] Finished: Generalizing osm_landuse_polygon into osm_landuse_polygon_gen_z12 in 44.462122525s
[2021-10-09T21:20:39Z] 3:10:35 [step] Finished: Generalizing osm_water_polygon into osm_water_polygon_gen_z10 in 3m14.557001975s
[2021-10-09T21:20:39Z] 3:10:35 [step] Starting: Generalizing osm_park_polygon into osm_park_polygon_gen_z11
[2021-10-09T21:20:39Z] 3:10:35 [step] Starting: Generalizing osm_landuse_polygon into osm_landuse_polygon_gen_z11
[2021-10-09T21:20:39Z] 3:10:35 [step] Starting: Generalizing osm_aeroway_linestring into osm_aeroway_linestring_gen_z10
[2021-10-09T21:20:39Z] 3:10:35 [step] Starting: Generalizing osm_water_polygon into osm_water_polygon_gen_z9
[2021-10-09T21:20:40Z] 3:10:37 [step] Finished: Generalizing osm_aeroway_linestring into osm_aeroway_linestring_gen_z10 in 1.073170561s
[2021-10-09T21:20:40Z] 3:10:37 [step] Starting: Generalizing osm_highway_linestring into osm_highway_linestring_gen_z9
[2021-10-09T21:21:08Z] 3:11:05 [step] Finished: Generalizing osm_park_polygon into osm_park_polygon_gen_z11 in 29.761569416s
[2021-10-09T21:21:08Z] 3:11:05 [step] Starting: Generalizing osm_railway_linestring into osm_railway_linestring_gen_z10
[2021-10-09T21:21:13Z] 3:11:10 [step] Finished: Generalizing osm_railway_linestring into osm_railway_linestring_gen_z10 in 4.774995817s
[2021-10-09T21:21:13Z] 3:11:10 [step] Starting: Generalizing osm_aeroway_polygon into osm_aeroway_polygon_gen_z11
[2021-10-09T21:21:14Z] 3:11:11 [step] Finished: Generalizing osm_aeroway_polygon into osm_aeroway_polygon_gen_z11 in 609.748125ms
[2021-10-09T21:21:14Z] 3:11:11 [step] Starting: Generalizing osm_border_disp_relation into osm_border_disp_linestring_gen_z12
[2021-10-09T21:21:14Z] 3:11:11 [step] Finished: Generalizing osm_border_disp_relation into osm_border_disp_linestring_gen_z12 in 84.623239ms
[2021-10-09T21:21:19Z] 3:11:15 [step] Finished: Generalizing osm_landuse_polygon into osm_landuse_polygon_gen_z11 in 40.027276553s
[2021-10-09T21:21:19Z] 3:11:16 [step] Finished: Generalizing osm_highway_linestring into osm_highway_linestring_gen_z9 in 39.237862217s
[2021-10-09T21:22:28Z] 3:12:25 [step] Finished: Generalizing osm_water_polygon into osm_water_polygon_gen_z9 in 1m49.674381632s
[2021-10-09T21:22:28Z] 3:12:25 [step] Starting: Generalizing osm_park_polygon into osm_park_polygon_gen_z10
[2021-10-09T21:22:28Z] 3:12:25 [step] Starting: Generalizing osm_aeroway_polygon into osm_aeroway_polygon_gen_z10
[2021-10-09T21:22:28Z] 3:12:25 [step] Starting: Generalizing osm_railway_linestring into osm_railway_linestring_gen_z9
[2021-10-09T21:22:28Z] 3:12:25 [step] Starting: Generalizing osm_landuse_polygon into osm_landuse_polygon_gen_z10
[2021-10-09T21:22:28Z] 3:12:25 [step] Finished: Generalizing osm_aeroway_polygon into osm_aeroway_polygon_gen_z10 in 275.979489ms
[2021-10-09T21:22:28Z] 3:12:25 [step] Starting: Generalizing osm_border_disp_relation into osm_border_disp_linestring_gen_z11
[2021-10-09T21:22:29Z] 3:12:25 [step] Finished: Generalizing osm_border_disp_relation into osm_border_disp_linestring_gen_z11 in 50.216353ms
[2021-10-09T21:22:29Z] 3:12:25 [step] Starting: Generalizing osm_water_polygon into osm_water_polygon_gen_z8
[2021-10-09T21:22:31Z] 3:12:28 [step] Finished: Generalizing osm_railway_linestring into osm_railway_linestring_gen_z9 in 2.686464567s
[2021-10-09T21:22:37Z] 3:12:34 [step] Finished: Generalizing osm_landuse_polygon into osm_landuse_polygon_gen_z10 in 8.600932284s
[2021-10-09T21:22:46Z] 3:12:43 [step] Finished: Generalizing osm_park_polygon into osm_park_polygon_gen_z10 in 17.947292648s
[2021-10-09T21:23:24Z] 3:13:21 [step] Finished: Generalizing osm_water_polygon into osm_water_polygon_gen_z8 in 55.511669604s
[2021-10-09T21:23:24Z] 3:13:21 [step] Starting: Generalizing osm_water_polygon into osm_water_polygon_gen_z7
[2021-10-09T21:23:24Z] 3:13:21 [step] Starting: Generalizing osm_landuse_polygon into osm_landuse_polygon_gen_z9
[2021-10-09T21:23:24Z] 3:13:21 [step] Starting: Generalizing osm_border_disp_relation into osm_border_disp_linestring_gen_z10
[2021-10-09T21:23:24Z] 3:13:21 [step] Starting: Generalizing osm_park_polygon into osm_park_polygon_gen_z9
[2021-10-09T21:23:24Z] 3:13:21 [step] Finished: Generalizing osm_border_disp_relation into osm_border_disp_linestring_gen_z10 in 86.953134ms
[2021-10-09T21:23:24Z] 3:13:21 [step] Starting: Generalizing osm_railway_linestring into osm_railway_linestring_gen_z8
[2021-10-09T21:23:27Z] 3:13:24 [step] Finished: Generalizing osm_railway_linestring into osm_railway_linestring_gen_z8 in 2.695877279s
[2021-10-09T21:23:27Z] 3:13:24 [step] Finished: Generalizing osm_landuse_polygon into osm_landuse_polygon_gen_z9 in 2.968948032s
[2021-10-09T21:24:20Z] 3:14:17 [step] Finished: Generalizing osm_border_disp_relation into osm_border_disp_linestring_gen_z1 in 4.862859ms
[2021-10-09T21:24:20Z] 3:14:17 [step] Finished: Creating generalized tables in 15m51.876825165s
[2021-10-09T21:24:20Z] 3:14:17 [step] Starting: Creating geometry indices
[2021-10-09T21:24:20Z] 3:14:17 [step] Starting: Creating geometry index on osm_city_point
[2021-10-09T21:24:20Z] 3:14:17 [step] Starting: Creating geometry index on osm_border_disp_relation
[2021-10-09T21:24:20Z] 3:14:17 [step] Starting: Creating geometry index on osm_aerialway_linestring
[2021-10-09T21:24:20Z] 3:14:17 [step] Starting: Creating geometry index on osm_shipway_linestring
[2021-10-09T21:24:20Z] 3:14:17 [step] Finished: Creating geometry index on osm_border_disp_relation in 13.476899ms
[2021-10-09T21:24:20Z] 3:14:17 [step] Starting: Creating geometry index on osm_marine_point
[2021-10-09T21:24:20Z] 3:14:17 [step] Finished: Creating geometry index on osm_shipway_linestring in 15.520279ms
[2021-10-09T21:24:20Z] 3:14:17 [step] Starting: Creating geometry index on osm_highway_polygon
[2021-10-09T21:24:20Z] 3:14:17 [step] Finished: Creating geometry index on osm_aerialway_linestring in 28.239464ms
[2021-10-09T21:24:20Z] 3:14:17 [step] Starting: Creating geometry index on osm_waterway_linestring
[2021-10-09T21:24:20Z] 3:14:17 [step] Finished: Creating geometry index on osm_marine_point in 15.445571ms
[2021-10-09T21:24:20Z] 3:14:17 [step] Starting: Creating geometry index on osm_railway_linestring
[2021-10-09T21:24:24Z] 3:14:21 [step] Finished: Creating geometry index on osm_highway_polygon in 3.266193888s
[2021-10-09T21:24:24Z] 3:14:21 [step] Starting: Creating geometry index on osm_landuse_polygon
[2021-10-09T21:24:24Z] 3:14:21 [step] Finished: Creating geometry index on osm_city_point in 4.126744097s
[2021-10-09T21:24:24Z] 3:14:21 [step] Starting: Creating geometry index on osm_continent_point
[2021-10-09T21:24:24Z] 3:14:21 [step] Finished: Creating geometry index on osm_continent_point in 10.604987ms
[2021-10-09T21:24:24Z] 3:14:21 [step] Starting: Creating geometry index on osm_park_polygon
[2021-10-09T21:24:25Z] 3:14:22 [step] Finished: Creating geometry index on osm_park_polygon in 675.324196ms
[2021-10-09T21:24:25Z] 3:14:22 [step] Starting: Creating geometry index on osm_building_polygon
[2021-10-09T21:24:28Z] 3:14:25 [step] Finished: Creating geometry index on osm_railway_linestring in 7.850963677s
[2021-10-09T21:24:28Z] 3:14:25 [step] Starting: Creating geometry index on osm_country_point
[2021-10-09T21:24:28Z] 3:14:25 [step] Finished: Creating geometry index on osm_country_point in 31.723984ms
[2021-10-09T21:24:28Z] 3:14:25 [step] Starting: Creating geometry index on osm_state_point
[2021-10-09T21:24:28Z] 3:14:25 [step] Finished: Creating geometry index on osm_state_point in 34.752725ms
[2021-10-09T21:24:28Z] 3:14:25 [step] Starting: Creating geometry index on osm_aerodrome_label_point
[2021-10-09T21:24:29Z] 3:14:25 [step] Finished: Creating geometry index on osm_aerodrome_label_point in 205.341641ms
[2021-10-09T21:24:29Z] 3:14:25 [step] Starting: Creating geometry index on osm_highway_linestring
[2021-10-09T21:25:01Z] 3:14:58 [step] Finished: Creating geometry index on osm_landuse_polygon in 37.775864691s
[2021-10-09T21:25:01Z] 3:14:58 [step] Starting: Creating geometry index on osm_poi_polygon
[2021-10-09T21:33:31Z] 3:23:27 [step] Starting: Creating geometry index on osm_aeroway_polygon_gen_z10
[2021-10-09T21:33:31Z] 3:23:27 [step] Finished: Creating geometry index on osm_aeroway_polygon_gen_z10 in 35.808958ms
[2021-10-09T21:33:31Z] 3:23:27 [step] Starting: Creating OSM id index on osm_border_disp_linestring_gen_z3
[2021-10-09T21:33:31Z] 3:23:28 [step] Finished: Creating OSM id index on osm_border_disp_linestring_gen_z3 in 59.97803ms
[2021-10-09T21:33:31Z] 3:23:28 [step] Starting: Creating OSM id index on osm_border_disp_linestring_gen_z3
[2021-10-09T21:33:31Z] 3:23:28 [step] Finished: Creating OSM id index on osm_border_disp_linestring_gen_z3 in 58.466125ms
[2021-10-09T21:33:31Z] 3:23:28 [step] Starting: Creating geometry index on osm_border_disp_linestring_gen_z3
[2021-10-09T21:33:31Z] 3:23:28 [step] Finished: Creating geometry index on osm_border_disp_linestring_gen_z3 in 16.21583ms
[2021-10-09T21:37:55Z] 3:27:52 [step] Finished: Creating geometry index on osm_housenumber_point in 10m20.638242446s
[2021-10-09T21:43:41Z] 3:33:38 [info] Rotating osm_aeroway_linestring_gen_z12 from import -> public -> backup
[2021-10-09T21:43:41Z] 3:33:38 [info] Rotating osm_water_polygon_gen_z10 from import -> public -> backup
[2021-10-09T21:43:41Z] 3:33:38 [info] Rotating osm_landuse_polygon_gen_z12 from import -> public -> backup
[2021-10-09T21:43:41Z] 3:33:38 [info] Rotating osm_park_polygon_gen_z10 from import -> public -> backup
[2021-10-09T21:43:41Z] 3:33:38 [step] Finished: Rotating tables in 213.823217ms
[2021-10-09T21:43:41Z] 3:33:38 [step] Finished: Imposm in 3h33m35.784634102s
+ set +x
====> : End importing Planet OpenStreetMap data: data/conus.osm.pbf -> imposm3[./config/mapping.yaml] -> PostgreSQL
elapsed time approx: 3h 15m
openmapconus=# \l+ openmapconus
List of databases
Name | Owner | Encoding | Collate | Ctype | Access privileges | Size | Tablespace | Description
--------------+---------+----------+-------------+-------------+---------------------+-------+------------+-------------
openmapconus | wturner | UTF8 | en_US.UTF-8 | en_US.UTF-8 | =Tc/wturner +| 56 GB | pg_default |
| | | | | wturner=CTc/wturner+| | |
| | | | | tiles=CTc/wturner | | |
(1 row)
and tables are:
openmapconus=# \d
List of relations
Schema | Name | Type | Owner
--------+------------------------------------+----------+---------
public | country_languages | table | wturner
public | country_osm_grid | table | wturner
public | geography_columns | view | wturner
public | geometry_columns | view | wturner
public | osm_aerialway_linestring | table | tiles
public | osm_aerialway_linestring_gen_z12 | table | tiles
public | osm_aerialway_linestring_id_seq | sequence | tiles
public | osm_aerodrome_label_point | table | tiles
public | osm_aerodrome_label_point_id_seq | sequence | tiles
public | osm_aeroway_linestring | table | tiles
public | osm_aeroway_linestring_gen_z10 | table | tiles
public | osm_aeroway_linestring_gen_z11 | table | tiles
public | osm_aeroway_linestring_gen_z12 | table | tiles
public | osm_aeroway_linestring_id_seq | sequence | tiles
public | osm_aeroway_point | table | tiles
public | osm_aeroway_point_id_seq | sequence | tiles
public | osm_aeroway_polygon | table | tiles
public | osm_aeroway_polygon_gen_z10 | table | tiles
public | osm_aeroway_polygon_gen_z11 | table | tiles
public | osm_aeroway_polygon_gen_z12 | table | tiles
public | osm_aeroway_polygon_gen_z13 | table | tiles
public | osm_aeroway_polygon_id_seq | sequence | tiles
public | osm_border_disp_linestring | table | tiles
public | osm_border_disp_linestring_gen_z1 | table | tiles
public | osm_border_disp_linestring_gen_z10 | table | tiles
public | osm_border_disp_linestring_gen_z11 | table | tiles
public | osm_border_disp_linestring_gen_z12 | table | tiles
public | osm_border_disp_linestring_gen_z13 | table | tiles
public | osm_border_disp_linestring_gen_z2 | table | tiles
public | osm_border_disp_linestring_gen_z3 | table | tiles
public | osm_border_disp_linestring_gen_z4 | table | tiles
public | osm_border_disp_linestring_gen_z5 | table | tiles
public | osm_border_disp_linestring_gen_z6 | table | tiles
public | osm_border_disp_linestring_gen_z7 | table | tiles
public | osm_border_disp_linestring_gen_z8 | table | tiles
public | osm_border_disp_linestring_gen_z9 | table | tiles
public | osm_border_disp_relation | table | tiles
public | osm_border_disp_relation_id_seq | sequence | tiles
public | osm_building_polygon | table | tiles
public | osm_building_polygon_id_seq | sequence | tiles
public | osm_building_relation | table | tiles
public | osm_building_relation_id_seq | sequence | tiles
public | osm_city_point | table | tiles
public | osm_city_point_id_seq | sequence | tiles
public | osm_continent_point | table | tiles
public | osm_continent_point_id_seq | sequence | tiles
public | osm_country_point | table | tiles
public | osm_country_point_id_seq | sequence | tiles
public | osm_highway_linestring | table | tiles
public | osm_highway_linestring_gen_z10 | table | tiles
public | osm_highway_linestring_gen_z11 | table | tiles
public | osm_highway_linestring_gen_z9 | table | tiles
public | osm_highway_linestring_id_seq | sequence | tiles
public | osm_highway_polygon | table | tiles
public | osm_highway_polygon_id_seq | sequence | tiles
public | osm_housenumber_point | table | tiles
public | osm_housenumber_point_id_seq | sequence | tiles
public | osm_island_point | table | tiles
public | osm_island_point_id_seq | sequence | tiles
public | osm_island_polygon | table | tiles
public | osm_island_polygon_id_seq | sequence | tiles
public | osm_landcover_polygon | table | tiles
public | osm_landcover_polygon_id_seq | sequence | tiles
public | osm_landuse_polygon | table | tiles
public | osm_landuse_polygon_gen_z10 | table | tiles
public | osm_landuse_polygon_gen_z11 | table | tiles
public | osm_landuse_polygon_gen_z12 | table | tiles
public | osm_landuse_polygon_gen_z13 | table | tiles
public | osm_landuse_polygon_gen_z6 | table | tiles
public | osm_landuse_polygon_gen_z7 | table | tiles
public | osm_landuse_polygon_gen_z8 | table | tiles
public | osm_landuse_polygon_gen_z9 | table | tiles
public | osm_landuse_polygon_id_seq | sequence | tiles
public | osm_marine_point | table | tiles
public | osm_marine_point_id_seq | sequence | tiles
public | osm_park_polygon | table | tiles
public | osm_park_polygon_gen_z10 | table | tiles
public | osm_park_polygon_gen_z11 | table | tiles
public | osm_park_polygon_gen_z12 | table | tiles
public | osm_park_polygon_gen_z13 | table | tiles
public | osm_park_polygon_gen_z6 | table | tiles
public | osm_park_polygon_gen_z7 | table | tiles
public | osm_park_polygon_gen_z8 | table | tiles
public | osm_park_polygon_gen_z9 | table | tiles
public | osm_park_polygon_id_seq | sequence | tiles
public | osm_peak_point | table | tiles
public | osm_peak_point_id_seq | sequence | tiles
public | osm_poi_point | table | tiles
public | osm_poi_point_id_seq | sequence | tiles
public | osm_poi_polygon | table | tiles
public | osm_poi_polygon_id_seq | sequence | tiles
public | osm_railway_linestring | table | tiles
public | osm_railway_linestring_gen_z10 | table | tiles
public | osm_railway_linestring_gen_z11 | table | tiles
public | osm_railway_linestring_gen_z12 | table | tiles
public | osm_railway_linestring_gen_z8 | table | tiles
public | osm_railway_linestring_gen_z9 | table | tiles
public | osm_railway_linestring_id_seq | sequence | tiles
public | osm_route_member | table | tiles
public | osm_route_member_id_seq | sequence | tiles
public | osm_shipway_linestring | table | tiles
public | osm_shipway_linestring_gen_z11 | table | tiles
public | osm_shipway_linestring_gen_z12 | table | tiles
public | osm_shipway_linestring_id_seq | sequence | tiles
public | osm_state_point | table | tiles
public | osm_state_point_id_seq | sequence | tiles
public | osm_water_polygon | table | tiles
public | osm_water_polygon_gen_z10 | table | tiles
public | osm_water_polygon_gen_z11 | table | tiles
public | osm_water_polygon_gen_z6 | table | tiles
public | osm_water_polygon_gen_z7 | table | tiles
public | osm_water_polygon_gen_z8 | table | tiles
public | osm_water_polygon_gen_z9 | table | tiles
public | osm_water_polygon_id_seq | sequence | tiles
public | osm_waterway_linestring | table | tiles
public | osm_waterway_linestring_id_seq | sequence | tiles
public | raster_columns | view | wturner
public | raster_overviews | view | wturner
public | spatial_ref_sys | table | wturner
(119 rows)
and:
$ df -h
Filesystem Size Used Avail Use% Mounted on
devtmpfs 32G 0 32G 0% /dev
/dev/mapper/crypt_home 660G 460G 201G 70% /home
/dev/mapper/crypt_tmp 10G 458M 9.6G 5% /tmp
sizes: - d.b. on rserver: 56G - pg_dump file: 22G
times: - pg_dump: 20 mins - scp: 15mins - pg_restore: 20 mins
PROBLEMS:
possible issues:
1) load_sql on opal4
cd openmaptiles/vmpython
source bin/activate
cd ../wdb-map-gen
source ~/pgmine.sh
vim config/env.config
POSTGRES_USER=wendell
./load_sql.sh
psql:/home/wendell/openmaptiles/wdb-map-gen/data/sql/tileset.sql:189: ERROR: relation "ne_10m_ocean" does not exist
LINE 8: FROM ne_10m_ocean
^
psql:/home/wendell/openmaptiles/wdb-map-gen/data/sql/tileset.sql:190: ERROR: relation "ne_10m_ocean_gen_z5" does not exist
psql:/home/wendell/openmaptiles/wdb-map-gen/data/sql/tileset.sql:554: ERROR: relation "osm_ocean_polygon_gen_z10" does not exist
LINE 9: FROM osm_ocean_polygon_gen_z10
^
psql:/home/wendell/openmaptiles/wdb-map-gen/data/sql/tileset.sql:574: ERROR: relation "osm_ocean_polygon_gen_z11" does not exist
LINE 9: FROM osm_ocean_polygon_gen_z11
^
2) load_sql on rserver (AFTER ne step (next one)
vim load_sql.sh
#wt:
~/openmaptiles/pg_pkgs/openmaptiles-tools/bin/generate-sql $LAYER_FILE > $SQL_DIR/tileset.sql
Mon am:
TODO:
create_border.sh BUT using conus...pbf instead of planet...pbf
on RSERVER:
(localpython) $ export PATH=/home/wturner/local/bin:$PATH
(localpython) $ vim create_border_conus_csv.sh
FULL_PBF=$EXPORT_DIR/conus.osm.pbf
OSMB_PBF=$EXPORT_DIR/osmborder_lines_conus.pbf
OSMB_CSV=$EXPORT_DIR/osmborder_lines_conus.csv
to create:
(localpython) [wturner@acy_test_app_vm_rserver wdb-map-gen]$ ./create_border_conus_csv.sh
====> : Creating border data from planet PBF
====> : Filtering border from PBF /home/wturner/openmaptiles/wdb-map-gen/data/conus.osm.pbf to /home/wturner/openmaptiles/wdb-map-gen/data/osmb order_lines_conus.pbf
osmborder -o /home/wturner/openmaptiles/wdb-map-gen/data/osmborder_lines_conus.csv /home/wturner/openmaptiles/wdb-map-gen/data/osmborder_lines_conus.pbf
terminate called after throwing an instance of 'osmium::not_found'
what(): location for one or more nodes not found in node location index
./create_border_conus_csv.sh: line 30: 31178 Aborted osmborder -o $OSMB_CSV $OSMB_PBF
which is:
(localpython) [wturner@acy_test_app_vm_rserver wdb-map-gen]$ osmborder_filter -o /home/wturner/openmaptiles/wdb-map-gen/data/osmborder_lines_conus.pbf /home/wturner/openmaptiles/wdb-map-gen/data/conus.osm.pbf
(localpython) [wturner@acy_test_app_vm_rserver wdb-map-gen]$ osmborder -o /home/wturner/openmaptiles/wdb-map-gen/data/osmborder_lines_conus.csv /home/wturner/openmaptiles/wdb-map-gen/data/osmborder_lines_conus.pbf
terminate called after throwing an instance of 'osmium::not_found'
what(): location for one or more nodes not found in node location index
Aborted
the natural earth files are:
echo "====> : Extracting Natural Earth 10m, 50m, and 110m zip files to '$NE_EXTRACT'"
unzip -o $EXPORT_DIR/10m_physical.zip -d $NE_EXTRACT/10m_physical
unzip -o $EXPORT_DIR/10m_cultural.zip -d $NE_EXTRACT/10m_cultural
unzip -o $EXPORT_DIR/50m_physical.zip -d $NE_EXTRACT/50m_physical
unzip -o $EXPORT_DIR/50m_cultural.zip -d $NE_EXTRACT/50m_cultural
unzip -o $EXPORT_DIR/110m_physical.zip -d $NE_EXTRACT/110m_physical
unzip -o $EXPORT_DIR/110m_cultural.zip -d $NE_EXTRACT/110m_cultural
which are:
-rw-rw-r--. 1 wturner wturner 206707262 Mar 24 2021 10m_cultural.zip
-rw-rw-r--. 1 wturner wturner 47084438 Mar 24 2021 10m_physical.zip
-rw-rw-r--. 1 wturner wturner 1371230 Mar 24 2021 110m_cultural.zip
-rw-rw-r--. 1 wturner wturner 3473035 Mar 24 2021 110m_physical.zip
-rw-rw-r--. 1 wturner wturner 7960177 Mar 24 2021 50m_cultural.zip
-rw-rw-r--. 1 wturner wturner 7139618 Mar 24 2021 50m_physical.zip
d.b. openmapconus on rserver BEFORE load of natural earth
openmapconus=# \d
List of relations
Schema | Name | Type | Owner
--------+------------------------------------+----------+---------
public | country_languages | table | wturner
public | country_osm_grid | table | wturner
public | geography_columns | view | wturner
public | geometry_columns | view | wturner
public | osm_aerialway_linestring | table | tiles
public | osm_aerialway_linestring_gen_z12 | table | tiles
public | osm_aerialway_linestring_id_seq | sequence | tiles
public | osm_aerodrome_label_point | table | tiles
public | osm_aerodrome_label_point_id_seq | sequence | tiles
public | osm_aeroway_linestring | table | tiles
public | osm_aeroway_linestring_gen_z10 | table | tiles
public | osm_aeroway_linestring_gen_z11 | table | tiles
public | osm_aeroway_linestring_gen_z12 | table | tiles
public | osm_aeroway_linestring_id_seq | sequence | tiles
public | osm_aeroway_point | table | tiles
public | osm_aeroway_point_id_seq | sequence | tiles
public | osm_aeroway_polygon | table | tiles
public | osm_aeroway_polygon_gen_z10 | table | tiles
public | osm_aeroway_polygon_gen_z11 | table | tiles
public | osm_aeroway_polygon_gen_z12 | table | tiles
public | osm_aeroway_polygon_gen_z13 | table | tiles
public | osm_aeroway_polygon_id_seq | sequence | tiles
public | osm_border_disp_linestring | table | tiles
public | osm_border_disp_linestring_gen_z1 | table | tiles
public | osm_border_disp_linestring_gen_z10 | table | tiles
public | osm_border_disp_linestring_gen_z11 | table | tiles
public | osm_border_disp_linestring_gen_z12 | table | tiles
public | osm_border_disp_linestring_gen_z13 | table | tiles
public | osm_border_disp_linestring_gen_z2 | table | tiles
public | osm_border_disp_linestring_gen_z3 | table | tiles
public | osm_border_disp_linestring_gen_z4 | table | tiles
public | osm_border_disp_linestring_gen_z5 | table | tiles
public | osm_border_disp_linestring_gen_z6 | table | tiles
public | osm_border_disp_linestring_gen_z7 | table | tiles
public | osm_border_disp_linestring_gen_z8 | table | tiles
public | osm_border_disp_linestring_gen_z9 | table | tiles
public | osm_border_disp_relation | table | tiles
public | osm_border_disp_relation_id_seq | sequence | tiles
public | osm_building_polygon | table | tiles
public | osm_building_polygon_id_seq | sequence | tiles
public | osm_building_relation | table | tiles
public | osm_building_relation_id_seq | sequence | tiles
public | osm_city_point | table | tiles
public | osm_city_point_id_seq | sequence | tiles
public | osm_continent_point | table | tiles
public | osm_continent_point_id_seq | sequence | tiles
public | osm_country_point | table | tiles
public | osm_country_point_id_seq | sequence | tiles
public | osm_highway_linestring | table | tiles
public | osm_highway_linestring_gen_z10 | table | tiles
public | osm_highway_linestring_gen_z11 | table | tiles
public | osm_highway_linestring_gen_z9 | table | tiles
public | osm_highway_linestring_id_seq | sequence | tiles
public | osm_highway_polygon | table | tiles
public | osm_highway_polygon_id_seq | sequence | tiles
public | osm_housenumber_point | table | tiles
public | osm_housenumber_point_id_seq | sequence | tiles
public | osm_island_point | table | tiles
public | osm_island_point_id_seq | sequence | tiles
public | osm_island_polygon | table | tiles
public | osm_island_polygon_id_seq | sequence | tiles
public | osm_landcover_polygon | table | tiles
public | osm_landcover_polygon_id_seq | sequence | tiles
public | osm_landuse_polygon | table | tiles
public | osm_landuse_polygon_gen_z10 | table | tiles
public | osm_landuse_polygon_gen_z11 | table | tiles
public | osm_landuse_polygon_gen_z12 | table | tiles
public | osm_landuse_polygon_gen_z13 | table | tiles
public | osm_landuse_polygon_gen_z6 | table | tiles
public | osm_landuse_polygon_gen_z7 | table | tiles
public | osm_landuse_polygon_gen_z8 | table | tiles
public | osm_landuse_polygon_gen_z9 | table | tiles
public | osm_landuse_polygon_id_seq | sequence | tiles
public | osm_marine_point | table | tiles
public | osm_marine_point_id_seq | sequence | tiles
public | osm_park_polygon | table | tiles
public | osm_park_polygon_gen_z10 | table | tiles
public | osm_park_polygon_gen_z11 | table | tiles
public | osm_park_polygon_gen_z12 | table | tiles
public | osm_park_polygon_gen_z13 | table | tiles
public | osm_park_polygon_gen_z6 | table | tiles
public | osm_park_polygon_gen_z7 | table | tiles
public | osm_park_polygon_gen_z8 | table | tiles
public | osm_park_polygon_gen_z9 | table | tiles
public | osm_park_polygon_id_seq | sequence | tiles
public | osm_peak_point | table | tiles
public | osm_peak_point_id_seq | sequence | tiles
public | osm_poi_point | table | tiles
public | osm_poi_point_id_seq | sequence | tiles
public | osm_poi_polygon | table | tiles
public | osm_poi_polygon_id_seq | sequence | tiles
public | osm_railway_linestring | table | tiles
public | osm_railway_linestring_gen_z10 | table | tiles
public | osm_railway_linestring_gen_z11 | table | tiles
public | osm_railway_linestring_gen_z12 | table | tiles
public | osm_railway_linestring_gen_z8 | table | tiles
public | osm_railway_linestring_gen_z9 | table | tiles
public | osm_railway_linestring_id_seq | sequence | tiles
public | osm_route_member | table | tiles
public | osm_route_member_id_seq | sequence | tiles
public | osm_shipway_linestring | table | tiles
public | osm_shipway_linestring_gen_z11 | table | tiles
public | osm_shipway_linestring_gen_z12 | table | tiles
public | osm_shipway_linestring_id_seq | sequence | tiles
public | osm_state_point | table | tiles
public | osm_state_point_id_seq | sequence | tiles
public | osm_water_polygon | table | tiles
public | osm_water_polygon_gen_z10 | table | tiles
public | osm_water_polygon_gen_z11 | table | tiles
public | osm_water_polygon_gen_z6 | table | tiles
public | osm_water_polygon_gen_z7 | table | tiles
public | osm_water_polygon_gen_z8 | table | tiles
public | osm_water_polygon_gen_z9 | table | tiles
public | osm_water_polygon_id_seq | sequence | tiles
public | osm_waterway_linestring | table | tiles
public | osm_waterway_linestring_id_seq | sequence | tiles
public | raster_columns | view | wturner
public | raster_overviews | view | wturner
public | spatial_ref_sys | table | wturner
(119 rows)
to load all Natural Earth datasets:
(localpython) [wturner@acy_test_app_vm_rserver wdb-map-gen]$ ./load_naturalearth.sh
0...10...20...30...40...50...60...70...80...90...100 - done.
0...10...20...30...40...50...60...70...80...90...100 - done.
0...10...20...30...40...50...60...70...80...90...100 - done.
0...10...20...30...40...50...60...70...80...90...100 - done.
0...10...20...30...40...50...60...70...80...90...100 - done.
0...10...20...30...40...50...60...70...80...90...100 - done.
0...10...20...30...40...50...60...70...80...90...100 - done.
0...10...20...30...40...50...60...70...80...90...100 - done.
====> : Start importing /home/wturner/openmaptiles/wdb-map-gen/data/natural_earth_vector.sqlite into Postgresql
/home/wturner/openmaptiles/wdb-map-gen/data/natural_earth_vector.sqlite
0...10...20...ERROR 1: TopologyException: Input geom 0 is invalid: Ring Self-intersection at or near point 30.796820538582722 61.704133379158407 at 30.796820538582722 61.704133379158407
ERROR 1: TopologyException: Input geom 0 is invalid: Ring Self-intersection at or near point 30.796820538582722 61.704133379158407 at 30.796820538582722 61.704133379158407
ERROR 1: TopologyException: Input geom 0 is invalid: Ring Self-intersection at or near point 30.796820538582722 61.704133379158407 at 30.796820538582722 61.704133379158407
ERROR 1: TopologyException: Input geom 0 is invalid: Ring Self-intersection at or near point 25.199999999950592 0.54166666664491459 at 25.199999999950592 0.54166666664491459
More than 1000 errors or warnings have been reported. No more will be reported from now.
.====> : Deleting extracted files
AFTER:
d.b. size:
openmapconus=# \l+ openmapconus
List of databases
Name | Owner | Encoding | Collate | Ctype | Access privileges | Size | Tablespace | Description
--------------+---------+----------+-------------+-------------+---------------------+-------+------------+-------------
openmapconus | wturner | UTF8 | en_US.UTF-8 | en_US.UTF-8 | =Tc/wturner +| 57 GB | pg_default |
| | | | | wturner=CTc/wturner+| | |
| | | | | tiles=CTc/wturner | | |
(1 row)
d.b. tables:
openmapconus=# \dt ne*
List of relations
Schema | Name | Type | Owner
--------+--------------------------------------------------------+-------+---------
public | ne_10m_admin_0_antarctic_claims | table | wturner
public | ne_10m_admin_0_boundary_lines_land | table | wturner
public | ne_10m_admin_0_boundary_lines_map_units | table | wturner
public | ne_10m_admin_0_boundary_lines_maritime_indicator | table | wturner
public | ne_10m_admin_0_countries_lakes | table | wturner
public | ne_10m_admin_0_disputed_areas | table | wturner
public | ne_10m_admin_0_disputed_areas_scale_rank_minor_islands | table | wturner
public | ne_10m_admin_0_label_points | table | wturner
public | ne_10m_admin_0_map_subunits | table | wturner
public | ne_10m_admin_0_map_units | table | wturner
public | ne_10m_admin_0_pacific_groupings | table | wturner
public | ne_10m_admin_0_seams | table | wturner
public | ne_10m_admin_0_sovereignty | table | wturner
public | ne_10m_admin_1_label_points | table | wturner
public | ne_10m_admin_1_label_points_details | table | wturner
public | ne_10m_admin_1_seams | table | wturner
public | ne_10m_admin_1_states_provinces | table | wturner
public | ne_10m_admin_1_states_provinces_lakes | table | wturner
public | ne_10m_admin_1_states_provinces_lines | table | wturner
public | ne_10m_airports | table | wturner
public | ne_10m_parks_and_protected_lands_area | table | wturner
public | ne_10m_parks_and_protected_lands_line | table | wturner
public | ne_10m_parks_and_protected_lands_point | table | wturner
public | ne_10m_parks_and_protected_lands_scale_rank | table | wturner
public | ne_10m_populated_places | table | wturner
public | ne_10m_populated_places_simple | table | wturner
public | ne_10m_ports | table | wturner
public | ne_10m_railroads | table | wturner
public | ne_10m_railroads_north_america | table | wturner
public | ne_10m_roads | table | wturner
public | ne_10m_roads_north_america | table | wturner
public | ne_10m_time_zones | table | wturner
public | ne_10m_urban_areas | table | wturner
public | ne_10m_urban_areas_landscan | table | wturner
(34 rows)
table sizes:
AND table_size > 1 and relname like 'ne%'
ORDER BY table_size DESC;
schema_name | relname | size | table_size
-------------+-----------------------------------------------------------------+------------+------------
public | ne_10m_roads_north_america | 279 MB | 292552704
public | ne_10m_railroads | 130 MB | 136470528
public | ne_10m_roads | 114 MB | 119963648
public | ne_10m_urban_areas | 90 MB | 94535680
public | ne_10m_admin_1_states_provinces_lakes | 72 MB | 75743232
public | ne_10m_admin_1_states_provinces | 60 MB | 63062016
public | ne_10m_admin_1_states_provinces_lines | 43 MB | 45113344
public | ne_10m_populated_places | 37 MB | 38871040
public | ne_10m_admin_1_label_points_details | 18 MB | 19005440
public | ne_10m_urban_areas_landscan | 16 MB | 17211392
public | ne_10m_roads_north_america_geometry_geom_idx | 16 MB | 17088512
public | ne_10m_roads_geometry_geom_idx | 14 MB | 14876672
public | ne_10m_populated_places_simple | 11 MB | 11542528
public | ne_10m_admin_1_label_points | 8448 kB | 8650752
public | ne_10m_railroads_geometry_geom_idx | 6680 kB | 6840320
public | ne_10m_railroads_north_america | 6608 kB | 6766592
public | ne_10m_roads_pkey | 6232 kB | 6381568
public | ne_10m_admin_0_boundary_lines_land | 5680 kB | 5816320
public | ne_10m_roads_north_america_pkey | 5408 kB | 5537792
public | ne_10m_admin_0_label_points | 4488 kB | 4595712
public | ne_10m_admin_0_map_subunits | 3880 kB | 3973120
public | ne_10m_admin_0_map_units | 3360 kB | 3440640
public | ne_10m_urban_areas_geometry_geom_idx | 3176 kB | 3252224
public | ne_10m_admin_1_label_points_geometry_geom_idx | 3128 kB | 3203072
public | ne_10m_airports | 2840 kB | 2908160
public | ne_10m_railroads_pkey | 2800 kB | 2867200
public | ne_10m_admin_0_countries_lakes | 2760 kB | 2826240
public | ne_10m_admin_1_states_provinces_lines_geometry_geom_idx | 2536 kB | 2596864
public | ne_10m_admin_0_sovereignty | 2128 kB | 2179072
public | ne_10m_populated_places_geometry_geom_idx | 2008 kB | 2056192
public | ne_10m_populated_places_simple_geometry_geom_idx | 1968 kB | 2015232
public | ne_10m_admin_0_label_points_geometry_geom_idx | 1824 kB | 1867776
public | ne_10m_admin_1_states_provinces_geometry_geom_idx | 1400 kB | 1433600
public | ne_10m_admin_1_states_provinces_lakes_geometry_geom_idx | 1352 kB | 1384448
public | ne_10m_urban_areas_pkey | 1320 kB | 1351680
public | ne_10m_admin_1_label_points_details_geometry_geom_idx | 1272 kB | 1302528
public | ne_10m_admin_1_label_points_pkey | 1256 kB | 1286144
public | ne_10m_admin_0_disputed_areas | 1200 kB | 1228800
public | ne_10m_time_zones | 1160 kB | 1187840
public | ne_10m_admin_1_states_provinces_lines_pkey | 1128 kB | 1155072
public | ne_10m_urban_areas_landscan_geometry_geom_idx | 1032 kB | 1056768
public | ne_10m_admin_0_disputed_areas_scale_rank_minor_islands | 1000 kB | 1024000
public | ne_10m_populated_places_simple_pkey | 824 kB | 843776
public | ne_10m_populated_places_pkey | 824 kB | 843776
public | ne_10m_parks_and_protected_lands_scale_rank | 800 kB | 819200
public | ne_10m_admin_0_label_points_pkey | 792 kB | 811008
public | ne_10m_parks_and_protected_lands_area | 680 kB | 696320
public | ne_10m_ports | 576 kB | 589824
public | ne_10m_admin_1_label_points_details_pkey | 528 kB | 540672
public | ne_10m_admin_1_states_provinces_pkey | 520 kB | 532480
public | ne_10m_admin_1_states_provinces_lakes_pkey | 520 kB | 532480
public | ne_10m_admin_0_boundary_lines_maritime_indicator | 480 kB | 491520
public | ne_10m_urban_areas_landscan_pkey | 432 kB | 442368
public | ne_10m_railroads_north_america_geometry_geom_idx | 304 kB | 311296
public | ne_10m_ports_geometry_geom_idx | 304 kB | 311296
public | ne_10m_parks_and_protected_lands_point | 280 kB | 286720
public | ne_10m_airports_geometry_geom_idx | 232 kB | 237568
public | ne_10m_parks_and_protected_lands_line | 200 kB | 204800
public | ne_10m_admin_0_pacific_groupings | 192 kB | 196608
public | ne_10m_admin_0_antarctic_claims | 160 kB | 163840
public | ne_10m_admin_0_boundary_lines_map_units | 160 kB | 163840
public | ne_10m_railroads_north_america_pkey | 144 kB | 147456
public | ne_10m_ports_pkey | 136 kB | 139264
public | ne_10m_admin_0_countries_lakes_geometry_geom_idx | 128 kB | 131072
public | ne_10m_admin_0_map_units_geometry_geom_idx | 128 kB | 131072
public | ne_10m_admin_0_boundary_lines_land_geometry_geom_idx | 120 kB | 122880
public | ne_10m_airports_pkey | 120 kB | 122880
public | ne_10m_admin_0_map_subunits_geometry_geom_idx | 120 kB | 122880
public | ne_10m_admin_0_sovereignty_geometry_geom_idx | 112 kB | 114688
public | ne_10m_parks_and_protected_lands_point_geometry_geom_idx | 96 kB | 98304
public | ne_10m_admin_0_boundary_lines_land_pkey | 72 kB | 73728
public | ne_10m_admin_0_boundary_lines_maritime_indicator_geometry_geom_ | 72 kB | 73728
public | ne_10m_admin_0_seams | 64 kB | 65536
public | ne_10m_parks_and_protected_lands_point_pkey | 56 kB | 57344
public | ne_10m_admin_0_map_subunits_pkey | 56 kB | 57344
public | ne_10m_admin_0_disputed_areas_scale_rank_minor_islands_geometry | 56 kB | 57344
public | ne_10m_admin_0_map_units_pkey | 48 kB | 49152
public | ne_10m_admin_0_countries_lakes_pkey | 48 kB | 49152
public | ne_10m_time_zones_geometry_geom_idx | 48 kB | 49152
public | ne_10m_admin_0_boundary_lines_maritime_indicator_pkey | 40 kB | 40960
public | ne_10m_admin_0_disputed_areas_scale_rank_minor_islands_pkey | 40 kB | 40960
public | ne_10m_admin_0_sovereignty_pkey | 40 kB | 40960
public | ne_10m_time_zones_pkey | 32 kB | 32768
public | ne_10m_parks_and_protected_lands_scale_rank_pkey | 32 kB | 32768
public | ne_10m_parks_and_protected_lands_scale_rank_geometry_geom_idx | 32 kB | 32768
public | ne_10m_admin_0_pacific_groupings_geometry_geom_idx | 24 kB | 24576
public | ne_10m_parks_and_protected_lands_area_geometry_geom_idx | 24 kB | 24576
public | ne_10m_admin_0_disputed_areas_geometry_geom_idx | 24 kB | 24576
public | ne_10m_admin_0_boundary_lines_map_units_pkey | 16 kB | 16384
public | ne_10m_parks_and_protected_lands_line_pkey | 16 kB | 16384
public | ne_10m_admin_0_disputed_areas_pkey | 16 kB | 16384
public | ne_10m_admin_0_antarctic_claims_pkey | 16 kB | 16384
public | ne_10m_admin_1_seams | 16 kB | 16384
public | ne_10m_admin_0_seams_pkey | 16 kB | 16384
public | ne_10m_admin_0_pacific_groupings_pkey | 16 kB | 16384
public | ne_10m_admin_1_seams_pkey | 16 kB | 16384
public | ne_10m_parks_and_protected_lands_area_pkey | 16 kB | 16384
public | ne_10m_ports_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_0_seams_geometry_geom_idx | 8192 bytes | 8192
public | ne_10m_admin_0_antarctic_claims_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_0_antarctic_claims_geometry_geom_idx | 8192 bytes | 8192
public | ne_10m_admin_0_pacific_groupings_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_1_label_points_details_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_0_seams_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_time_zones_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_1_states_provinces_lakes_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_0_map_units_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_1_states_provinces_lines_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_0_disputed_areas_scale_rank_minor_isla_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_0_label_points_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_0_sovereignty_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_airports_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_railroads_north_america_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_0_disputed_areas_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_parks_and_protected_lands_point_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_populated_places_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_roads_north_america_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_1_seams_geometry_geom_idx | 8192 bytes | 8192
public | ne_10m_admin_0_boundary_lines_land_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_1_states_provinces_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_1_seams_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_0_boundary_lines_maritime_indicator_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_0_countries_lakes_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_populated_places_simple_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_urban_areas_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_parks_and_protected_lands_line_geometry_geom_idx | 8192 bytes | 8192
public | ne_10m_railroads_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_1_label_points_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_parks_and_protected_lands_line_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_0_boundary_lines_map_units_geometry_geom_idx | 8192 bytes | 8192
public | ne_10m_parks_and_protected_lands_area_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_0_map_subunits_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_parks_and_protected_lands_scale_rank_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_admin_0_boundary_lines_map_units_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_urban_areas_landscan_ogc_fid_seq | 8192 bytes | 8192
public | ne_10m_roads_ogc_fid_seq | 8192 bytes | 8192
(136 rows)
NOPE, not the point at all:
-> Data Source -> Add New Source
Source id: g72fi2zhl
Source Type: Vector(TileJSON URL)
TileJSON URL: https://tiles.ilikecarrots.com/tilejson.json