Skip to content

Latest commit

 

History

History
195 lines (137 loc) · 10.8 KB

CONFIGURATION.md

File metadata and controls

195 lines (137 loc) · 10.8 KB

Configuring Tilemaker

Vector tiles contain (generally thematic) 'layers'. For example, your tiles might contain river, cycleway and railway layers.

You'll generally assign OpenStreetMap data into layers by making decisions based on their tags. You might put anything with a highway= tag into the roads layer, anything with a railway= tag into the railway layer, and so on.

In Tilemaker, you achieve this by writing a short script in the Lua programming language. Lua is a simple and fast language used by several other OpenStreetMap tools, such as the OSRM routing engine and osm2pgsql.

In addition, you supply Tilemaker with a JSON file which specifies certain global settings for your tileset.

A note on zoom levels

Because vector tiles are so efficiently encoded, you generally don't need to create tiles above (say) zoom level 14. Instead, your renderer will use the data in the z14 tiles to generate z15, z16 etc. (This is called 'overzooming'.)

So when you set a maximum zoom level of 14 in Tilemaker, this doesn't mean you're restricted to displaying maps at z14. It just means that Tilemaker will create z14 tiles, and it's your renderer's job to use these tiles to draw the most detailed maps.

JSON configuration

The JSON config file sets out the layers you'll be using, and which zoom levels they apply to. For example, you might want to include your roads layer in your z12-z14 tiles, but your buildings at z14 only.

It also includes these global settings:

  • minzoom - the minimum zoom level at which any tiles will be generated
  • maxzoom - the maximum zoom level at which any tiles will be generated
  • basezoom - the zoom level for which Tilemaker will generate tiles internally (should usually be the same as maxzoom)
  • include_ids - whether you want to store the OpenStreetMap IDs for each way/node within your vector tiles
  • compress - whether to compress vector tiles (Any of "gzip","deflate" or "none"(default))
  • name, version and description - about your project (these are written into the MBTiles file)
  • bounding_box (optional) - the bounding box to output, in [minlon, minlat, maxlon, maxlat] order

A typical config file would look like this:

{
	"layers": {
		"roads": { "minzoom": 12, "maxzoom": 14 },
		"buildings": { "minzoom": 14, "maxzoom": 14 },
		"pois": { "minzoom": 13, "maxzoom": 14 }
	},
	"settings": {
		"minzoom": 12,
		"maxzoom": 14,
		"basezoom": 14,
		"include_ids": false,
		"compress": true,
		"name": "Tilemaker example",
		"version": "0.1",
		"description": "Sample vector tiles for Tilemaker"
	}
}

The order of layers will be carried forward into the vector tile.

All options are compulsory unless stated otherwise. If Tilemaker baulks at the JSON file, check everything's included, and run it through an online JSON validator to check for syntax errors.

By default Tilemaker expects to find this file at config.json, but you can specify another filename with the --config command-line option.

Advanced layer configuration

You can add optional parameters to layers:

  • write_to - write way/nodes to a previously named layer
  • simplify_below - simplify ways below this zoom level
  • simplify_level - how much to simplify ways (in degrees of longitude) on the zoom level simplify_below-1
  • simplify_length - how much to simplify ways (in kilometers) on the zoom level simplify_below-1, preceding simplify_level
  • simplify_ratio - (optional: the default value is 1.0) the actual simplify level will be simplify_level * pow(simplify_ratio, (simplify_below-1) - <current zoom>)

Use these options to combine different layer specs within one outputted layer. For example:

"layers": {
    "roads": { "minzoom": 12, "maxzoom": 14 },
    "low_roads": { "minzoom": 9, "maxzoom": 11, "write_to": "roads", "simplify_below": 12, "simplify_level": 0.0001 }
}

This would combine the roads (z12-14) and low_roads (z9-11) layers into a single roads layer on writing, with simplified geometries for low_roads.

(See also 'Shapefiles' below.)

Additional metadata

If you need to add additional metadata fields to your .mbtiles output, include the keys/values as an (optional) "metadata" entry under "settings". These will usually be string key/value pairs. (The value can also be another JSON entity - hash, array etc. - in which case it'll be encoded as JSON when written into the .mbtiles metadata table.)

For example:

{
	"layers": { ... },
	"settings": { ... ,
		"metadata": {
			"author": "THERE Data Inc",
			"licence": "ODbL 1.1",
			"layer_order": { "water": 1, "buildings": 2, "roads": 3 }
		}
	}
}

Lua processing

Your Lua file needs to supply 5 things:

  1. node_keys, a list of those OSM keys which indicate that a node should be processed
  2. init_function (optional), a function to initialize Lua logic
  3. node_function, a function to process an OSM node and add it to layers
  4. way_function, a function to process an OSM way and add it to layers
  5. exit_function (optional), a function to finalize Lua logic (useful to show statistics)

node_keys is a simple list (or in Lua parlance, a 'table') of OSM tag keys. If a node has one of those keys, it will be processed by node_function; if not, it'll be skipped. For example, if you wanted to show highway crossings and railway stations, it should be { "highway", "railway" }. (This avoids the need to process the vast majority of nodes which contain no important tags at all.)

node_function and way_function work the same way. They are called with an OSM object; you then inspect the tags of that object, and put it in your vector tiles' layers based on those tags. In essence, the process is:

  • look at tags
  • if tags meet criteria, write to a layer
  • (optionally) add attributes (= vector tile metadata/tags)

To do that, you use these methods:

  • node:Find(key) or way:Find(key): get the value for a tag, or the empty string if not present. For example, way:Find("railway") might return "rail" for a railway, "siding" for a siding, or "" if it isn't a railway at all.
  • node:Holds(key) or way:Holds(key): returns true if that key exists, false otherwise.
  • node:Id() or way:Id(): get the OSM ID of the current object.
  • node:Layer("layer_name", false) or way:Layer("layer_name", is_area): write this node/way to the named layer. This is how you put objects in your vector tile. is_area (true/false) specifies whether a way should be treated as an area, or just as a linestring.
  • way:LayerAsCentroid("layer_name"): write a single centroid point for this way to the named layer (useful for labels and POIs).
  • node:Attribute(key,value) or node:Attribute(key,value): add an attribute to the most recently written layer.
  • node:AttributeNumeric(key,value), node:AttributeBoolean(key,value) (and way:...): for numeric/boolean columns.

The simplest possible function, to include roads/paths and nothing else, might look like this:

function way_function(way)
  local highway = way:Find("highway")
  if highway~="" then
    way:Layer("roads", false)
    way:Attribute("name", way:Find("name"))
    way:Attribute("type", highway)
  end
end

Take a look at the supplied process.lua for a full example. You can specify another filename with the --process option.

If your Lua file causes an error due to mistaken syntax, you can test it at the command line with luac -p filename. Three frequent Lua gotchas: tables (arrays) start at 1, not 0; the "not equal" operator is ~= (that's the other way round from Perl/Ruby's regex operator); and if statements always need a then, even when written over several lines.

Relations

Tilemaker handles multipolygon relations natively. The combined geometries are processed as ways (i.e. by way_function), so if your function puts buildings in a 'buildings' layer, Tilemaker will cope with this whether the building is mapped as a simple way or a multipolygon. The only difference is that they're given an artificial ID.

Multipolygons are expected to have tags on the relation, not the outer way. The vector tile spec is slightly vague on multipolygon encoding. Tilemaker will enforce correct winding order, but in the case of a multipolygon with multiple outer ways, it assigns all inner ways to the first outer way.

Shapefiles

Tilemaker chiefly works with OpenStreetMap .osm.pbf data, but you can also bring in shapefiles. These are useful for rarely-changing data such as coastlines and built-up area outlines.

Shapefiles are imported directly in your layer config like this:

"urban_areas": {
  "minzoom": 11, "maxzoom": 14,
  "source": "data/urban_areas.shp",
  "simplify_below": 13, "simplify_level": 0.0003
},
"bridges": {
  "minzoom": 13, "maxzoom": 14,
  "source": "data/Bridges_WGS84.shp", 
  "source_columns": ["SAP_DESCRI"]
}

You can import attribute columns from a shapefile using the source_columns parameter, and they'll be available within your vector tiles just as any OSM tags that you import would be. Lua transformations are not available for shapefiles: it's assumed that you have processed your shapefiles before running Tilemaker.

Shapefiles must be in WGS84 projection, i.e. pure latitude/longitude. (Use ogr2ogr to reproject them if your source material is in a different projection.) They will be clipped to the bounds of the first .pbf that you import, unless you specify otherwise with a bounding_box setting in your JSON file.

Lua spatial queries

When processing OSM objects with your Lua script, you can perform simple spatial queries against a shapefile layer. Let's say you have the following shapefile layer containing country polygons, each one named with the country name:

"countries": {
  "minzoom": 2, "maxzoom": 10,
  "source": "data/country_polygons.shp",
  "index": true, "index_column": "NAME"
}

You can then find out whether a node is within one of these polygons using the Intersects method:

if node:Intersects("countries") then print("Looks like it's on land"); end

Or you can find out what country(/ies) the node is within using FindIntersecting, which returns a table:

names = node:FindIntersecting("countries")
print(table.concat(name,","))

To enable these functions, set index to true in your shapefile layer definition. index_column is not needed for Intersects but required for FindIntersecting.

Note these significant provisos:

  • Way queries are performed on the start and end points of ways, not the full way geometry. So if your way starts and ends outside a polygon, Intersects will return false, even if the midpoints are within the polygon. This may be changed in a future version.
  • Spatial queries do not work where the OSM object is a multipolygon, and will return false/empty.