Home

Development notes for the OPAL converter component

Architecture

The configuration of used queues (bindings) can be found in converter-configuration.

Configuration

• The converter is configured by
  • Configuration variables in the .env file, see the readme file
  • The docker-compose.yml file
  • Branches on the converter-configuration repository

Starting locally

• If you also run the opaldata component locally, both components want to use the Elasticsearch port 9200. To handle this, change that port in docker-compose.yml.
• Comments on the configuration can be found in Issue 12.

Reading data

• dataset-fetcher uses the variables starting with CRAWLER_TRIPLESTORE_
• dataset-file-fetcher uses the variable DATASET_FOLDER