A Python MediaWiki bot doing mighty things. See Commons:User:ErfgoedBot
By default, the bot connects to the monuments database using the credentials
pywikibot_config.db_username and pywikibot_config.db_password.
You can override them via the database_config.yml file.
To hack on it, use tox to run the tests
To spin-up a development environement simulating harvesting:
# Build Docker images
docker-compose build
# Create database tables
docker-compose run --rm --no-deps --entrypoint python bot -m erfgoedbot.monument_tables
docker-compose run --rm --no-deps --entrypoint python bot -m erfgoedbot.fill_table_monuments_all
# Start the Docker containers
docker-compose up -d
# Ensure a directory for locally written pages
mkdir -p docker_pages
# Run the bot to harvest a country
docker-compose run --rm bot python -m erfgoedbot.update_database -countrycode:ge -langcode:ka -log
# Update the monuments_all table
docker-compose run --rm db mysql -h db s51138__heritage_p --user=heritage --password=password < erfgoedbot/sql/fill_table_monuments_all.sql
# Update the statistics table
docker-compose run --rm web php ../maintenance/_buildStats.php
The web interface will be accessible on http://localhost:5000/
This tool is meant to run on Toolforge.
Dependencies are installed in a Python virtual environment (via bin/build-python.sh). In order to run Python scripts, you may want to use the Shell scripts in the bin directory:
./bin/run_erfgoedbot_script.sh erfgoedbot/update_database.py -countrycode:ge -langcode:ka -log
A PHP API exploiting the MySQL database.
To hack on it, use Composer to run PHP tests and docker-compose to spin-up a local development environment.
./bin/download_monuments_database_dump.sh
docker-compose -f docker-compose-dump.yml up -d
The web interface will be accessible on http://localhost:5000/
With the exception of directories containing their own LICENSE file, this repository is licensed under the MIT License.