Table of contents
- Overview
- Getting started
- Configuration
- Examples
- Use NFS for shared-folder
- Change PHP version
- Change MySQL version
- Adapt MySQL "sql_mode"
- Change VM provider
- Change shared folder path
- Define github token for composer
- Define gitlab url and token for composer
- Define auth for composer repositories
- Change ubuntu repository mirror url
- Change virtual host
- Change the display mode of errors
- Change MySQL password
- Setting up Varnish
- Trigger Selenium installation
- Trigger IonCube integration
- Customize email monitoring integration
- Customize MySQL administration web app integration
- Composer parallel install plugin
- Trigger Doxygen integration
- Examples
- Guides
- Troubleshooting
- Provision process hangs on "Run composer install" task
- Error from Unit_Admin_ModuleListTest::testRender() method while testing eShop
- Browser shows "Zend Guard Run-time support missing!"
- On Windows machines, getting "requires a TTY"
- Selenium tests do not run after VM was destroyed: error "Session not started"
- Composer returns "ProcessTimedOutException"
- On Windows machines, fails to install vagrant-hostmanager plugin
This project provides a flexible base for VM configurations.
Current OXID eShop development environment is inspired by PuPHPet and Phansible projects.
Virtual environment is built using:
- Vagrant - virtual environment automation tool;
- Ansible - environment orchestration tool;
- YAML - solution configuration.
Final solution is composed of two repositories (linked using git sub-modules):
Before proceeding with Quick start please ensure that the Dependencies listed below are installed.
- Vagrant (>=1.8.6)
- VirtualBox [1] (>=4.2, except 5.1.8, see #29; Windows users see #32)
- Git
- OpenSSH (Only client part is needed)
- Vagrant plugins:
Note for Windows users: Use console with Administrator privileges to run vagrant commands!
- Clone out current repository:
git clone https://github.com/OXID-eSales/oxvm_base.git
- Start the VM:
cd oxvm_base
vagrant up
- After successful provision process you can put your sources in the shared folder and access them at http://oxvm.local/
- If something doesn't work, see the Troubleshooting section.
[1] | VirtualBox is listed as dependency due to the fact that it is the default chosen provider for the VM. In case other providers will be used there is no need to install VirtualBox. Please refer to the list of possible providers in the configuration section to get more information. |
Default virtual environment configuration should be sufficient enough to get most projects up and running. However, it is possible to adjust the configuration of the virtual environment to better match individual preferences.
All configuration changes should be done by overriding variables from:
- default.yml - base vm variables;
These overridden values must be placed in personal.yml
[2] file at the root level of current repository.
For the overridden values to take effect please run vagrant provision
. If
the changes are related to the shared folder use vagrant reload
. In case the
provision process will start to show any kind of errors, please try to use
vagrant destroy && vagrant up
for the process to start over from a clean
state.
To double check the merged version of configuration just run vagrant config
.
Hint: you have to care for the syntax/semantics for yourself. So, if you get an error while vagrant provision
your personal.yml is the start point for troubleshooting.
Hint: Check if every entry has a value. At the moment no empty entries will work.
Below is a list of possible frequent changes which are typically done after cloning this repository.
One can just copy and paste the example snippets from the list below to the
personal.yml
file at the root of this repository.
If LXC is not available on your host system the best (so far) method to share your application folder would be to use NFS.
In order to trigger NFS usage inside the VM one has to add the following configuration:
---
vagrant_local:
vm:
app_shared_folder:
sync_type: nfs
Beware that in order for this to work your host system must support NFS server:
- OS X/macOS has this integrated out-of-the-box
- Various GNU/Linux distributions might require additional setup:
Be aware that NFS also has it's own limitations:
- No server is available for Microsoft Windows
- NFS uses network stack to share data
- NFS does not propagate file change events to the guest system
- Sometimes NFS is complicated to setup/troubleshoot in a non-standard environment
By default, PHP 7.1 version is installed.
If some other PHP version is needed, it can be specified in personal.yml
before building the machine (changing the php version via vagrant provision is not supported).
---
php:
version: 5.6
Note: Ensure all packages described in packages list are available for required version. As example - mcrypt is deprecated and not available for PHP 7.2, so installation with this package in list will fail.
--- php:
- packages:
- cli
- intl
- mcrypt
- mysql
- gd
- curl
- xml
By default, MySQL 5.7 version is installed.
Alternatively you could use tools like mysql-apt-config to switch to a different MySQL version,
see example below which you can use after doing vagrant ssh
:
wget http://dev.mysql.com/get/mysql-apt-config_0.8.13-1_all.deb
sudo dpkg -i mysql-apt-config_0.8.13-1_all.deb
# Choose MySQL version to install
sudo apt-get update
sudo apt-get install mysql-server
By default the sql mode is set to "ONLY_FULL_GROUP_BY,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION", but can be adapted as needed via:
---
mysql:
sql_mode: 'your custom mode string'
Change VM provider from VirtualBox (default) to LXC. A list of available and tested providers [4]:
- virtualbox - Default provider which is free to use and available on all major operating systems;
- lxc [5] - Operating system level virtualization which vastly improves I/O performance compared to para-virtualization solutions;
- parallels [6] - Commercial VM provider for OS X.
---
vagrant_local:
vm:
provider: lxc
Change the default application shared folder from www
to local path
/var/www
.
---
vagrant_local:
vm:
app_shared_folder:
source: /var/www
target: /var/www
Provide OAuth token from github for composer so that the access API limit could be removed [7].
---
php:
composer:
github_token: example_secret_token
Provide OAuth token from gitlab for composer so it can access git via https sources or access to gitlab composer repositories.
---
php:
composer:
gitlab_token: example_secret_token
gitlab_url: example_url
Provide HTTP auth for composer. e.G. to the oxid enterprise repository
---
php:
composer:
http-basic:
- basic-url: enterprise-edition.packages.oxid-esales.com
username:<username>
password:<password>
Change the default ubuntu repository mirror url from http://de.archive.ubuntu.com/ubuntu/
to http://us.archive.ubuntu.com/ubuntu/
.
---
server:
apt_mirror: http://us.archive.ubuntu.com/ubuntu/
Change the default virtual host from www.default.local
to
www.myproject.local
.
---
vagrant_local:
vm:
aliases:
- www.myproject.local
By default the display_errors option is turned on. To change the behavior you can use:
---
php:
display_errors: Off
Change the default MySQL user password from oxid
to secret
.
---
mysql:
password: secret
Trigger Varnish installation via:
---
varnish:
install: true
The above change will only trigger installation of Varnish with the distributed
default configuration default.vcl
, adapt this to your needs.
If you change the parameter for a running VM you can use vagrant provision
to trigger the installation.
Trigger Selenium installation so that it can be used to run Selenium tests with the help of OXID testing library.
---
selenium:
install: true
Together with Selenium, a vnc server is installed in order to connect via remote
display. Suitable clients are e.g. vinagre
on Linux or the built-in vnc
client of OS X.
Trigger IonCube integration so that it can be used to decode the encoded files.
---
ioncube:
install: true
Integration of Mailhog allows to monitor e-mail activity from the eShop. List of e-mails could be seen at: http://www.default.local/mail/ or http://www.oxideshop.local/mail/
Possible configuration options for Mailhog:
web_port
- web UI port (8025
is the default value which means that the UI can be accessed by the following URL: http://www.default.local:8025/)smtp_port
- SMTP server port (1025
is the default value)web_alias
- an URL alias for the default virtual host to act as a proxy for web UI of mailhog (/mail/
is the default value which means that the UI can be access by the following URL: http://www.default.local/mail/)
An example configuration which changes web UI port to 8024
, SMTP port to
1026
and alias to /emails/
:
---
mailhog:
web_port: 8024
smtp_port: 1026
web_alias: /emails/
Mailhog is installed by default as it has install: true
option in the
default configuration file. In order to disable email monitoring please use the
following configuration snippet:
---
mailhog:
install: false
Integration of Adminer allows to access
MySQL administrative tasks and data through web alias adminer
at:
http://www.default.local/adminer/ or http://www.oxideshop.local/adminer/
Integration of
Adminer editor allows
to access and modify MySQL data through web alias adminer_editor
at:
http://www.default.local/adminer_editor/ or http://www.oxideshop.local/adminer_editor/
Possible configuration options for Adminer and Adminer editor:
pkg_url
- An URL which points to the compiled PHP version of the applicationweb_alias
- An alias used to access the application (Default value isadminer
/adminer_editor
, which means that in order to access it one has to open http://www.default.local/adminer/ / http://www.default.local/adminer_editor/)pkg_sha256
- A SHA-256 hash of file contents downloaded from resource defined inpkg_url
Adminer and Adminer editor are installed by default as they have
install: true
option in the default configuration file. In order to disable
these tools please use the following configuration snippet:
---
adminer:
install: false
adminer_editor:
install: false
Keep in mind that your MySQL credentials will be already present in the login page and there is no need to enter the login data manually. The following variables are used to gain MySQL credentials:
mysql.user
- User name which has access to the created databasemysql.password
- Password of previously mentioned usermysql.database
- Name of the newly created database
The composer parallel install plugin hirak/prestissimo is enabled by default. In order to disable it please use the following snippet:
---
php:
composer:
prestissimo:
install: false
Trigger Doxygen integration so that it can be used to automatically generate source code documentation.
---
doxygen:
install: true
[2] | personal.yml configuration file is already included in .gitignore and should not be visible as changes to the actual repository. |
[3] | Repository with some already prebuilt versions of php for faster installation. |
[4] | VM solutions from VMWare, such as workstation and fusion were not yet adapted or tested with our current configuration of VM. |
[5] | Keep in mind that LXC provider is only available for GNU/Linux based operating systems. In order to start using this provider with vagrant a plugin must be installed for it (vagrant plugin install vagrant-lxc ). So far it has been only tested with Ubuntu based OS with lxc package installed (sudo apt-get install lxc ). |
[6] | A vagrant plugin must be installed (vagrant plugin install vagrant-parallels ) in order to use vagrant with Parallels. |
[7] | By default github has API access limits set for anonymous access. In order to overcome these limits one has to create a github token, which could be done as described in: https://help.github.com/articles/creating-an-access-token-for-command-line-use/ |
List of guides for working with VM:
- Open VM directory:
cd oxvm_base
- Destroy old VM:
vagrant destroy
- Update eShop VM:
git pull
- Start VM:
vagrant up
In order to provision only individual part of the VM one can simply use
ANSIBLE_TAGS
environment variable. Consider the following examples:
# Provision PHP and MySQL parts only
ANSIBLE_TAGS=php,mysql vagrant provision
# Provision OXID eShop related part only
ANSIBLE_TAGS=eshop vagrant provision
Ansible tags are marked inside roles
directories. To get a list of them try running the following command:
grep -r -A 2 --include="*.yml" "tags\:" .
List of troubleshooting items:
During the provision process (which could be invoked implicitly by
vagrant up
or explicitly by vagrant provision
) a task Run composer
install
might hang (waiting for time-out) because github access API limit
has been reached and composer
is asking for github account username/password
which could resolve the API limit. Ansible
will not provide this information
to STDOUT
or STDERR
so it will look like the task just hanged.
Since there are no options to provide username/password for this particular task one could just use a github API token which will allow to overcome the API access limit.
How to create and configure a github token is described in Define github token for composer chapter.
Older versions of eShop contains a very strict test inside Unit_Admin_ModuleListTest::testRender() method which tries to match the exact list of available modules. The test method might fail because VM includes SDK components and some of them are actual modules (which will result in modified list of available modules).
This is a known issue which is fixed in the development and new upcoming releases of eShop.
To check which shop is compatible with testing library please refer to compatibility list.
This message will only appear if a Zend Guard encoded eShop package is being used. In order to solve the issue one has to install Zend Guard Loader which will decode the encoded PHP files on execution.
To install and enable Zend Guard Loader PHP extension add the following configuration:
php:
zendguard:
install: true
Keep in mind that this extension will only work with the default PHP version, i.e. at the moment the use of extenion with phpbrew is not automated.
To install and enable Zend Guard Loader PHP extension manually inside the VM:
# From host (local machine)
vagrant ssh
# From guest (virtual machine)
cd /usr/lib/php/20131226/
sudo wget https://github.com/OXID-eSales/oxvm_assets/blob/master/zend-loader-php5.6-linux-x86_64.tar.gz?raw=true -O zend.tar.gz
sudo tar zxvf zend.tar.gz
sudo cp zend-loader-php5.6-linux-x86_64/ZendGuardLoader.so ./
sudo cp zend-loader-php5.6-linux-x86_64/opcache.so ./zend_opcache.so
cd /etc/php/5.6/mods-available/
sudo sh -c 'echo "zend_extension=ZendGuardLoader.so" > zend.ini'
sudo sh -c 'echo "zend_extension=zend_opcache.so" >> zend.ini'
sudo phpdismod opcache
sudo phpenmod zend
sudo service apache2 restart
Keep in mind that different PHP version needs different version of Zend Guard Loader extension. List of possible extension versions can be found in oxvm_assets repository.
More information on how to install and configure Zend Guard Loader can be found at: http://files.zend.com/help/Zend-Guard/content/installing_zend_guard_loader.htm
The example of error message:
{ oxvm_base } master » vagrant destroy
Vagrant is attempting to interface with the UI in a way that requires
a TTY. Most actions in Vagrant that require a TTY have configuration
switches to disable this requirement. Please do that or run Vagrant
with TTY.
Please check answers on stackoverflow for your specific case: http://stackoverflow.com/questions/23633276/vagrant-is-attempting-to-interface-with-the-ui-in-a-way-that-requires-a-tty
Restart selenium server is needed and can be done with command:
sudo /etc/init.d/selenium restart
In case there are Internet connection issues composer might take longer time to download
various packages and hit ProcessTimeOutException
. In order to avoid that configuration can
be updated to increase this time-out:
php:
composer:
timeout: 3000
Using user name with space in it leads to an error message:
The directory where plugins are installed (the Vagrant home directory) has a space in it. On Windows, there is a bug in Ruby when compiling plugins into directories with spaces. Please move your Vagrant home directory to a path without spaces and try again.
Possible solution:
- Install Vagrant in a directory which has no spaces in the path.
- Define Windows Environment Variable
%VAGRANT_HOME%
to hold path to the directoryPath_to_Vagrant\bin