free-http-proxy

some high anonymous proxy spider & check service, output data api used bottle web framework.

1.Install packages

pip install -r requirements.txt

2.Install mysql

rpm -Uvh http://dev.mysql.com/get/mysql57-community-release-el7-8.noarch.rpm
yum install -y mysql-community-server
systemctl enable mysqld
systemctl start mysqld

3.Init scheme

echo -n "Enter new mysql root password and press [ENTER]: "
read -s newpass
oldpass=`grep 'temporary password' /var/log/mysqld.log | awk '{print $NF}'`
mysql -u root -p ${oldpass} <<EOF
	ALTER USER 'root'@'localhost' IDENTIFIED BY '$newpass';
EOF
mysql -u root -p < db.sql

4.Web Interface

nohup python app.py >/dev/null 2>&1 &

5.crawling service

nohup python service.py fetch >/dev/null 2>&1 &
nohup python service.py check >/dev/null 2>&1 &

For detailed explanation on how things work, checkout the code