Files
tcg_web_scraper/requirements.txt

46 lines
1.0 KiB
Plaintext

# YGH
pandas
# MTG
ijson
# PKM
openpyxl
xlsxwriter
# Product Scraping
# selenium
# undetected_chromedriver
playwright
aioconsole
""" Call
EMAIL_SENDER=bot@partsltd.co.uk \
EMAIL_PASSWORD=@sJt1b5Cliu6 \
EMAIL_RECIPIENT=teddy@shuffleandskirmish.co.uk \
python3 product_scraper.py
One-time setup (edit credentials first):
# 1. Fill in your email details in the service file
nano product_scraping/tcg-scraper.service
# 2. Copy to systemd and enable
sudo cp product_scraping/tcg-scraper.service /etc/systemd/system/
sudo systemctl daemon-reload
sudo systemctl enable tcg-scraper # auto-start on boot
sudo systemctl start tcg-scraper
Day-to-day controls:
sudo systemctl stop tcg-scraper # stop immediately
sudo systemctl start tcg-scraper # start again
sudo systemctl restart tcg-scraper # restart (e.g. after editing the .py)
sudo systemctl status tcg-scraper # is it running? last exit code?
journalctl -fu tcg-scraper # live log tail (Ctrl+C to exit)
journalctl -u tcg-scraper --since today # today's log
"""