Portia
Portia를 사용해 시각적으로 스크래핑하기
설치 https://github.com/scrapinghub/portia
docker run -v ~/portia_projects:/app/data/projects:rw -p 9001:9001 scrapinghub/portia:portia-2.0.7
스파이더 실행하기
docker run -it --rm -v ~/portia_projects:/app/data/projects:rw -v <출력_디렉토리>:/mnt:rw -p 9001:9001 scrapinghub/portia portiacrawl /app/data/projects/<프로젝트_이름> example.webscraping.com -o /mnt/example.webscrping.com.jl
docker run -it --rm -v ~/portia_projects:/app/data/projects:rw -v ~/portia_output:/mnt:rw -p 9001:9001 scrapinghub/portia portiacrawl /app/data/projects/my_example_site example.webscraping.com -o /mnt/example.webscrping.com.jl -s CONCURRENT_REQUESTS_PER_DOMAIN=1 -s DOWNLOAD_DELAY=5