This repository was archived by the owner on May 26, 2026. It is now read-only.

Name		Name	Last commit message	Last commit date
crawled_data		crawled_data
scrapy_crawler		scrapy_crawler
.gitignore		.gitignore
Dockerfile		Dockerfile
README.md		README.md
__init__.py		__init__.py
docker-compose.yaml		docker-compose.yaml
main.py		main.py
main_local.py		main_local.py
models.py		models.py
provider.py		provider.py
requirements.txt		requirements.txt
scrapy.cfg		scrapy.cfg

Repository files navigation

crawler service

crawl articles from popular news publishers in Vietnam:

VnExpress
TuoiTre
NguoiLaoDong

Tech stack

Flask
Scrappy

Installation

Prerequisites:

Python 3.8+
Docker
Docker Compose

Run the service

docker-compose build

docker-compose up -d

Run locally

Run file main_local.py

About

Crawl popular news publishers in Vietnam

crawler news scraping vietnamese

Custom properties

0 stars

2 watching

Report repository

Contributors

Languages