Switch to English?
Yes
Переключитись на українську?
Так
Переключиться на русскую?
Да
Przełączyć się na polską?
Tak
HTTPS://m-ets.ru scrapper
I deciphered the m-ets cipher and created the functions for generating cookies on the fly.
The scrapper is asynchronous. It works with Celery. You can monitor tasks with Flower.
The scrapper is super effective. It uses only bs4. There is a possibility of using proxy.
It scrapes around 110K lots. The total data size is above 10GB. The database record has more than 30 fields.
It downloads all files and extracts all periods from a lot of page.
I used MongoDB database.
I attached the example of database record.
Work details
Budget 5000 UAH
Added 30 March 2020
2064 views

4 likes
Freelancer
Dmytro Ohorodnik
Ukraine Khmelnitskyi  43  0

Very busy Very busy
44 Safe completed
1 arbitration procedure
On service 5 years