Commit Graph

8 Commits (63764a22c49a5240ca1d3347d9245c78f3f69612)

Author SHA1 Message Date
Joshua Potter 63764a22c4 Transition to a CSV; Postgres can handle that better. 2023-12-04 15:08:17 -07:00
Joshua Potter 9b9e561e49 Apply pyls-isort. 2023-12-01 16:37:05 -07:00
Joshua Potter 9b81105a5e Use lxml to speed up parsing. 2023-12-01 07:12:40 -07:00
Joshua Potter d549e5f5eb Export blitz and bullet ratings. 2023-12-01 07:10:58 -07:00
Joshua Potter 36d471e395 Export rapid ratings. 2023-11-30 20:35:20 -07:00
Joshua Potter e050d13aa7 Add class for wrapping around exports. 2023-11-30 17:30:28 -07:00
Joshua Potter bc2ffeae9d
Add a scraper for lichess. (#2) 2023-11-30 15:36:44 -07:00
Joshua Potter 10801b560c
Generalize in anticipation of merging the lichess scraper. (#1)
* Add a general `Scraper` class.

* Setup main as primary entrypoint.

* Abstract original scraper into scraper class.

* Add better logging and cleaner bash commands.

* Ensure exporting works.
2023-11-30 15:15:15 -07:00