Commit Graph

7 Commits (f2fd2892255e3bd0696fb12b69b705dfeb494b9b)

Author SHA1 Message Date
Joshua Potter 82dbef21b6
Fix all mypy warnings. (#9) 2023-12-05 12:54:12 -07:00
Joshua Potter 8d7f1e7c4a
Scrape content into an asynchronous pipeline. (#8) 2023-12-05 11:43:13 -07:00
Joshua Potter 9b81105a5e Use lxml to speed up parsing. 2023-12-01 07:12:40 -07:00
Joshua Potter 10801b560c
Generalize in anticipation of merging the lichess scraper. (#1)
* Add a general `Scraper` class.

* Setup main as primary entrypoint.

* Abstract original scraper into scraper class.

* Add better logging and cleaner bash commands.

* Ensure exporting works.
2023-11-30 15:15:15 -07:00
Joshua Potter fe2e504de9 Package into app for `nix build`. 2023-11-28 05:53:09 -07:00
Joshua Potter 27577aa5b0 Add `mypy` and lock poetry dependencies. 2023-11-28 04:55:09 -07:00
Joshua Potter 1710e1aefa Initial commit. 2023-11-27 13:09:40 -07:00