Commit Graph

9 Commits (58815d3ae5a69cac12436a01e77019a5ac5d16a7)

Author SHA1 Message Date
Joshua Potter 811cf997d1 Update app name and version. 2023-12-08 17:55:49 -07:00
Joshua Potter 44a18fc59c Add language detection for chesscom profiles. 2023-12-07 05:12:13 -07:00
Joshua Potter 82dbef21b6
Fix all mypy warnings. (#9) 2023-12-05 12:54:12 -07:00
Joshua Potter 8d7f1e7c4a
Scrape content into an asynchronous pipeline. (#8) 2023-12-05 11:43:13 -07:00
Joshua Potter 9b81105a5e Use lxml to speed up parsing. 2023-12-01 07:12:40 -07:00
Joshua Potter 10801b560c
Generalize in anticipation of merging the lichess scraper. (#1)
* Add a general `Scraper` class.

* Setup main as primary entrypoint.

* Abstract original scraper into scraper class.

* Add better logging and cleaner bash commands.

* Ensure exporting works.
2023-11-30 15:15:15 -07:00
Joshua Potter fe2e504de9 Package into app for `nix build`. 2023-11-28 05:53:09 -07:00
Joshua Potter 27577aa5b0 Add `mypy` and lock poetry dependencies. 2023-11-28 04:55:09 -07:00
Joshua Potter 1710e1aefa Initial commit. 2023-11-27 13:09:40 -07:00