- Clone repo
- go mod tidy
- mkdir output && mkdir output/html && output/csv
- https://go.dev/doc/faq#git_https
- https://github.com/libsql/libsql-client-go/blob/main/examples/sql/counter/main.go
https://github.com/tursodatabase/libsql/blob/main/libsql-server/docs/BUILD-RUN.md
Instructions for mac install were buried bc they changed repos
https://turso.tech/ Managed SQlLite as libSQL seems promising way to add db to app very quickly with flat file local dev and generous free tier
- Create output directories
- add git version to output maybe
A competitor that beat gordon at purple shouldn't be considered to beat gordon at black belt
Refresh data daily/weekly/etc
If a user beats gordon in EBI should that count for ADCC? What about points
I need to be able to record when a file was cached locally and then use current date to validate/expire the cache date I think for now once a month or week would really be fine.
https://github.com/gocolly/colly/blob/master/_examples/local_files/local_files.go
Update local cache and rescrape
Currently they are using weird ?p=# url and want the actual resolved urls
If you need to have sqlite first in your PATH, run: echo 'export PATH="/usr/local/opt/sqlite/bin:$PATH"' >> ~/.zshrc
For compilers to find sqlite you may need to set: export LDFLAGS="-L/usr/local/opt/sqlite/lib" export CPPFLAGS="-I/usr/local/opt/sqlite/include"
For pkg-config to find sqlite you may need to set: export PKG_CONFIG_PATH="/usr/local/opt/sqlite/lib/pkgconfig"
- https://github.com/actyx/ipfs-sqlite-block-store
- https://github.com/dpapathanasiou/simple-graph-go
- Demo Video: https://www.hytradboi.com/2022/simple-graph-sqlite-as-probably-the-only-graph-database-youll-ever-need
must send https://www.bjjheroes.com
not just www...
weirdly it just failed silently would have expected an error.
must run go mod init after
I'd like to just have
/src
- main.go /package1
- package1.go /package2
- package2.go ...
but not sure entirely how to accomplish this. main.go
should just setup the code with flags and then call
into the src/ packages.
Go community pretty opinionated and have a standard https://github.com/golang-standards/project-layout
Sheliah Lindsey Magness BJJ has original url: https://www.bjjheroes.com/?p=13193 which redirects to: https://www.bjjheroes.com/wp-content/uploads/2023/01/CarlosHenrique.jpg
it should be: https://www.bjjheroes.com/bjj-fighters/sheliah-lindsey