phiresky / blog

Source code of my personal blog

Source code of my blog

https://phiresky.github.io/blog/

The posts are written in Markdown that is parsed by Pandoc, with the Pandoc AST rendered with React. This is done so the React renderer can have a few custom components, especially code blocks with specific tags are interpreted as e.g. interactive demos or charts. All the React stuff is rendered server-side with next.js to static HTML files. So most of the blog should work without JS.

It also generates an RSS feed for people that are into that.

Run yarn posts to generate the posts, then yarn dev for the hot-reloading dev server (navigate to http://localhost:3000/blog/ )

Run yarn build to run all the build steps, or yarn commit to commit a new blog version ready for pushing.

blog's Issues

"pragma vacuum" does nothing on SQLITE

from https://github.com/phiresky/blog/blob/master/posts/2020/sqlite-performance-tuning.md

On there you state to run pragma vacuum;, which is not listed anywhere on https://sqlite.org/pragma.html#toc

There is the pure VACUUM command, as talked about here: https://sqlite.org/lang_vacuum.html

Thank you for the project

Just a note to say thanks. It is a very useful project. I often have to deal with large trees of files of many kinds, including the non-open-source ones like DOCX.

I have been using this and also crgrep (https://sourceforge.net/projects/crgrep/files/), which is unfortunately getting a little old now.

Anyway, thanks!

Detailed install steps. Could not load httpvfs config: 404 Not Found for SQLite file

I've documented install commands for compatibility issues:
https://model.earth/data-pipeline/timelines/sqlite/phiresky/

I included steps from issue 11
But ultimately I still had to run npm install

The last remaining item to resolve is loading the SQLite file. Any ideas?
Error: Could not load httpvfs config: 404 Not Found

Note: You won't see the blog list locally here: http://localhost:3000
Go here instead: http://localhost:3000/blog/

Is the inclusion of "blog" in the site path a possible clue for why the SQLite file is not found?

sqlite on github pages error

This was the first thing I saw upon checking out https://phiresky.netlify.app/blog/2021/hosting-sqlite-databases-on-github-pages/:

Repeated reloads resulted in a seemingly-random cycle between expected behaviour and a return of the above error message. Observed in well-updated FF and Chrome fwiw.

Consider adding kiss-orm to the list of SQL libraries for TypeScript

I noticed your blog post about sql libraries for Typescript ( https://phiresky.github.io/blog/2020/sql-libs-for-typescript/ ).

I developed a library for that (MIT licence) which I now consider mature enough: https://github.com/Seb-C/kiss-orm

Would you consider adding it to the list?

I designed it with a completely different approach and think it could be useful to people.

SQLite memory mapping comment

Hi, not sure if this is the right place for comments. I notice you mention:

Uses memory mapping instead of read/write calls when db is < mmap_size.

Maybe I misread it, but I took this to mean "when total database size > mmap_size, the memory mapping would not be used at all". I later found out the memory mapping will still be used, but only for the starting bytes of the database up to mmap_size, so it can still give some performance benefit. It also might be worth noting a warning from the SQLite documentation: if a read fails (e.g. USB stick pulled out of drive), then you'll get a signal or crash rather than a graceful read error! But that's OK for some applications.

Compatibility errors with React libraries

Hello, I found your blog project very interesting, and I tried to replicate it in my local environment, but it is showing some compatibility errors with React libraries.

Below is the error that is happening.

npm WARN using --force Recommended protections disabled.
npm WARN ERESOLVE overriding peer dependency
npm WARN While resolving: [email protected]
npm WARN Found: [email protected]
npm WARN node_modules/react
npm WARN   react@"^18.2.0" from the root project
npm WARN   32 more (@emotion/react, ...)
npm WARN 
npm WARN Could not resolve dependency:
npm WARN peer react@"^15.3.2 || ^16.0.0" from [email protected]
npm WARN node_modules/react-katex
npm WARN   react-katex@"^2.0.2" from the root project
npm WARN 
npm WARN Conflicting peer dependency: [email protected]
npm WARN node_modules/react
npm WARN   peer react@"^15.3.2 || ^16.0.0" from [email protected]
npm WARN   node_modules/react-katex
npm WARN     react-katex@"^2.0.2" from the root project

➜  ~ node -v 
v18.13.0
➜  ~ npm -v 
9.6.5
➜  ~ yarn -v 
1.22.17
➜  ~ 

Just a quick one - firefox error on sqlite post

Hi, just got a SharedArrayBuffer error on firefox while trying to run one of your code blocks on the sqlite post:
https://stackoverflow.com/questions/64650119/react-error-sharedarraybuffer-is-not-defined-in-firefox
Hope this helps!

Failing to build from example

Hi

I'm a complete typescript novice and was trying to rebuild a working blog from this repo to explore using the sqlite components.

After installing TypeScript (npm install typescript) I tried the yarn build command but it failed on:

client/pages/index.tsx:3:21 - error TS2307: Cannot find module '../../posts-built/summary.json' or its corresponding type declarations.

Chasing dow the errors, I created an empty posts-built/summary.json file, then one with the contents {"posts":[]}, but it still wants more; does a schema, or some such, for that object need defining somewhere to be able to run the build?