owulveryck / repocketable Goto Github PK

Tying to grab the Feynman lectures (eg https://www.feynmanlectures.caltech.edu/I_01.html) leads to a 403.

The webserver requires custom headers; for example this request is ok:

curl -I https://www.feynmanlectures.caltech.edu/I_01.html \
>   -H 'sec-ch-ua: "Chromium";v="94", "Google Chrome";v="94", ";Not A Brand";v="99"' \
  -H 'Referer: https://www.feynmanlectures.caltech.edu/I_01.html' \
  -H 'sec-ch-ua-mobile: ?0' \
  -H 'User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.81 Safari/537.36' \
  -H 'Range: bytes=294912-' \
  -H 'sec-ch-ua-platform: "macOS"' \
  --compressed

I think about changing the NewDownloader function to take ... string as argument.

We may create a custon roundtripper that sets the header automatically:

type customTransport struct {
	*http.Transport
}

func (c *customTransport) RoundTrip(req *http.Request) (*http.Response, error) {
	req.Header.Set("blabla", "blabla")
	return c.Transport.RoundTrip(req)
}

Hi,

as per subject.
I have just installed the current version of repocketable on Ubuntu 22.04LTS.

the toEpub binary works with other website, but if I try to run e.g.:

#> ./toEpub https://danafblankenhorn.substack.com/p/the-hinge-point

all I get is this error message, and no ePUB file is created:
2024/04/18 11:08:00 Cannot fill document: bad sethttps://substackcdn.com/image/fetch/w_424

what does this exactly mean, and can it be fixed on repocketable's side?

Thanks,
M.

Hello,
I found your post and this project on Hacker news and I love it!

While I've unfortunately not the bandwidth to contribute myself, I wanted to suggest an idea that may increase adoption: Kindle support.

It would means 2 distinct features:

• convert the epub to .mobi
• optionally, send the generated .mobi to the email address associated to the kindle

PS: Your link Archive in the navbar of your site does not work: https://blog.owulveryck.info/post/

The links in the section https://github.com/owulveryck/rePocketable#features

are misinterpreted as relative links:
e.g. github.com/go-latex/latex

is currently

https://github.com/owulveryck/rePocketable/blob/master/github.com/go-latex/latex

but should be https://github.com/go-latex/latex

same for the others