Comments (4)
Thanks for the suggestion @MrHamel and thanks for the detailed report @Teqed !
For user profile backfilling, there is a user/notes endpoint but it requires a userID which does not parse from the user's name in the URL. It should be possible to make a request against the users/search endpoint and provide the parsed username as the query parameter, which will return the required userID.
That's the same with Mastodon, see
Line 216 in 213ef57
Because the user URLs match the same pattern as Mastodon profiles, the choices here would be to either:
- After failing against any Mastodon API, attempt Misskey/Calckey API.
- Implement nodeinfo as discussed here to determine the appropriate API.
I'm personally strongly in favour of the 2nd option here. Doing 2 requests per user seems wasteful.
I'm not currently having capacity to actually implement this, but hopefully later in the summer. If you have an itch, and the time, I'd be very happy, too, though ๐
from fedifetcher.
Additional information:
Calckey is downstream of Misskey, differences are noted.
.well-known/nodeinfo
response: Yes- Nodeinfo path:
{server}/nodeinfo/2.0
and{server}/nodeinfo/2.1
- Nodeinfo response:
misskey
orcalckey
- Users URL pattern:
{server}/@{user}
- "Posts" URL pattern:
{server}/notes/{id}
Calckey's API documentation mentions notes/children and notes/conversation endpoints which can be POSTed to using a noteID as parsed from the URL. This appears to function similar to Mastodon's Context API and respectively fetch ancestors and descendants of a "note".
A CLI example: curl -X POST -H "Content-type: application/json" -H "Accept: application/json" -d '{ "noteId": "{id}" }' {server}/api/notes/children
will return a JSON with the replies, including a URL that can be handed back to the local Mastodon server's search API for lookup.
For user profile backfilling, there is a user/notes endpoint but it requires a userID
which does not parse from the user's name in the URL. It should be possible to make a request against the users/search endpoint and provide the parsed username as the query
parameter, which will return the required userID
.
Because the user URLs match the same pattern as Mastodon profiles, the choices here would be to either:
- After failing against any Mastodon API, attempt Misskey/Calckey API.
- Implement
nodeinfo
as discussed here to determine the appropriate API.
from fedifetcher.
Let's reopen this issue since the script still does not import posts into CalcKey/FireFish instances, thanks.
from fedifetcher.
Apologies @MrHamel. Like @ToadKing i understood this issue to mean to offer support for pulling in content from Calckey/Firefish instances, not to actually support running FediFetcher against them.
I need to be honest though: I do not have a Firefish instance, so Iโm unable to implement Firefish support myself. Unless someone else came along and implemented this, and was willing to commit to ongoing testing and support Firefish, this is unfortunately very unlikely to be implemented in FediFetcher.
from fedifetcher.
Related Issues (20)
- Add option not to include timestamp in logs HOT 7
- FediFetcher fails on checking followings with 401 HOT 4
- [Question] Is it necessary for Akkoma? HOT 2
- 7.0.5 breaks logging when launched as a cronjob HOT 4
- blocks and run FediFetcher as Admin HOT 5
- Implement more detailed UA HOT 3
- โRate-Limitโ FediFetcher HOT 13
- Robots.txt parsing might not be 100% correct HOT 5
- Robots.txt is fetched for every request made. HOT 1
- 7.1.2 Crashes due to an error in copy-pasted code HOT 1
- from-lists causes TypeError HOT 3
- Add custom extension to robots.txt cache HOT 1
- Job failed: 'dict' object is not callable HOT 6
- Backfill profiles while fetching list context
- Check out any other software that might be worth supporting HOT 21
- FediFetcher crashes when using multiple tokens (admin:read:accounts scope) HOT 4
- Handling of threads.net HOT 1
- Should I set "Application Website" or "Redirect URI" in the Mastodon app when using GitHub actions? HOT 1
- getAllRepliesToKnownPosts: All jobs have failed HOT 4
- Seems to be fetching lots of replies not connected to posts in my home feed HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fedifetcher.