chainfeeds / rssaggregatorforweb3

Bootstrapping your personal Web3 info hub from more than 600 RSS Feeds.

RSS Aggregator for Web3 (or 🥩 RAW for short)

Bootstrapping your personal Web3 info hub from more than 600 RSS Feeds.

What is RSS or Reader Services?

RSS is a standard for contents feeds. Any website supporting this standard can be permissionless aggregated to RSS Reader Service or Apps.

"RSS to Reader" is just like "ERC-20 to Uniswap".

How to use 🥩 RAW? Just 4 steps.

1. Download the the latest RAW.opml file from this repo.
2. Choose your favorite RSS service or apps. (I strongly recommend NetNewsWire as a fresh start because it's totally free and open sourced.)
3. Import this OPML to your apps/services.
4. Syncing and Done!

How to find/add new feeds?

Medium, Github, Substack, Mirror, Ghost are natively support RSS.

For example,

• GitHub: Appending ".atom" to most links, e.g. https://github.com/bitcoin/bitcoin/releases.atom
• Substack: Appending "/feed" to link, e.g. https://0xsoros.substack.com/feed
• Mirror: Appending "/feed/atom" to link, e.g. https://ens.mirror.xyz/feed/atom
• Ghost: Appending "/rss" to link, e.g. https://fuel-labs.ghost.io/rss/
• Medium: Adding "/feed" after medium.com, e.g. https://medium.com/feed/anomanetwork

For other sites or sources, you can find many great tutorials from ALL About RSS or RSSHub.

How many feeds I can find in 🥩 RAW?

You can find the full list here. Breakdown:

• Direct source from projects: 300+ Feeds
  • Including product announcements/updates from L1/L2 Chains, Web3 DApps, Developer Tools.
• GitHub updates: 120+ Feeds
  • Including code releases or smart contract upgrades from L1/L2 Chains, Web3 DApps, Developer Tools.
• Media/Curator/Aggregator: 10+ Feeds
  • Including press or content aggregator like CoinDesk, Messari.
• Newsletters: 10+ Feeds
  • Including weekly newsletters like Week in Ethereum, Bitcoin Optech.
• Research/VCs: 30+ Feeds
  • Indluding deep dive research or analysis contents from independent researchers or VCs.
• Others: 2 Feeds
  • Including forum, communities.

Recommendation of RSS Aggregating Service

• Google Reader
• Inoreader
• Feedbin
• Feedly
• Feeder

Recommendation of App/Client

• NetNewsWire (Free!)
• Planet (Free!)
• Thunderbird (Free!)
• An Otter RSS (Free!)
• Fluent Reader (Free!)
• Feedbro (Free!)
• Raven Reader (Free!)
• Reeder
• Big News
• News Explorer

More Tutorials

• by @lufeieth: https://cryptotimemachine.notion.site/Chainfeeds-RAW-opml-2022-5-18-ab0889dda6ca4d73abbefe98e9f51f49
• by @zjavax: https://www.youtube.com/watch?v=dabK4vLpQ9k
• by @zlexdl: https://mirror.xyz/zlexdl.eth/7vAc_B_I8WdJ6Eiyp4nWgGX2lMtPKCifUI3wPEM0rTM

Based on 🥩 RAW

• All-in-one Feed by @RoCry: https://github.com/roallop/feedcooker/releases/tag/latest
• Telegram Channel by @Tweet_TgBot: t.me/web3_rss

Other Web3 related Feeds:

• 900+ Mirror Author by @zlexdl: https://github.com/zlexdl/mirror
• PrimitivesFeed：https://github.com/PrimitivesLane/PrimitivesFeed

rssaggregatorforweb3's Issues

Error when import the OPML file

I read the instruction and download the raw.opml file from the repo.
Then I use NetNewsWire to import the subscription.]
However it shows the errow below:

dac8-488e-b9f9-e3810786f2eb.jpg)

I tried to change the file name but it doesnt work.
Any problems about the origin OPML file?

Is your website system source code for sale? I also want to build a website like yours.

What I like is your website system https://www.chainfeeds.xyz/

Update Kurt Pan' Crypto Monthly link

Revue is down.
Please update
<outline text="🔐Kurt Pan’s Crypto Weekly" title="🔐Kurt Pan’s Crypto Weekly" description="" type="rss" version="RSS" htmlUrl="https://www.getrevue.co/profile/kurtpan" xmlUrl="https://www.getrevue.co/profile/kurtpan?format=rss"/>
to 🔐Kurt Pan’s Crypto Monthly https://crypto.kurtpan.pro/monthly (or some RSS feed link (how?))

RSS 的 item entry 的 id 会重复

猜测是 投研早报 产生的BUG，导致频繁推送相同的内容，以此时的内容为例：

注意 Vitalik：Degen 共产主义 —— 唯一正确的政治意识形态 这条，很明显有两个同级的 item entry：

<entry>
<title>投研早报丨Vitalik：Degen 共产主义 —— 唯一正确的政治意识形态 / 数据解读 Farcaster：活跃用户人均跨 8 个频道发帖 / 比特币生态的游戏和元宇宙</title>
<link href=""></link>
<id>urn:uuid:777f080a-ca52-9e23-00b3-a1a01d550c02</id>
<updated>2024-04-04T01:40:49+00:00</updated>
<author><name>Jewelry</name>
</author>
<summary type="html">...</summary>
</entry>

和

<entry>
<title>Vitalik：Degen 共产主义 —— 唯一正确的政治意识形态</title>
<link href="https://news.marsbit.co/20240402064259707671.html"></link>
<id>urn:uuid:a6de0b2b-61d6-28e7-b73d-bfa2de51190a</id>
<updated>2024-04-03T06:23:31+00:00</updated>
<author><name>Vitalik Buterin（以太坊联合创始人）</name>
</author>
<summary type="html">...</summary>
</entry>

首先 投研早报 并没有 link，其次由于它们同级，这已经重复推送了，但最大的问题不止于此，我个人在使用的 RSS 工具有数据库记录，可以发现对于相同 item，这个 rss 的 id 并不稳定：

sqlite> SELECT created_at,raw_id,title FROM contents WHERE title LIKE '%投研早报%唯一正确的政治意识形态%';
2024-04-04 01:54:59.953046648+00:00|urn:uuid:a23e1979-1b50-0408-01d8-20732704132c|投研早报丨Vitalik：Degen 共产主义 —— 唯一正确的政治意识形态 / 数据解读 Farcaster：活跃用户人均跨 8 个频道发帖 / 比特币生态的游戏和元宇宙
2024-04-04 02:49:12.20129679+00:00|urn:uuid:f46973ea-07d8-03aa-5767-f73c6f7d4a40|投研早报丨Vitalik：Degen 共产主义 —— 唯一正确的政治意识形态 / 数据解读 Farcaster：活跃用户人均跨 8 个频道发帖 / 比特币生态的游戏和元宇宙
2024-04-04 03:43:39.814886468+00:00|urn:uuid:1ebe76db-0541-d649-f932-83a7e037c39e|投研早报丨Vitalik：Degen 共产主义 —— 唯一正确的政治意识形态 / 数据解读 Farcaster：活跃用户人均跨 8 个频道发帖 / 比特币生态的游戏和元宇宙
2024-04-04 04:52:52.865941952+00:00|urn:uuid:7f12ef4c-066a-3456-65db-516928817755|投研早报丨Vitalik：Degen 共产主义 —— 唯一正确的政治意识形态 / 数据解读 Farcaster：活跃用户人均跨 8 个频道发帖 / 比特币生态的游戏和元宇宙
2024-04-04 05:44:39.742511187+00:00|urn:uuid:751761d9-f999-0708-fe4b-09442abfc422|投研早报丨Vitalik：Degen 共产主义 —— 唯一正确的政治意识形态 / 数据解读 Farcaster：活跃用户人均跨 8 个频道发帖 / 比特币生态的游戏和元宇宙
2024-04-04 06:44:12.408865361+00:00|urn:uuid:91dc5a7f-8fa3-5cb2-50d8-4b3c741d46ef|投研早报丨Vitalik：Degen 共产主义 —— 唯一正确的政治意识形态 / 数据解读 Farcaster：活跃用户人均跨 8 个频道发帖 / 比特币生态的游戏和元宇宙
2024-04-04 07:43:50.562128416+00:00|urn:uuid:b9df949e-6b97-c282-d892-cf7149c56cb8|投研早报丨Vitalik：Degen 共产主义 —— 唯一正确的政治意识形态 / 数据解读 Farcaster：活跃用户人均跨 8 个频道发帖 / 比特币生态的游戏和元宇宙
2024-04-04 08:51:45.789150047+00:00|urn:uuid:e98f1c14-e60e-8b18-396a-2977c8bad010|投研早报丨Vitalik：Degen 共产主义 —— 唯一正确的政治意识形态 / 数据解读 Farcaster：活跃用户人均跨 8 个频道发帖 / 比特币生态的游戏和元宇宙
...（非常多，省略）

How to get Twitter KOL data from daily?

I found that it has lots of twitter KOL data from https://www.chainfeeds.xyz/ , such as https://www.chainfeeds.xyz/feed/detail/8ec8c72e-d438-4f86-b3ae-95cc9829800a and https://www.chainfeeds.xyz/feed/detail/8ef52086-e653-480a-807b-126ff8118405 . But the RAW.opml in this project does not have RSS feeds related to Twitter KOL.