A Bitcoin-native LLM: dataset, architecture and open questions

I expect that the corpus of Bitcoin related text is relatively small compared to the corpuses that frontier models are trained on (at minimum all text on the internet + anna’s archive) and the practical experience of many + literature indicates that domain specific finetuning is rarely worth the time and effort compared to building something general like RAG that you can just plug the latest frontier model into.

It would be nice if there were an index of high quality bitcoin-specific content that traditional search engines struggle to score highly like mailing list posts, github comments, git commit messages, code comments, IRC discussions, the social media posts of people that write about bitcoin, BTC transcripts, Bitcoin Optech, BSE, blog posts, etc. and feed these to {CURRENT_FRONTIER_MODEL} with an MCP tool that can search this index.

This is very close but I’m not sure how maintained it is:

It seems to do a good job of finding mailing list posts and text on BTC transcripts, but some stuff is missing from the crawlers: GitHub - bitcoinsearch/scraper · GitHub . I don’t know hard it would be to add e.g. b10c’s mirror of github content to it.

1 Like