blockchain-data-engineering-toolkit/README.md

blockchain data engineering toolkit

chapters

• token-scanner-api:

  • a mvp for a scalable event scanner cli and api for ethereum, through indexing and parsing blocks events. this is the first step for training machine learning models on the chains (e.g., high-frequency trading with deep learning)
  • check my mirror post on building a scalable event scanner for ethereum

• implementation of a draft of an EIP for rental NFTs with rights management:

  • this standard is an extension of ERC-721 and ERC-4907
  • it proposes an API for rights management through a rental license
  • this framework is fully compatible with the licensing framework proposed on ERC-5218, although it can be implemented independently

• a protocol for management and bartering of game (NFT) assets:

  • discussion, design, and implementation route of a protocol for management and bartering of game (NFT) assets

• research notes:

  • rlp encoding

---

cool resources

• urani.trade's experiments on solana:
  • a batching orderbook on mongodb: orderbook-poc-ts
  • a swap protocol for order intents: urani-swap-ts
  • a mev solver: solana-mev-agent-py
  • a graph visualization of order fulfillment: urani-arena-graph-ts
• autistic symposium's ml-ai-agents-py
• autistic symposium's backend-and-orchestration-toolkit
• google biquery article on blockchain public datasets
• paradigm's data portal
• crypto data engineering guide, by a. hong (2025)