## blockchain data engineering toolkit


### chapters
* **[token-scanner-api](token-scanner-api)**: - a mvp for a **scalable event scanner cli and api for ethereum**, through indexing and parsing blocks events. this is the first step for training **machine learning models on the chains** (e.g., high-frequency trading with deep learning) - check my mirror post **[on building a scalable event scanner for ethereum](https://mirror.xyz/go-outside.eth/vSF18xcLyfXLIWwxjreRa3I_XskwgnjSc6pScegNJWI)** * **[implementation of a draft of an EIP for rental NFTs with rights management](eip-9999)**: - this standard is an extension of ERC-721 and ERC-4907 - it proposes an API for rights management through a rental license - this framework is fully compatible with the licensing framework proposed on ERC-5218, although it can be implemented independently * **[a protocol for management and bartering of game (NFT) assets](game-protocol-design)**: - discussion, design, and implementation route of a protocol for management and bartering of game (NFT) assets * **research notes**: - **[rlp encoding](technologies/rlp_enconding.md)**
--- ### cool resources
* **[crypto data engineering guide, by a. hong (2025)](https://read.cryptodatabytes.com/p/2025-annual-guide-crypto-data-engineering)** * **[google biquery article on blockchain public datasets](https://cloud.google.com/blog/products/data-analytics/introducing-six-new-cryptocurrencies-in-bigquery-public-datasets-and-how-to-analyze-them)** * **[paradigm's data portal](https://data.paradigm.xyz/)** * **[indexed podcast (trendy metrics; chart crimes), by d. sui et al.](https://www.youtube.com/@indexed_pod)** * **[urani.trade's experiments on solana](https://github.com/urani-trade)**: - a batching orderbook on mongodb: **[orderbook-poc-ts](https://github.com/urani-trade/orderbook-poc-ts)** - a swap protocol for order intents: **[urani-swap-ts](https://github.com/urani-trade/urani-swap-ts)** - a mev solver: **[solana-mev-agent-py](https://github.com/urani-trade/solana-mev-agent-py)** - a graph visualization of order fulfillment: **[urani-arena-graph-ts](https://github.com/urani-trade/urani-arena-graph-ts)** * **[autistic symposium's ml-ai-agents-py](https://github.com/autistic-symposium/ml-ai-agents-py)** * **[autistic symposium's backend-and-orchestration-toolkit](https://github.com/autistic-symposium/backend-and-orchestration-toolkit)**