mirror of
https://github.com/autistic-symposium/blockchain-data-engineering-toolkit.git
synced 2025-04-27 19:26:06 -04:00
36 lines
1.1 KiB
Markdown
36 lines
1.1 KiB
Markdown
## ⛓🛠 blockchain data engineering
|
|
|
|
<br>
|
|
|
|
##### 👉 this repository contains blockchain engineering projects such as scalable event scanners and infrastructure setups for on-chain analysis and machine learning models training (*e.g.*, high-frequency trading with deep learning).
|
|
|
|
##### 🛠 here is a high-level system design chart for a possible blockchain intelligence data platform (all deployed in kubernetes):
|
|
|
|

|
|
|
|
|
|
<br>
|
|
|
|
---
|
|
|
|
### scanners
|
|
|
|
<br>
|
|
|
|
|
|
|
|
* **[💎 token-scanner-api](token-scanner-api)**:
|
|
- a mvp for a **scalable event scanner cli and api for ethereum**, through indexing and parsing blocks events. this is the first step for training **machine learning models on the chains** (e.g., high-frequency trading with deep learning).
|
|
- check my mirror post **[building a scalable event scanner for ethereum](https://mirror.xyz/steinkirch.eth/vSF18xcLyfXLIWwxjreRa3I_XskwgnjSc6pScegNJWI)**.
|
|
|
|
|
|
<br>
|
|
|
|
---
|
|
|
|
### resources
|
|
|
|
<br>
|
|
|
|
* **[go-outside-labs orchestration-toolkit](https://github.com/go-outside-labs/orchestration-toolkit)**
|