Portable Data Platform
Thoughts of Portable Data Platform
CHANGELOG
- [2024-04-02] Init thought about the platform
Key Notes
Youtube Video for Showcase → Deploy Data Services using K8s
- Having question why they’ve been spent to much money for building data platforms (including pipelines, database, frontend, etc …)
- Recently I shared why we can save efforts and cost of building the mess by using OSS
Solution and Project
- Target: Building sandbox data platform
- Problem statement:
- Functional requirements:
- Non-functional requirements:
Components
- ETL engine
- Storage engine
- Visualization
- Portable / Configuration engine