Architecture

Fast flow — sensors

• —JSON files from 2 apartments via local network
• —recup.py polls every minute using asyncio
• —Raw files stored in Bronze (timestamped paths)
• —Flattened → Silver → aggregated → Gold

Slow flow — weather

• —CSV downloaded daily from sFTP (Meteo2) at ~7am
• —Raw CSV stored in Bronze
• —Parsed, standardized → Silver
• —Joined with sensor data in Gold for ML features

ML enrichment

• —Reads from Gold layer
• —Energy consumption forecast (time series)
• —Room presence prediction (classification)
• —Writes predictions back to Gold as new fact tables

BI layer

• —Power BI — energy & environment dashboards
• —SAP Analytics Cloud — room presence dashboard
• —Row-level security per apartment owner
• —Available in FR, ES, RO, PT