Lyftrondata Architecture
This page define the Lyftrondata Architecture flow.
Lyftrondata Fabric (Application Server)
Lyftrondata Application server where the user manage the pipeline and configuration.
DB Server (Project Metadata DB)
Store the actual data related to application.
DB Server (Admin Metadata DB)
Store the metadata of the application.
Lyftrondata Fabric Highly Scalable (Job Server Pods)
Job server pods (multiple warehouses) where lyftrondata application deploy and run the jobs for the pipelines.
Warehouse Logs Server (S3/Wasabi/Blob/Google Storage)
A centralized system for managing and storing warehouse logs, integrated with cloud storage solutions (S3, Wasabi, Blob, Google Storage) for scalable and cost-effective storage.
DB Server (Warehouse Metadata DB)
Store and manage the data related to the jobs runs on multiple warehouses.
Notification Services (Email/Slack)
Facilitates sharing of job-related information through email and Slack notifications.
Last updated