OmniFlow is a prefect based data orchestration and lakehouse platform which streamlines data ingestion and transformation. It is a meta data driven framework and supports structured and unstructured data ingestion and provides capabilities to transform the data for different data modelling requirements
OmniFlow is a prefect based data orchestration platform to create and manage enterprise datalakehouse in AWS. It is UI based metadata driven platform to setup data ingestion for structured and unstructured data.
Meta data and event driven orchestration for different ingestion and transformation jobs using Prefect
This platform can setup data ingestion pipeline for different databases like postgre, mysql, oracle and SQL Server. It also supports file ingestion workflow and also supports API based data ingestion
Out of the boz it supports building data lake in AWS S3 and lakehouse using S3 tables.
Platfrom uses spark and duckdb to support disctributed data transformation