Job Description
Key Responsibilities
Leadership & Strategy
•Lead team of 4-6 data engineers •Define analytics platform architecture and roadmap •Build data platform from scratch using open-source tools •Establish data governance and quality frameworks
Platform Architecture •Design end-to-end analytics platform on open-source stack •Build data lake house on Cloudian object storage •Architect ClickHouse for OLAP (sub-second queries) •Design multi-source ingestion (APIs, databases, SaaS) • Implement real-time and batch pipelines
Data Ingestion & ETL •Build pipelines using Airbyte (CDC, connectors, validation) •Orchestrate workflows with Apache Airflow (DAGs, monitoring, error handling) •Design incremental/full-load strategies,•Data Streaming using Kafka
Data Warehouse & Analytics •Optimize ClickHouse (materialized views, distributed tables) •Design dimensional models (star/snowflake schemas) •Build semantic layers for consistent metrics
BI Platform •Deploy Apache Superset for self-service analytics • Integrate Power BI (optional) • Implement Redis caching for performance
Data Quality & Governance • Implement quality frameworks (Great Expectations, Soda) •Build data reconciliation automation •Establish data lineage, cataloging, compliance (GDPR)
Performance & Automation •Write Python automation tools and custom connectors,• Implement CI/CD for data pipelines •Optimize costs and performance
Are you interested in this position?
Apply by clicking on the “Apply Now” button below!
#GraphicDesignJobsOnline
#WebDesignRemoteJobs #FreelanceGraphicDesigner #WorkFromHomeDesignJobs #OnlineWebDesignWork #RemoteDesignOpportunities #HireGraphicDesigners #DigitalDesignCareers# Dynamicbrand guru
Apply Now