Senior Data Engineer

Job Description

Key Responsibilities

Data Ingestion & ETL

• Build and maintain data pipelines using Airbyte from multiple sources
• Configure connectors for databases (PostgreSQL, MySQL, MongoDB), APIs, SaaS applications
• Implement CDC for real-time data replication or using kafka streaming
• Design incremental and full-load sync strategies
• Ensure data validation and quality checks 

Workflow Orchestration

• Develop and maintain Airflow DAGs for ETL workflows
• Implement error handling, retry logic, and monitoring
• Schedule complex multi-step data pipelines
• Integrate with databases, APIs, and external systems

Data Warehouse & Analytics

• Design and optimize ClickHouse schemas for OLAP
• Write advanced SQL queries and optimize performance
• Implement materialized views and aggregations
• Manage data partitioning and retention policies
• Build data marts for analytics use cases

Are you interested in this position?

Apply by clicking on the “Apply Now” button below!

#GraphicDesignJobsOnline

#WebDesignRemoteJobs #FreelanceGraphicDesigner #WorkFromHomeDesignJobs #OnlineWebDesignWork #RemoteDesignOpportunities #HireGraphicDesigners #DigitalDesignCareers# Dynamicbrand guru