ETL Tester (Databricks)

Job Description

Your new role

The Databricks ETL Tester is responsible for designing and executing complex data testing activities across Databricks-based data solutions. The role ensures the integrity and quality of data across all layers of the platform and supports the migration of large-scale historical datasets from legacy environments.

The tester will work closely with Databricks Engineers responsible for backend pipeline development, while front-end and reporting solutions (e.g. Power BI) are delivered by a separate BAU team.

Technology Environment

• Platform: Databricks on Microsoft Azure
• Processing Framework: Apache Spark
• Architecture: Medallion Framework
  • Bronze: Raw ingestion layer using watermarking for incremental loads
  • Silver: Transformation layer (joins, calculations, facts and dimensions)
  • Gold: Aggregated and curated datasets for consumption (e.g. Power BI)
• Languages & Tools:
  • SQL (primary testing language)
  • Python
  • Databricks notebooks (hundreds in scope)
  • Databricks Gini (AI-assisted development)
• Data Volumes: Very large datasets, including 10+ years of historical data

What you’ll need to succeed

Required Skills & Experience (Essential)

• Proven experience in data testing and data quality assurance
• Very strong SQL skills (mandatory)
• Hands-on experience testing ETL / ELT pipelines
• Strong understanding of data modelling (facts and dimensions)
• Ability to analyse complex data transformations and lineage
• Experience working in Agile delivery teams
• Strong attention to detail and high-quality defect documentation skills

Are you interested in this position?

Apply by clicking on the “Apply Now” button below!

#GraphicDesignJobsOnline

#WebDesignRemoteJobs #FreelanceGraphicDesigner #WorkFromHomeDesignJobs #OnlineWebDesignWork #RemoteDesignOpportunities #HireGraphicDesigners #DigitalDesignCareers# Dynamicbrand guru