Databricks Lead – Python/PySpark/SQL

Job Description

Required Skills :

– Strong hands-on experience with Azure Databricks – Notebooks, Delta Lake, Jobs & Orchestration.

– Deep expertise in Apache Spark, PySpark & Spark SQL.

– Strong Python programming skills for data processing & automation.

– Strong SQL – complex queries, analytical functions & performance tuning.

– Knowledge of Databricks Genie and its application in engineering workflows.

– Strong experience with CI/CD & Git-based development.

– Expertise in Data Modeling & ETL/ELT pipeline design.

– Experience with automation frameworks & scheduling tools.

– Strong understanding of Distributed Systems & Big Data concepts.

What You’ll Do :

– Lead the design and development of scalable Databricks data engineering solutions, optimize Spark workloads, build robust ETL/ELT pipelines, and provide technical leadership to the data engineering team.

Are you interested in this position?
Apply by clicking on the “Apply Now” button below!
#GraphicDesignJobsOnline
#WebDesignRemoteJobs
#FreelanceGraphicDesigner
#WorkFromHomeDesignJobs
#OnlineWebDesignWork
#RemoteDesignOpportunities
#HireGraphicDesigners
#DigitalDesignCareers
# Dynamicbrand guru