Data Engineer

Job Description

Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks.
• Build and optimize ETL/ELT workflows for structured and unstructured data.
• Develop and manage data ingestion processes from multiple data sources.
• Process and analyze large-scale datasets using Apache Spark and PySpark.
• Design and maintain data models to support analytics and reporting.
• Optimize data pipeline performance and ensure data accuracy and quality.
• Collaborate with business and technical stakeholders to understand and translate data requirements.
• Implement data governance, security, and engineering best practices.
• Monitor, troubleshoot, and enhance existing data pipelines and data workflows.
• Document technical designs, processes, and data engineering standards.
• Contribute to the continuous improvement of data architecture and engineering practices.

Required Qualifications & Skills

• Bachelors degree in Computer Science, Information Technology, Engineering, or a related field.
• 57 years of experience in Data Engineering or a similar role.
• Strong hands-on experience with Databricks.
• Strong proficiency in Apache Spark and PySpark.
• Strong SQL skills and experience working with relational databases.
• Hands-on experience developing ETL/ELT data pipelines.
• Experience with at least one major cloud platform: Azure, AWS, or GCP.
• Solid understanding of data warehousing concepts and dimensional modeling.
• Experience with version control systems such as Git.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and collaboration skills.

Preferred Skills

• Experience with Delta Lake and Lakehouse architecture.
• Familiarity with AWS Glue or equivalent cloud data services.
• Experience with orchestration tools such as Apache Airflow.
• Knowledge of CI/CD practices for data engineering.
• Experience implementing data quality, governance, and monitoring solutions.
• Databricks or cloud platform certifications are a plus

Are you interested in this position?
Apply by clicking on the “Apply Now” button below!
#GraphicDesignJobsOnline
#WebDesignRemoteJobs
#FreelanceGraphicDesigner
#WorkFromHomeDesignJobs
#OnlineWebDesignWork
#RemoteDesignOpportunities
#HireGraphicDesigners
#DigitalDesignCareers
# Dynamicbrand guru