Job Description
Key Responsibilities:
– Fabric Implementation: Build data pipelines, notebooks, and Spark jobs within Microsoft Fabric.
– Data Ingestion & Integration: Develop ingestion pipelines (Azure Data Factory or Fabric Pipelines) from various sources.
– Data Transformation & Modeling: Implement data transformations using Fabric Dataflows Gen2, Spark SQL, and Python.
– OneLake & Data Warehouse Management: Manage storage in OneLake, build SQL analytics endpoints, and optimize data warehousing.
– Optimization & Monitoring: Troubleshoot performance bottlenecks in Spark jobs and pipelines to ensure high performance.
– Security & Governance: Implement security protocols (RBAC, private endpoints) to ensure data integrity.
– DevOps & CI/CD: Implement DevOps practices, including version control (Git) and automated deployment (CI/CD).
Qualifications:
– Platforms: Microsoft Fabric (Mandatory), Azure Data Factory, Azure Synapse Analytics, ADLS Gen2.
– Languages: Python (PySpark), SQL, Spark SQL.
– Data Processing: Delta Lake (ACID transactions, schema evolution), ETL/ELT pipelines, Medallion Architecture (Bronze/Silver/Gold).
– Reporting: Power BI (DAX, Power Query M).
– Other: Data Modeling (Star Schema), Azure DevOps, Git.
Preferred Qualifications:
– Education: Bachelor’s degree in Computer Science, Data Engineering, or related field.
– Certifications: Microsoft Certified: Azure Data Engineer Associate (DP-203) or Fabric-specific certifications are preferred.
– Experience with Open Source Cloud and configuration management tools (Terraform, Ansible, etc.).
– Experience with alternate cloud providers.
Are you interested in this position?
Apply by clicking on the “Apply Now” button below!
#GraphicDesignJobsOnline
#WebDesignRemoteJobs
#FreelanceGraphicDesigner
#WorkFromHomeDesignJobs
#OnlineWebDesignWork
#RemoteDesignOpportunities
#HireGraphicDesigners
#DigitalDesignCareers
# Dynamicbrand guru