Data Engineer – Microsoft Fabric
Job Description
Job Description
Experience:
– Overall 6+ years of experience in Azure Data Engineering and Data Warehousing.
– At least 2-3 years of hands-on experience with Microsoft Fabric.
Technical Skills:
– Strong understanding of Data Warehousing concepts, architecture, and best practices.
– Hands-on experience in designing and implementing Enterprise Data Warehouse (EDW) solutions.
– Good experience in Dimensional Data Modeling using Star and Snowflake schema techniques.
– Strong knowledge of ETL/ELT design and implementation.
Microsoft Fabric Components:
– Hands-on experience with:
– Lakehouse
– Data Factory
– Data Pipelines
– Notebooks (PySpark)
– Warehouse
– Semantic Models
– Power BI Reporting (optional)
Data Engineering & Optimization:
– Developing data transformation logic using PySpark and SQL.
– Strong SQL programming and query optimization skills.
– Experience working with Delta Lake tables and Medallion Architecture (Bronze, Silver, Gold).
– Experience with Metadata-Driven ETL/ELT Frameworks.
– Understanding of Incremental Data Loading, CDC (Change Data Capture), and SCD (Slowly Changing Dimensions).
– Experience in data validation, reconciliation, and end-to-end testing.
– Strong understanding of data quality frameworks and validation techniques.
– Experience in performance tuning and optimization of ETL pipelines and SQL queries.
– Ability to troubleshoot and resolve production data issues within SLA timelines.
– Experience in monitoring data pipelines, job failures, and root cause analysis.
Azure & DevOps (Optional):
– Hands-on experience with Azure DevOps for source code management and CI/CD implementation.
– Experience creating and maintaining build and release pipelines.
– Knowledge of Git branching strategies and version control best practices.
– Experience in deployment automation across Development, UAT, and Production environments.
Data Integration:
– Experience integrating data from multiple source systems such as SQL Server, Oracle, SAP, REST APIs, and flat files.
– Experience with incremental and full-load data ingestion patterns.
– Knowledge of handling structured and semi-structured data (JSON, XML, CSV, Parquet).
Project Experience:
– Hands-on experience in at least one end-to-end Data Warehouse implementation project, from requirements gathering through production deployment and hypercare support.
– Experience participating in solution design, technical discussions, and architecture reviews.
– Ability to estimate development effort and prepare technical design documents.
Soft Skills:
– Strong analytical and problem-solving skills.
– Excellent debugging and troubleshooting abilities.
– Good communication and stakeholder management skills.
– Ability to work independently and collaboratively within Agile/Scrum teams.
– Willingness to mentor junior team members and participate in knowledge-sharing sessions.
Preferred Skills:
– Microsoft Fabric Certification (DP-700 or equivalent) is preferred.
– Knowledge of Power BI and Semantic Models.
– Exposure to Azure Data Factory, Azure Synapse Analytics, or Databricks/PySpark is mandatory.
– Experience working in Retail, Manufacturing, or Financial Services domains is desirable.
Are you interested in this position?
Apply by clicking on the “Apply Now” button below!
#GraphicDesignJobsOnline
#WebDesignRemoteJobs
#FreelanceGraphicDesigner
#WorkFromHomeDesignJobs
#OnlineWebDesignWork
#RemoteDesignOpportunities
#HireGraphicDesigners
#DigitalDesignCareers
# Dynamicbrand guru
