Software Engineer – Data Platform

Job Description

Responsibilities

• Design, build, and operate data platform services (warehousing, orchestration, and catalogs). Continuously enhance platform operations by improving monitoring, performance, reliability, and resource optimization.
• Design, build and maintain batch and streaming data ingestion framework to source the required data for analytical and operational needs, which include onchain data, internal system data, and partner data.
• Be a domain expert in streaming processing, data pipelines, data warehousing and quality. Work closely across multiple stakeholders–including Product, Engineering, Data Science, Security and Compliance teams–on data contract modeling, data lifecycle management, governance and regulatory/legal compliance.
• Provide ML data platform capabilities for AI/Data Science teams to perform data preparation, model preparation and serving, and performance monitoring.
• Develop and maintain core services and libraries to enhance critical platform functionalities, such as cataloging data assets and lineage, tracking data versioning and quality, managing auto-backfilling, implementing access controls on data assets.

You’ll bring to

Senior Software Engineer (III):

• 4+ years of software engineering experience building data-intensive systems
• Hands-on experience designing and operating scalable batch, micro-batch, or streaming data pipelines
• Experience in business domains such as payment systems, credit cards, bank transfers, or blockchains.
• Familiarity with data governance, lineage, and provenance concepts
• Strong understanding of open-source data technologies and cloud-native data platforms
• Ability to tackle complex and ambiguous problems.
• Self-starter who takes ownership and enjoys moving at a fast pace.
• Excellent communication skills, with the ability to collaborate across multiple remote teams, share ideas and present concepts effectively.

Nice to have:

• Experience with with streaming frameworks such as Apache Flink or Google Cloud Dataflow
• Experience with NoSQL databases such as Bigtable, Cassandra

Are you interested in this position?
Apply by clicking on the “Apply Now” button below!
#GraphicDesignJobsOnline
#WebDesignRemoteJobs
#FreelanceGraphicDesigner
#WorkFromHomeDesignJobs
#OnlineWebDesignWork
#RemoteDesignOpportunities
#HireGraphicDesigners
#DigitalDesignCareers
# Dynamicbrand guru