Data Engineer

Job Description

Description

Responsibilities:

• Champions innovative technology solutions to resolve sophisticated business problems
• Works across groups to find opportunities for organization-wide technology initiatives
• Brings external information, ideas, and expertise back to the team
• Identify creative ways to drive desired outcomes and promote culture of innovation by setting examples
• Collaborate with peers through code reviews, pair programming or interactive discussions daily
• Bring a data-driven & collaborative approach to decision making, both in day-to-day work and in making strategic trade-offs.
• Develop, Test, Deploy and maintain ETL Batch Jobs using Apache Spark/EMR Jobs
• Utilize Apache Spark cluster-computing framework to process big data and write to No-SQL Database ex Cassandra or Yugabyte

Requirements

• Bachelor’s degree in Computer Science, Information Systems, or a related field
• Proven track record in data engineering
• 10+ years of experience developing Spark Services for Data movement
• Hands on experience with Java clients for consuming REST and SOAP APIs and Scala spark batch application
• Experience with cloud-based data warehousing and data lake solutions such as Snowflake
• Experience with data storage and data management for large datasets like parquet, HDF5, etc.
• Proven experience in building and deploying software solutions utilizing public cloud provider services like AWS
• Good understanding of the software development process including analysis, design, coding, system and user testing, problem resolution and planning
• Ability to work across multiple squads and adaptable to change
• Embrace customer-first mentality and enjoy developing user-friendly internet facing web applications that tackle real life problems
• Have a passion for following outstanding software engineering practices and always looking to improve your engineering skills and industry knowledge

Are you interested in this position?
Apply by clicking on the “Apply Now” button below!
#GraphicDesignJobsOnline
#WebDesignRemoteJobs
#FreelanceGraphicDesigner
#WorkFromHomeDesignJobs
#OnlineWebDesignWork
#RemoteDesignOpportunities
#HireGraphicDesigners
#DigitalDesignCareers
# Dynamicbrand guru