Data Engineer (AI-driven Data Platform)

Job Description

About the Role

• Build and improve large-scale data platforms that support an AI-powered SaaS product
• Work with tens of terabytes of enterprise data used by real business users
• Design data foundations for future AI / data science use cases
• Work on a proven product with real users and real impact

Responsibilities

• Design, build, and improve big data pipelines for a SaaS + database product
• Develop and maintain data pipelines for:
• Web data crawling
• Data cleansing and enrichment
• Build data quality monitoring and validation systems
• Improve scalability, performance, and cost efficiency of data infrastructure
• Design data platforms and data quality foundations with future analytics and AI usage in mind

Tech Stack

Data Ingestion

• Python (Scrapy)
• AWS Fargate (Amazon ECS)
• Amazon Managed Workflows for Apache Airflow

Data Processing

• Apache Spark (Databricks)

Infrastructure & Tools

• AWS, Databricks
• GitHub, Slack, Notion, Asana, Google Workspace
• Cursor / Claude Code (AI-assisted development, refactoring)
• CodeRabbit (AI-based PR review)
• n8n (AI workflow orchestration)

Requirements

• Experience processing data using SQL and Python
• Experience working with public cloud platforms (AWS, GCP, etc.)
• Currently residing in Japan, or willing and able to relocate to Japan
• Business-level Japanese communication skills (equivalent to JLPT N1)

Are you interested in this position?

Apply by clicking on the “Apply Now” button below!

#GraphicDesignJobsOnline

#WebDesignRemoteJobs #FreelanceGraphicDesigner #WorkFromHomeDesignJobs #OnlineWebDesignWork #RemoteDesignOpportunities #HireGraphicDesigners #DigitalDesignCareers# Dynamicbrand guru