Web Scrape Developer (Python)

Job Description

Responsibilities

• Analyse retailer websites to identify product and price attributes and collect data
• Build and deploy web crawlers using Python Scrapy and our cloud deployment platform using best practices
• Perform web crawler scheduling, monitoring and maintenance
• Perform data processing using text matching techniques such as fuzzy match
• Advocate for exceptional code design, and contribute to shaping a culture of design at ShopGrok
• Improve existing code base, architecture and workflows where possible

Requirements

• You have 2+ years experience with Python either in a business environment, or through heavy exposure during your studies which can be demonstrated
• You have built web crawlers using Python Scrapy and can demonstrate them, for example via your Github profile
• You have a very strong understanding of HTTP protocols, HTML and DOM concepts, and are adept at using XPath to identify elements in web pages
• You have experience using Chrome Developer Tools (or equivalent) to interrogate a web page to identify page elements, data sources and API calls
• You have experience interrogating APIs and working with data in JSON format
• You have a strong knowledge of regular expressions and the Python re library
• A working knowledge of SQL to analyse data. Experience building ETL workflows with tools such as Alteryx to blend, cleanse and model data is a big plus
• You are a thoughtful and considered communicator who thrives on sharing ideas
• You have experience using version control tools such as Git
• Experience building and maintaining APIs using tools such as Flask would be a big plus
• Likewise, experience with DevOps in the cloud, such as maintaining virtual machines in GCP would also be a big plus

Are you interested in this position?

Apply by clicking on the “Apply Now” button below!

#GraphicDesignJobsOnline

#WebDesignRemoteJobs #FreelanceGraphicDesigner #WorkFromHomeDesignJobs #OnlineWebDesignWork #RemoteDesignOpportunities #HireGraphicDesigners #DigitalDesignCareers# Dynamicbrand guru