Job
Description
DataWeave is a cutting-edge AI-powered digital commerce analytics platform that empowers retailers with competitive intelligence and equips consumer brands with digital shelf analytics on a global scale. By harnessing the power of DataWeave, retailers gain the ability to make smarter pricing and merchandising decisions, while consumer brands can optimize their digital shelf performance across key performance indicators such as share of search, content quality, price competitiveness, and stock availability. At the heart of DataWeave's capabilities lies its state-of-the-art AI-powered proprietary technology, which aggregates and analyzes 500+ billion data points, covering over 400,000 brands, 4,000+ websites, and spanning more than 20 industry verticals. We are a globally distributed team, composed of over 200 talented engineers, product managers, and eCommerce experts located across San Francisco, Seattle, Austin, and Toronto in North America, complemented by our technology-focused offices in Bangalore and Coimbatore. Data Engineering and Delivery @DataWeave We the Delivery / Data engineering team at DataWeave, deliver the Intelligence with actionable data to the customer. One part of the work is to write effective crawler bots to collect data over the web, which calls for reverse engineering and writing scalable python code. Other part of the job is to crunch data with our big data stack / pipeline. Underpinnings are Tooling, domain awareness, fast paced delivery, and pushing the envelope. How we work? It's hard to tell what we love more, problems or solutions! Every day, we choose to address some of the hardest data problems that there are. We are in the business of making sense of messy public data on the web. At serious scale! Read more on Become a DataWeaver What do we offer? Some of the most challenging data problems. Huge text and image datasets that you can play with! Ability to see the impact of your work and the value you're adding to our customers almost immediately. Opportunity to work on different problems and explore a wide variety of tools to figure out what really excites you. A culture of openness. Fun work environment. A flat hierarchy. Organization wide visibility. Flexible working hours. Learning opportunities with courses and tech conferences. Mentorship from seniors in the team. Last but not the least, competitive salary packages and fast paced growth opportunities. Relevant set of skills Candidate must have good written and oral communication skills, be a fast learner and have the ability to adapt quickly to a fast-paced development environment Has a strong grasp of CS fundamentals Hands on with Python programming Good understanding of RDBMS / SQL Excellent problem-solving and analytical abilities Optional Skills Knowledge of building crawlers and data mining is a plus. Working knowledge of open-source tools such as MySQL, Solr, Elasticsearch, Cassandra (data stores) would be a plus. Role and responsibilities Inclined towards working in a start-up environment. Design and build robust and scalable data engineering solutions for structured and unstructured data for delivering business insights, reporting and analytics. Help continually improve ongoing analysis processes, optimizing or simplifying self-service support for customers Implement various bots Configure and write Regex to extract data from simple to complex websites. Develop tools & techniques related to the various processes or data extraction automation. Work on data lake platform and different components in the data lake such as Hadoop, Amazon S3 etc. Work on SQL technologies on Hadoop such as Spark, Hive, Impala etc.
