Bigdata + GCP Engineer

Must have :

• We are looking for energetic, high-performing and highly skilled data engineers to help shape our technology and product roadmap.
• You will be part of the fast-paced, entrepreneurial Global Campaign Tracking (GCT) team under Enterprise PersonalizationPortfolio focused on delivering the next generation of global marketing capabilities.
• The team is responsible for marketing campaign tracking of new accounts acquisition and bounty payments and leverages large scale data engineering technologies, such as such as Adobe Analytics, Google Analytics, SQL, PySpark, GCP, Big Query, Data Proc, Hive, Kafka & Java.
• Focus: Designs, develops, solves problems, debugs, evaluates, modifies, deploys, and documents software and systems that meet the needs of customer-facing applications, business applications, and/or internal end user applications.

Minimum Qualifications:

This high energy Engineer must have:

• A Bachelor’s degree in computer science, computer engineering, other technical discipline, or equivalent
• Hands-on expertise with application design, software development, and automated testing.
• Strong programming knowledge in SQL, PySpark, Data Proc, Big QueryHands-on experience in Big Data technologies (Spark, Hive)
• Understanding and experience with UNIX / Shell / Perl / Python scriptingDatabase query optimization and indexingWeb services design and implementation using REST / SOAP and Java is a plus.
• Experience collaborating with the business to drive requirements/Agile story analysis.
• Experience with design and coding across one or more platforms and languages as appropriate
• Bonus skills:Machine learning/data miningObject-oriented design and codingAdobe Marketing Campaign products

• Develop and maintain large scale data processing pipeline using PySpark Data Proc, Big Query and SQL.
• Use Big Query and Data proc to migrate existing Hadoop/Spark/Hive workloads to Google Cloud.
• Proficient in Big Query to carry out batch and interactive data analysis.
• Function as member of an agile team by contributing to software builds through consistent development practices (tools, common components, and documentation)
• Develops and tests software, including ongoing refactoring of code, and drives continuous improvement in code structure and quality
• Enable the deployment, support, and monitoring of software across test, integration, and production environments