Data Engineer

Role:

Exp :

Location:

Immediate Joiner

Mandatory Skills:

Note: 5-7 years of exp having programming hands-on on Scala + Spark + CICD, cloud exposure as GCP exposure would be good to have but not mandatory.

• Must have good experience in below tech stack

• Hadoop
• Hive
• HDFS
• Apache
• Spark
• Scala
• GCP
• Jenkins
• Airflow
• SQL

• Hands on experience on Data migration and data processing on the Google Cloud stack, specifically:

• Big Query
• Cloud Dataflow
• Cloud DataProc
• Cloud Storage
• Cloud DataPrep
• Cloud PubSub
• Cloud Composer & Airflow

• Must have understanding Scala
• Experience designing and deploying large scale distributed data processing systems with few technologies such as PostgreSQL or equivalent databases, SQL, Hadoop, Spark, Tableau
• Proven ability to define and build architecturally sound solution designs.
• Demonstrated ability to rapidly build relationships with key stakeholders.
• Experience of automated unit testing, automated integration testing and a fully automated build and deployment process as part of DevOps tooling.
• Must have the ability to understand and develop the logical flow of applications on technical code level.
• Strong interpersonal skills and ability to work in a team and in global environments.
• Should be proactive, have learning attitude & adjust to work in dynamic work environments.
• Exposure in Enterprise Data Warehouse technologies
• Exposure in a customer facing role working with enterprise clients.
• Experience with industry standard version control tools (Git, GitHub), automated deployment tools (Ansible & Jenkins) and requirement management in JIRA.
• Exposure to DevOps & Agile Project methodology such as Scrum and Kanban.
• Understanding of big data modelling techniques using relational and non-relational techniques
• Experience on Debugging the Code issues and then publishing the highlighted differences to the development team/Architects.
• Understanding or experience of Cloud design patterns
• Good to have Google Cloud Certification.