Gcp Data Engineer

• 4-9 Years

  of hands-on experience in designing, testing, and implementing

  GCP supported architectures as a Data Engineer

  .
• Good hands-on experience in GCP services including

  Big Query

  ,

  Cloud Storage, Dataflow

  , Cloud Datapost, Cloud Composer/Airflow, and IAM.
• Must have proficient experience in GCP Databases: Bigtable, Spanner,

  Cloud SQL and Alloy DB

• Proficiency either in

  SQL, Python,

  Java, or Scala for data processing and scripting.
• Experience in development and test automation processes through the CI/CD pipeline (Git, Jenkins, SonarQube, Artifactory, Docker containers)
• Experience in orchestrating data processing tasks using tools like Cloud Composer or Apache Airflow.
• Strong understanding of data modeling, data warehousing and big data processing concepts.
• Solid understanding and experience of relational database concepts and technologies such as SQL, MySQL, PostgreSQL or Oracle. Design and implement data migration strategies for various database types (PostgreSQL, Oracle, Alloy DB etc.) Deep understanding of at least 1 Database type with ability to write complex SQLs.
• Experience with NoSQL databases such as MongoDB, Scylla, Cassandra, or DynamoDB is a plus.
• Optimize data pipelines for performance and cost-efficiency, adhering to GCP best practices.
• Implement data quality checks, data validation, and monitoring mechanisms to ensure data accuracy and integrity.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions.
• Ability to work independently and manage multiple priorities effectively.
• Preferably having expertise in end to end DW implementation.

Location and way of working:

• Base location: Bangalore, Mumbai, Delhi, Pune, Coimbatore, Chennai, Bhubaneswar Hyderabad
• This profile involves occasional travelling to client locations.
• Hybrid is our default way of working. Each domain has customized the hybrid approach to their unique needs.