Pune
INR 15.0 - 20.0 Lacs P.A.
Work from Office
Full Time
We are seeking a highly skilled and experienced Data Engineering Architect to join our growing team. As a Data Engineering Architect, you will play a critical role in designing, building, and scaling Googles massive data infrastructure and platforms. You will be a technical leader and mentor, driving innovation and ensuring the highest standards of data quality, reliability, and performance. Responsibilities: Design and Architecture: Design and implement scalable, reliable, and efficient data pipelines and architectures for various Google products and services. Develop and maintain data models, schemas, and ontologies to support diverse data sources and use cases. Evaluate and recommend new and emerging data technologies and tools to improve Googles data infrastructure. Collaborate with product managers, engineers, and researchers to define data requirements and translate them into technical solutions. Data Processing and Pipelines: Build and optimize batch and real-time data pipelines using Google Cloud Platform (GCP) services such as Dataflow, Dataproc, Pub/Sub, and Cloud Functions. Develop and implement data quality checks and validation processes to ensure data accuracy and consistency. Design and implement data governance policies and procedures to ensure data security and compliance. Data Storage and Management: Design and implement scalable data storage solutions using GCP services such as BigQuery, Cloud Storage, and Spanner. Optimize data storage and retrieval for performance and cost-effectiveness. Implement data lifecycle management policies and procedures. Team Leadership and Mentorship: Provide technical leadership and guidance to data engineers and other team members. Mentor and coach junior engineers to develop their skills and expertise. Foster a culture of innovation and collaboration within the team. Qualifications: Bachelors or Masters degree in Computer Science, Engineering, or a related field. 8+ years of experience in data engineering or a related field. Strong understanding of data warehousing, data modeling, and ETL processes. Expertise in designing and implementing large-scale data pipelines and architectures. Proficiency in SQL and at least one programming language such as Python or Java. Experience with Google Cloud Platform (GCP) services such as BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Storage. Experience with open-source data processing frameworks such as Hadoop, Spark, and Kafka. Excellent communication, interpersonal, and collaboration skills. Preferred Qualifications: Experience with data governance and data quality management. Experience with machine learning and data science. Experience with containerization and orchestration technologies such as Docker and Kubernetes.
Pune
INR 7.0 - 12.0 Lacs P.A.
Work from Office
Full Time
Lead end-to-end cloud migration projects, including assessments, planning, resource migration, execution, and post-migration support. Leverage in-depth knowledge of cloud services and tools, particularly GCP, including services like Compute Engine, Cloud SQL, Cloud Run Services/Job/Functions, GKE (Kubernetes), BigQuery, Cloud Storage, VPCs, IAM, and others. Define project scope, deliverables, timeline, and resources in collaboration with stakeholders. Manage project risks, issues, and changes, ensuring adherence to timelines and budgets. Ensure effective communication across all levels of the organization, from executive stakeholders to technical teams. Oversee the migration of workloads, applications, and databases from on-prem or other cloud providers to Google cloud platform. Coordinate the migration of server-based and serverless applications, including Docker-based containers, virtual machines, and microservices. Manage the replication, synchronization, and migration of databases (e.g., RDS, SQL, NoSQL, and cloud-native database services). Ensure the application of cloud best practices for scalability, high availability, and disaster recovery. Manage and lead a cross-functional technical team, including DevOps engineers, infrastructure specialists, and data engineers. Provide guidance and support to technical teams during cloud migration tasks, offering solutions to challenges and ensuring alignment with project goals. Conduct regular project meetings to monitor progress, manage workloads, and resolve roadblocks. Monitor and optimize the cloud infrastructure to ensure cost-efficiency and performance. Regularly update stakeholders on project status, milestones, risks, and resource allocation. Create detailed project documentation, including timelines, roadmaps, and migration strategies. Work closely with business and technical stakeholders to understand project goals and ensure alignment with broader organizational objectives. Required Qualifications: Ability to work independently and collaboratively in a fast-paced, dynamic environment. Proven experience in managing large-scale cloud migration initiatives, particularly involving both server and serverless architectures. Experience with Docker, containerization, and microservices architecture. Brief Hands-on and overall usage level knowledge of cloud platforms (AWS, GCP) services and products, including compute, storage, networking, databases, and serverless technologies. Hands-on experience on Emails, Calendar, Meeting Invites, Chat Space, Share Drive management , preferably Google Workspace ecosystem. Familiarity with at least 20-30 widely used AWS and GCP services, such as: GCP: Compute Engine, Cloud Functions, BigQuery, Cloud Storage, Cloud SQL, Pub/Sub, Cloud Run, etc. AWS: EC2, S3, RDS, Lambda, VPC, CloudFormation, ECS, EKS, IAM, CloudWatch, CloudTrail, etc. Experience with database replication, data migration, and backup strategies in the cloud. Basic understanding of DevOps tools and practices (CI/CD, Jenkins, Terraform, Kubernetes, etc.). Strong proficiency in project management methodologies (Agile, Waterfall, or Hybrid). Strong experience in managing and maintaining Project Charter, Project Plans, Status reports Proficient in creating and managing Milestones, Epics, Stories, Tasks in JIRA or ClickUp like project management tools. Experience in writing user stories, acceptance criteria, Start/End date, Estimation and Actual time spent using ClickUp/JIRA like project management tool. Experience in time estimation, sprint planning and milestone tracking. Experience with project management tools (e.g., JIRA, ClickUp, Zoho). Excellent organizational and multitasking abilities, with the capacity to manage competing priorities. Excellent communication skills, both written and verbal. Strong interpersonal and leadership abilities to manage a diverse technical team and engage with stakeholders. Problem-solving mindset and ability to make data-driven decisions.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.