Get alerts for new jobs matching your selected skills, preferred locations, and experience range.
5 - 10 years
20 - 25 Lacs
Bengaluru
Work from Office
Job Description AWS Data engineer Hadoop Migration We are seeking an experienced AWS Principal Data Architect to lead the migration of Hadoop DWH workloads from on-premise to AWS EMR. As an AWS Data Architect, you will be a recognized expert in cloud data engineering, developing solutions designed for effective data processing and warehousing requirements of large enterprises. You will be responsible for designing, implementing, and optimizing the data architecture in AWS, ensuring highly scalable, flexible, secured and resilient cloud architectures solving business problems and helps accelerate the adoption of our clients data initiatives on the cloud. Key Responsibilities: Lead the migration of Hadoop workloads from on-premise to AWS-EMR stack. Design and implement data architectures on AWS, including data pipelines, storage, and security. Collaborate with cross-functional teams to ensure seamless migration and integration. Optimize data architectures for scalability, performance, and cost-effectiveness. Develop and maintain technical documentation and standards. Provide technical leadership and mentorship to junior team members. Work closely with stakeholders to understand business requirements, and ensure data architectures meet business needs. Work alongside customers to build enterprise data platforms using AWS data services like Elastic Map Reduce (EMR), Redshift, Kinesis, Data Exchange, Data Sync, RDS , Data Store, Amazon MSK, DMS, Glue, Appflow, AWA Zero-ETL, Glue Data Catalog, Athena, Lake Formation, S3, RMS, Data Zone, Amazon MWAA, APIs Kong Deep understanding of Hadoop components, conceptual processes and system functioning and relative components in AWS EMR and other AWS services. Good experience on Spark-EMR Experience in Snowflake/Redshift Good idea of AWS system engineering aspects of setting up CI-CD pipelines on AWS using Cloudwatch, Cloudtrail, KMS, IAM IDC, Secret Manager, etc Extract best-practice knowledge, reference architectures, and patterns from these engagements for sharing with the worldwide AWS solution architect community Basic Qualifications: 10+ years of IT experience with 5+ years of experience in Data Engineering and 5+ years of hands-on experience in AWS Data/EMR Services (e.g. S3, Glue, Glue Catalog, Lake Formation) Strong understanding of Hadoop architecture, including HDFS, YARN, MapReduce, Hive, HBase. Experience with data migration tools like Glue, Data Sync. Excellent knowledge of data modeling, data warehousing, ETL processes, and other Data management systems. Strong understanding of security and compliance requirements in cloud. Experience in Agile development methodologies and version control systems. Excellent communication an leadership skills. Ability to work effectively across internal and external organizations and virtual teams. Deep experience on AWS native data services including Glue, Glue Catalog, EMR, Spark-EMR, Data Sync, RDS, Data Exchange, Lake Formation, Athena, AWS Certified Data Analytics – Specialty. AWS Certified Solutions Architect – Professional. Experience on Containerization and serverless computing. Familiarity with DevOps practices and automation tools. Experience in Snowflake/Redshift implementation is additionally preferred. Preferred Qualifications: Technical degrees in computer science, software engineering, or mathematics Cloud and Data Engineering background with Migration experience. Other Skills: A critical thinker with strong research, analytics and problem-solving skills Self-motivated with a positive attitude and an ability to work independently and or in a team Able to work under tight timeline and deliver on complex problems. Must be able to work flexible hours (including weekends and nights) as needed. A strong team player
Posted 3 months ago
10 - 15 years
25 - 30 Lacs
Chennai, Hyderabad, Noida
Hybrid
Job title: AWS solution delivery expert Job Summary We are seeking a highly skilled AWS solution delivery expert to join our team, The ideal candidature should have extensive experience in designing, implementing, and managing AWS solutions for business teams across various regions. This role requires a deep understanding of AWS services, good problem-solving skills, and the ability to communicate technical concepts effectively to the required stakeholders. Job description to support AWS environment. Understand the business requirements from external collaborators to create end-to-end infrastructure design and deliver solutions on AWS cloud platform. Assist scientists and external collaborators throughout the entire infrastructure delivery process, guiding them in provisioning necessary AWS services and utilizing the NVS infrastructure efficiently. Proficiency in AWS services like EC2, VPC, S3, RDS, Lambda, CloudFront, EBS, EFS, ASG, IAM, ELB, Data sync, Route53,EKS, ECS etc. Experience on Linux/Windows OS and CICD implementation using Jenkins, Ansible, AWS Cloud formation,Terraform, containerization technologies such as docker, K8S and HPC. Proficiency with monitoring, logging, and troubleshooting tools for AWSsuch as CloudWatch, CloudTrail, Splunk, etc. Familiarity of data analysis toolsand programming/scripting languages such as SQL, Python, bash Technical expertise on Virtualization, On-premises Storage, Network Connectivity, Data Protection (Backup and recovery), DR & HA Expertise in designing skills using Draw.io for AWS infrastructure architecture. Hands on experience in implementing data transfer solutions from external vendor accounts to internal accounts and vice versa. Collaborate with cross-functional teams, including developers, architects, and project managers, to ensure successful solution delivery. Qualifications Candidate with bachelors degree and minimum of 5+ yrs. experience with strong technical background Proven experience as an AWS Solution Architect and DevOps, preferably within the life sciences industry Candidature with excellent communication and presentation skills to effectively collaborate with business and internal teams. Familiarity with regulatory frameworks and standards applicable to the life sciences industry, such as GxP, HIPAA and FDA regulations. Stay up to date with the latest AWS services, features, and best practices. AWS Certified Solutions Architect certification is an added advantage. Ability to work independently and collaboratively in a team environment. Candidature should be flexible to work during US time zone.
Posted 3 months ago
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
Accenture
36723 Jobs | Dublin
Wipro
11788 Jobs | Bengaluru
EY
8277 Jobs | London
IBM
6362 Jobs | Armonk
Amazon
6322 Jobs | Seattle,WA
Oracle
5543 Jobs | Redwood City
Capgemini
5131 Jobs | Paris,France
Uplers
4724 Jobs | Ahmedabad
Infosys
4329 Jobs | Bangalore,Karnataka
Accenture in India
4290 Jobs | Dublin 2