Job
Description
Youre a talented, creative, and motivated engineer who loves developing powerful, stable, and intuitive apps and youre excited to work with a team of individuals with that same passion. Youve accumulated years of experience, and youre excited about taking your mastery of Cloud, Big Data and Java to a new level. You enjoy challenging projects involving big data sets and are cool under pressure. Youre no stranger to fast-paced environments and agile development methodologies in fact, you embrace them. With your strong analytical skills, your unwavering commitment to quality, your excellent technical skills, and your collaborative work ethic, youll do great things here at American Express. Purpose of the Role: American Express is on a path to migrate big data workloads from on-prem to a cloud hosted solution. As an Engineer you will deliver technical solutions using cutting edge technologies and industry best practices to implement cloud native tools in large scale migration.Experience in architecting, deploying, automating cloud-based data platforms.Should possess skills in technologies such as GCP, Big data, Java, Scala, Spark, Kafka, APIs, Python, RDBMS, NoSQL etc. You should have experienced in building and using low code/no code data transformation tools for setting up complex rules. Responsibilities: * As a Big Data Engineer, youll be responsible for designing and building high performance, and scalable data platforms * You should be a quick learner to understand user needs and guide them towards most suitable path * You will be required to effectively collaborate with product teams from business group and understand the user needs, requirements, roadmap and vision of different tooling * You will ride high on creating automated tools that will cater to multiple usecases and speed up the enablement process * You will work with a variety of teams and individuals, including platform engineers, usecase owners, analytical users to understand their needs and come up with innovative solutions * You will follow the Amex-way of building engineering products that leads to engineering excellence by adopting DevOps principals Qualifications: * Bachelors degree in Computer Science, Engineering, or a related field. Masters degree would be a plus * Great to have :- GCP professional certification - Data Engineer/Cloud Architect will be preferable * 6+ years of software development experience with hands-on expertise in coding in Java/Python/Scala etc * 4+ years of experience in setting up ETL jobs on low-code UI * 2+ years of experience in using GCP cloud tools such as BigQuery, Data Proc, Data Flow, Cloud SQL, Pub Sub etc. * Strong SQL, RDBMS skills. Expert in writing complex SQLs for different databases such as Hive , MySQL , Postgres etc. Proficiency in working with NoSQL databases as well * Experience working with Spark , Big Data and Hive * Experience in Git Management including PR reviews, maintaining code hygiene * In-depth understanding of data warehousing concepts, dimensional modelling, and data integration techniques * Experience in optimizing high volume data processing jobs. * Hands-on experience on CICD pipelines, Automated test frameworks, DevOps and source code management will be a big plus (XLR, Jenkins, Git, Stash, Jira, Confluence, Splunk etc.) * Experience working in Agile/SAFe framework for development * Excellent communication and analytical skills * Excellent team-player with ability to work with global team Benefits include: Competitive base salaries Bonus incentives Support for financial-well-being and retirement Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location) Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need Generous paid parental leave policies (depending on your location) Free access to global on-site wellness centers staffed with nurses and doctors (depending on location) Free and confidential counseling support through our Healthy Minds program Career development and training opportunities
