Job
Description
you're a talented, creative, and motivated engineer who loves developing powerful, stable, and intuitive apps and you're excited to work with a team of individuals with that same passion. you've accumulated years of experience, and you're excited about taking your mastery of Cloud, Big Data and Java to a new level. You enjoy challenging projects involving big data sets and are cool under pressure. you're no stranger to fast-paced environments and agile development methodologies in fact, you embrace them. With your strong analytical skills, your unwavering commitment to quality, your excellent technical skills, and your collaborative work ethic, you'll do great things here at American Express. Purpose of the Role: American Express is on a path to migrate big data workloads from on-prem to a cloud hosted solution. There are hundreds of usecases who would be adopting to this change and plan to move their usecases from On-prem Big data cluster to GCP native warehouse. As an Engineer you will deliver technical solutions using cutting edge technologies and industry best practices to implement cloud native tools and help usecases in this large scale migration. You should have experience in architecting, deploying, automating cloud-based data platforms. You should be we'll versed in technologies such as GCP, Big data, Java, Scala, Spark, Kafka, APIs, Python, RDBMS, NoSQL etc You should have experienced in building and using low code/no code data transformation tools for setting up complex rules. Responsibilities: * As a Big Data Engineer, you'll be responsible for designing and building high performance, and scalable data platforms * You should be a quick learner to understand user needs and guide them towards most suitable path * You will be required to effectively collaborate with product teams from business group and understand the user needs, requirements, roadmap and vision of different tooling * You will ride high on creating automated tools that will cater to multiple usecases and speed up the enablement process * You will work with a variety of teams and individuals, including platform engineers, usecase owners, analytical users to understand their needs and come up with innovative solutions * You will follow the Amex-way of building engineering products that leads to engineering excellence by adopting DevOps principals Qualifications: * Bachelors degree in Computer Science, Engineering, or a related field. Masters degree would be a plus * Great to have :- GCP professional certification - Data Engineer/Cloud Architect will be preferable * 3+ years of software development experience with hands-on expertise in coding in Java/Python/Scala etc * 2+ years of experience in setting up ETL jobs on low-code UI * 2+ years of experience in using GCP cloud tools such as BigQuery, Data Proc, Data Flow, Cloud SQL, Pub Sub etc * Strong SQL, RDBMS skills. Expert in writing complex SQLs for different databases such as Hive , MySQL , Postgres etc Proficiency in working with NoSQL databases as we'll * Experience working with Spark , Big Data and Hive * Experience in Git Management including PR reviews, maintaining code hygiene * In-depth understanding of data warehousing concepts, dimensional modelling, and data integration techniques * Experience in optimising high volume data processing jobs. * Hands-on experience on CICD pipelines, Automated test frameworks, DevOps and source code management will be a big plus (XLR, Jenkins, Git, Stash, Jira, Confluence, Splunk etc) * Experience working in Agile/SAFe framework for development * Excellent communication and analytical skills * Excellent team-player with ability to work with global team We back you with benefits that support your holistic we'll-being so you can be and deliver your best. This means caring for you and your loved ones physical, financial, and mental health, as we'll as providing the flexibility you need to thrive personally and professionally: Competitive base salaries Bonus incentives Support for financial-we'll-being and retirement Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location) Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need Generous paid parental leave policies (depending on your location) Free access to global on-site we'llness centers staffed with nurses and doctors (depending on location) Free and confidential counseling support through our Healthy Minds program Career development and training opportunities
