Data Engineer

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career.

Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express.

Data Management team within Global Servicing MIS

.Key responsibilities

• :Understanding business use cases and be able to convert to technical desig
• nPart of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners
• .You will be designing scalable, testable and maintainable data pipeline
• sDeveloping metrics to measure effectiveness and drive adoption of Data Governance policies and standards that will be applied to mitigate identified risks across the data lifecycle (e.g., capture / production, aggregation / processing, reporting / consumption)
• .You will continuously monitor, troubleshoot, and improve data pipelines and workflows to ensure optimal performance and cost-effectiveness

.Key Skills require

• d:2-4 years of experience in data engineering role
• s.Advanced SQL skills, Python with a focus on optimization techniques, have experience on Data Pipeline
• s.Big data and Hadoop experience, with a focus on Spark, Hive (or other query engines), big data storage formats (such as Parquet, ORC, Avro), performance tuning and debugging ETL jo
• bsCloud experience (GCP preferred) with solutions designed and implemented at production sca
• leStrong understanding of key GCP services, especially those related to data processing [Batch/Real Time] Big Query, Cloud Scheduler, Airflow, Cloud Logging and Monitori
• ngHands-on experience with Git, advanced automation capabilities & shell scriptin