Data Engineer II

Job Description

You will be part of the Operations QA Engineering team tasked with supporting and maintaining the Information Security (IS) Cyber Analytics data platform and ecosystem consisting of various applications, products and technologies enabling IS teams to better quantify, investigate, and understand risk trends within the American Express (AXP) environment. The data and services provided by the platform help improve visibility to risks and increase the IS teams ability to manage the complex and vast data required to support the management and mitigation of AXP security risks. How will you make an impact in this role Provide level 2 and level 1 problem identifications, diagnose and regular troubleshoots for Postgres, Starburst, Trino, SQL, Qlik sense and Kubernetes administration. Understand and ability to write Power shell or python code to remediate on going regular system maintenance. Write/develop scripts and frameworks using PowerShell or Python to automate regular operational work, to integrate with monitoring tools to monitor applications, systems and ad hoc requirements. Perform Starburst, Trino, SQL, Postgres, Qlik cluster deployments and upgrades. Use Ansible to develop maintenance scripts for Postgres deployments. Provide support and maintain availability of portal applications. Develop and implement observability solutions using Dynatrace, Prometheus and ELK Written skills to prepare Knowledge base articles for ongoing maintenance, and to prepare Root Cause Analysis in case of system failures. Proactively respond and work on problem alerts receiving through monitoring tools and other sources Be part of on-call rotation with other team players to monitor systems health and proactively engage SMEs to resolve issues on-time Minimum Qualifications bachelors or masters degree in computer science, computer engineering or related field or equivalent associate degree. Hands on experience in the area of SQL, Starburst, Trino, Solr, Postgres Database, Qlik sense BI product and Kubernetes administration that deals with information and technology risk data/metrics Write/develop scripts and frameworks using PowerShell or Python to automate regular operational work, to integrate with monitoring tools to monitor applications, systems and ad hoc requirements. Hands on experience to implement site reliability for security risk management portals that are built using technology stack Docker/Kubernetes containers, Apache Webserver, zookeeper, Linux VMs, load balancing technologies, queuing technologies, caching technologies. Hands on experience with observability tools like Dynatrace, log analytics tool ELK and Prometheus Strong verbal and written communication skills, experience of working onsite/offshore model. Hands on experience to identify and implement stored procedures fine tuning with respect to SQL and Postgres databases Knowledge of data warehouse technology Starburst Ability to work in a rapidly changing environment. Ability to multi-task and context-switch effectively between different activities and teams. Preferred Qualifications Cloud Native Kubernetes Certification We back you with benefits that support your holistic we'll-being so you can be and deliver your best. This means caring for you and your loved ones physical, financial, and mental health, as we'll as providing the flexibility you need to thrive personally and professionally: Competitive base salaries Bonus incentives Support for financial-we'll-being and retirement Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location) Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need Generous paid parental leave policies (depending on your location) Free access to global on-site we'llness centers staffed with nurses and doctors (depending on location) Free and confidential counseling support through our Healthy Minds program Career development and training opportunities