Senior Data Engineer II

2 - 7 years

22 - 25 Lacs

Posted:2 weeks ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

You will be part of the Operations & QA Engineering team tasked with supporting and maintaining the Information Security (IS) Cyber Analytics data platform and ecosystem consisting of various applications, products and technologies enabling IS teams to better quantify, investigate, and understand risk trends within the American Express (AXP) environment. The data and services provided by the platform help improve visibility to risks and increase the IS teams ability to manage the complex and vast data required to support the management and mitigation of AXP security risk. How will you make an impact in this role Provide Level 2.5 administration for Cloudera Hadoop, Apache NiFi, Elastic index, Logstash, File Beats Kubernetes, and Linux servers Provide Level 2.5 administration for Min IO and AWS S3 storage Ability to build Kibana dashboards, develop observability solutions for full stack health monitoring Understand Redhat repo kickstart process and deploy machines to IT infrastructure and automate basic fulfills through custom scripts. Understand Kubernetes platform architecture Write/develop scripts and frameworks using one of the popular languages, like python, shell or Perl to automate regular operational work, to integrate with monitoring tools to monitor applications, systems, ingestions and adhoc requirements Work with Ansible and ansible playbooks to automate system management and application work Actively participate in troubleshooting and fine-tuning Apache NiFi, Clouder Hadoop parameters to ensure data ingestion needs are fulfilled Provide support for regular systems patching, change implementations, maintenance and enhancements to production and Development IT systems Proactively respond and work on problem alerts receiving through monitoring tools and other sources Be part of on-call rotation with other team players to monitor systems health and proactively engage SMEs to resolve issues on-time. Provide weekend support for production restorations Minimum Qualifications Bachelors or masters degree in computer science, computer engineering or related field or equivalent associate degree. Hands on experience with Hortonworks/Cloudera Hadoop administration and Redhat Linux system administration Hands on experience with Apache NiFi, Elasticsearch index, Rancher Kubernetes, Min IO, S3 storage administration Hands on experience with Kubernetes setup and Ansible automation Hands on knowledge to build Kibana dashboards, deploying observability solutions using Prometheus and Grafana Strong knowledge and experienced in writing snippets using one the known languages like Shell, Perl, Ruby or Python Familiarity with SQL Enthusiast to learn and upskill knowledge on open source and community technologies Familiarity with monitoring frameworks either open source or Enterprise tools like Icinga2 Experience in working with onshore/offshore model Preferred Qualifications Cloud Native Kubernetes Certification We back you with benefits that support your holistic we'll-being so you can be and deliver your best. This means caring for you and your loved ones physical, financial, and mental health, as we'll as providing the flexibility you need to thrive personally and professionally: Competitive base salaries Bonus incentives Support for financial-we'll-being and retirement Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location) Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need Generous paid parental leave policies (depending on your location) Free access to global on-site we'llness centers staffed with nurses and doctors (depending on location) Free and confidential counseling support through our Healthy Minds program Career development and training opportunities

Mock Interview

Practice Video Interview with JobPe AI

Start Career Development Interview Now

My Connections AMERICAN EXPRESS

Download Chrome Extension (See your connection in the AMERICAN EXPRESS )

chrome image
Download Now
AMERICAN EXPRESS
AMERICAN EXPRESS

Financial Services

New York NY

10001 Employees

433 Jobs

    Key People

  • Stephen Squeri

    Chairman and Chief Executive Officer
  • Jeffrey C. Campbell

    Chief Financial Officer

RecommendedJobs for You

Bengaluru, Karnataka, India

Kolkata, Mumbai, New Delhi, Hyderabad, Pune, Chennai, Bengaluru