Manager Data Engineering DE - Big Data AWS

8.0 - 10.0 years

8 - 10 Lacs

Bengaluru / Bangalore, Karnataka, India

Posted:1 week ago| Platform: Foundit logo

Apply Now

Skills Required

CI/CD big data ingestion tools

Work Mode

On-site

Job Type

Full Time

Job Description

Your Impact: What You'll Achieve Provide technical leadership and hands-on implementation in the areas of data engineering, including data ingestion, data access, modeling, data processing, visualization, design, and implementation. Lead a team to deliver high-quality big data technologies-based solutions on AWS Cloud. Manage functional & non-functional scope and quality. Help establish standard data practices like governance and address other non-functional issues like data security, privacy, and quality. Manage and provide technical leadership to a data program implementation based on the requirements using agile technologies. Participate in workshops with clients and align client stakeholders to optimal solutions. Engage in Consulting, Soft Skills, Thought Leadership, and Mentorship . People management , contributing to hiring and capability building. Qualifications: Your Skills & Experience Overall IT Experience: 8+ years of IT experience. Data Technologies Experience: 3+ years in Data related technologies. AWS Cloud Data Experience: Expertise of 1+ years in data-related AWS Cloud services and delivered at least 1 project as an architect. Big Data Architecture: Mandatory to have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end Big Data solutions on AWS Cloud . Programming Languages: Expert in programming languages like Java/Scala and good to have Python. Distributed Data Processing: Expert in at least one distributed data processing framework : Spark (Core, Streaming, SQL), Storm, or Flink, etc. Hadoop Ecosystem & Ingestion Tools: Expert in the Hadoop ecosystem with AWS cloud distribution and worked at least on one or more big data ingestion tools (Sqoop, Flume, NiFi, etc.), distributed messaging and ingestion frameworks (Kafka, Pulsar, Pub/Sub, etc.). Good to know traditional tools like Informatica, Talend etc. NoSQL Solutions: Should have worked on any of NoSQL solutions like MongoDB, Cassandra, HBase etc., or Cloud-based NoSQL offerings like DynamoDB, Big Table etc. DevOps: Good exposure in development with CI/CD pipelines . Containerization: Knowledge of containerization, orchestration, and Kubernetes engine would be an added advantage. Set Yourself Apart With Certification on AWS cloud platform or big data technologies. Strong analytical and problem-solving skills. Excellent understanding of data technologies landscape / ecosystem.

Epsilon Data Management
Epsilon Data Management

Advertising Services

Irving Texas +

5001-10000 Employees

159 Jobs

    Key People

  • John Doe

    CEO
  • Jane Smith

    Chief Marketing Officer

RecommendedJobs for You