Senior Consultant

Job Title: Senior Consultant - Data Engineer

Experience Level

9+ years of experience

Key Responsibilities

As a Senior Consultant - Data Engineer, you will:

• Data Engineering Fundamentals:

  Apply deep knowledge of Big Data Concepts to design, develop, and manage robust data solutions.

• Coding & Scripting:

  Write high-quality code in Core Python and develop effective Shell Scripts for automation and data processing.

• Data Storage & Management:

  Work extensively with SQL databases and manage data within AWS S3.

• Scalable Architecture (Good to Have):

  Design and implement event-driven architectures using AWS SQS, integrate with Microservices, and develop APIs.

• Real-time Data (Good to Have):

  Work with Kafka for real-time data streaming.

• Containerization & Orchestration (Good to Have):

  Utilize Kubernetes and Argo for container orchestration and workflow management.

• Cloud Data Warehousing (Good to Have):

  Work with Amazon Redshift and Amazon Aurora for data warehousing and relational database solutions.

Mandatory Skills & Experience

Technical Proficiency:

• Big Data Concepts:

  Strong knowledge of

  Big Data Concepts

  .

• Python:

  Proficient in

  Core Python

  (able to write code).

• SQL:

  Strong knowledge of

  SQL

  .

• Shell Scripting:

  Proficient in

  Shell Scripting

  .

• AWS Storage:

  Experience with

  AWS S3

  .

Experience & Qualifications:

• 9+ years of experience

  in data engineering.

Essential Professional Skills

Good to Have:

• Experience with

  Event-driven architecture / AWS SQS

  .
• Experience with

  Microservices

  .
• Experience with

  API Development

  .
• Experience with

  Kafka

  .
• Experience with

  Kubernetes

  .
• Experience with

  Argo

  .
• Experience with

  Amazon Redshift

  .
• Experience with

  Amazon Aurora

  .