Senior Consultant

Job Description

Job Title: Senior Consultant - Data Engineer Experience Level 9+ years of experience Key Responsibilities As a Senior Consultant - Data Engineer, you will: Data Engineering Fundamentals: Apply deep knowledge of Big Data Concepts to design, develop, and manage robust data solutions. Coding & Scripting: Write high-quality code in Core Python and develop effective Shell Scripts for automation and data processing. Data Storage & Management: Work extensively with SQL databases and manage data within AWS S3. Scalable Architecture (Good to Have): Design and implement event-driven architectures using AWS SQS, integrate with Microservices, and develop APIs. Real-time Data (Good to Have): Work with Kafka for real-time data streaming. Containerization & Orchestration (Good to Have): Utilize Kubernetes and Argo for container orchestration and workflow management. Cloud Data Warehousing (Good to Have): Work with Amazon Redshift and Amazon Aurora for data warehousing and relational database solutions. Mandatory Skills & Experience Technical Proficiency: Big Data Concepts: Strong knowledge of Big Data Concepts . Python: Proficient in Core Python (able to write code). SQL: Strong knowledge of SQL . Shell Scripting: Proficient in Shell Scripting . AWS Storage: Experience with AWS S3 . Experience & Qualifications: 9+ years of experience in data engineering. Essential Professional Skills Good to Have: Experience with Event-driven architecture / AWS SQS . Experience with Microservices . Experience with API Development . Experience with Kafka . Experience with Kubernetes . Experience with Argo . Experience with Amazon Redshift .