Intel DS Data Ingestion Consultant

Role Overview: You will be responsible for ETL design, development, and business system designs. Additionally, you will need to have a good understanding of AWS networking concepts, proficiency in IAM concepts, hands-on experience in various AWS services, and the ability to write clean, modular, testable, and maintainable code. Your role will also involve working with programming languages such as Python, Scala, or Java, willingness to learn Python/PySpark if not already experienced, understanding Spark architecture, execution plans, and performance tuning, strong SQL skills, experience with Redshift and/or Athena, writing and maintaining Terraform scripts, familiarity with Git, GitHub workflows, CI/CD tools like Jenkins, exposure to data lake architectures, and familiarity with monitoring and logging tools. Key Responsibilities: - Designing and developing ETL processes - Understanding and implementing AWS networking concepts such as VPC, subnets, routing, NAT gateways, security groups - Proficiency in IAM concepts including roles, policies, assume-role, and cross-account access - Hands-on experience in AWS services like S3, KMS, Lambda, Glue (or Spark), SQS, EventBridge - Writing clean, modular, testable, and maintainable code using functional or OOP principles - Working with programming languages like Python, Scala, or Java - Willingness to learn Python/PySpark - Understanding Spark architecture, execution plans, and performance tuning - Strong SQL skills and experience with Redshift and/or Athena - Writing and maintaining Terraform scripts - Familiarity with Git, GitHub workflows, and CI/CD tools like Jenkins - Exposure to data lake architectures and data governance practices - Familiarity with monitoring and logging tools (e.g., CloudWatch) Qualifications Required: - B.E or B TECH or MASTERS IN COMPUTER SCIENCE, ELECTRONICS, RELEVANT TECHNICAL CERTIFICATION - Minimum of 5 years of experience in ETL design, development, and business system designs Note: Cigres Technologies Private Limited is a technology consulting and services company that focuses on helping clients resolve significant digital problems and enabling radical digital transformation using various technologies on premise or in the cloud. Founded with the goal of leveraging cutting-edge technology, the company delivers innovative solutions to clients across different industries.,