Sr. Data Engineer Big Data & AWS

As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data processing systems in cloud-based Big Data environments. Your passion for data architecture and experience in creating reliable pipelines using modern technologies will be crucial for this role. **Key Responsibilities:** - Understand business requirements and translate them into scalable and efficient data solutions. - Design, develop, and maintain robust data pipelines for batch and stream processing. - Build data lakes, warehouses, and data mesh solutions for enterprise-level consumption. - Transform complex data from various sources into actionable insights and production-ready data products. - Evaluate and implement best practices for data storage, movement, and transformation. - Collaborate with cross-functional teams including data scientists, analysts, and engineers. **Must-Have Skills:** - 6+ years of hands-on experience in Big Data environments. - Strong command over Apache Spark with Python for batch and stream processing. - Expertise in SQL and NoSQL databases. - Proven experience in building scalable, fault-tolerant, and production-grade data pipelines. - 3+ years of experience with AWS services such as S3, DMS, Redshift, Glue, Lambda, Kinesis, and MSK (or similar services from Azure/GCP). **Good to Have:** - Exposure to multiple industry domains. - Experience with CI/CD in data engineering workflows. - Understanding of data mesh architecture. **Soft Skills:** - Strong analytical and problem-solving abilities. - Excellent written and verbal communication skills. - Self-motivated, detail-oriented, and a strong team player. **Important Notes:** This is a full-time onsite position in Pune. Applications without relevant Big Data & AWS experience will not be considered. Candidates must be able to join within a reasonable notice period. Apply only if you meet all the above requirements. Shortlisted candidates will be contacted for further rounds. **Benefits:** - Cell phone reimbursement - Food provided - Health insurance - Internet reimbursement - Leave encashment - Life insurance - Paid sick time - Paid time off - Provident Fund **Schedule:** - Fixed shift, Monday to Friday, Morning shift **Additional Details:** - Joining bonus - Performance bonus - Quarterly bonus - Shift allowance - Yearly bonus **Application Question(s):** - Do you have a minimum of 6 years of professional experience in Data Engineering or related roles - Do you have hands-on experience with Apache Spark using Python (for batch and/or stream processing) - Do you have at least 3 years of hands-on experience working with AWS services like S3, Glue, Lambda, Redshift, or Kinesis - What is your current CTC (in LPA) - What is your current notice period **Work Location:** In person,