Job
Description
Role Senior Cloud Data Engineer Visit our website bmwtechworks.in to know more. Follow us on LinkedIn I Instagram I Facebook I X for the exciting updates. Location Pune/Chennai Experience: 6 to 8 Years What awaits you/ Job Profile You will design, develop, and optimize large-scale data pipelines. You will take ownership of critical components of the data architecture, ensuring performance, security, and compliance. Design and implement scalable data pipelines for batch and real-time processing. Optimize data storage and computing resources to improve cost and performance. Ensure data security and compliance with industry regulations. Collaborate with data scientists, analysts, and application teams to align data storage strategies. Lead technical discussions with stakeholders to deliver the best possible solutions. Automate data workflows and develop reusable frameworks. Monitor and troubleshoot ETL pipelines, jobs, and cloud services. What should you bring along 6+ years of experience in AWS cloud services and data engineering. Strong expertise in data modeling, ETL pipeline design, and SQL query optimization. Prior experience working with streaming solutions like Kafka. Excellent knowledge of Terraform and GitHub Actions. Experienced in being in the lead of a feature team. Must have technical skill Python, PySpark, Hive, Unix AWS (S3, Lambda, Glue, Athena, RDS, Step Functions, SNS, SQS, API Gateway) MySQL, Oracle, NoSQL and experience in writing complex queries Good to have technical skills Cloud Architect Certification. Terraform Git, GitHub Actions, Jenkins Delta Lake, Iceberg Experience in AI-powered data solutions
