Job
Description
Job Summary We are seeking a highly motivated and experienced Data Engineer to design, build, and maintain robust data pipelines. The ideal candidate will have deep expertise in cloud-based data processing technologies using GCP, AWS, or Azure. You will play a critical role in ensuring data reliability, quality, and availability to support our business needs. You will get to work on cutting-edge data infrastructure with a real-world impact. Responsibilities Design, develop, and maintain scalable data pipelines using cloud services (GCP, AWS, or Azure). Implement data ingestion, transformation, and storage solutions. Ensure data quality, integrity, and security across all data systems. Monitor and troubleshoot data pipelines to identify and resolve issues. Has to ensure a 99.999% uptime & performance SLAs of the production environment. Collaborate with data scientists and other stakeholders to understand data requirements. Optimize data pipelines for performance, reliability, and cost-effectiveness. Create and maintain clear documentation of data flows, system architecture, and operational procedures. Qualifications B.Tech. / M. Tech. degree or higher educational qualification. 3+ years of experience in Data Engineering or related roles. Must have worked in production deployments, including managing scalable data pipelines that process high-volume, real-time data. Proficiency with cloud services such as GCP, AWS, or Azure is required. Hands-on experience with Distributed Stream Processing Technology ecosystem, including Apache Kafka, Flink or Beam etc. Strong Programming skills in languages such as Python, Scala, or NodeJS. Experience with SQL, NoSQL & especially Timeseries databases. Experience with parallel programming & distributed data processing. Solid understanding of data warehousing concepts and technologies. Ability to design and implement data architectures. Excellent problem-solving and analytical skills. Strong communication and collaboration abilities. Preferred Qualifications Experience developing data pipelines & processing services, with a deeper understanding of the Quality Controls. Knowledge of IoT data and related technologies. A Google Cloud Certified Professional Data Engineer will be given preference. Skills: gcp,dataengineering,aws,azure,kafka,flink,python,datapipelines,troubleshooting,iot,dataingestion,realtime,nosql,nodejs,sql,scala,optimization,analytic problem solving,iot architecture Show more Show less
