Data Ops

Role Overview: As the Lead Data Infrastructure Engineer at CBG, your primary responsibility will be to develop and manage a robust data infrastructure and pipelines across the network. Your role is crucial in enabling the delivery of data as a product, ensuring high-quality, accessible, and timely data for advanced analytics, reporting, and decision-making across all operational and business functions. Key Responsibilities: - Design, implement, and manage scalable data architecture for collecting, storing, and processing large volumes of data from CBG plant systems. - Own the cloud/on-prem data lake, data warehouse, and structured databases supporting real-time and batch processing. - Develop and maintain robust, automated data pipelines using modern ETL/ELT tools to ensure reliability, efficiency, and monitoring of all data flows from source to destination systems. - Implement processes to ensure data accuracy, consistency, completeness, and freshness, collaborating with Data Governance and Compliance teams to define standards, validation rules, and audit trails. - Collaborate with data scientists, business analysts, application teams, and plant operations to understand and prioritize data requirements and enable self-service data access through APIs, secure dashboards, and curated datasets. - Maintain a data catalogue and lineage tracking system to improve data discoverability and reusability across the organization. - Provide documentation and training on data schema, usage, and access policies. Qualification Required: - B.E. / B.Tech degree with expertise in SQL, Python, DevOps, and distributed data technologies such as Spark and Kafka. - Experience with cloud platforms like AWS, Azure, or GCP, and associated data services. - Strong understanding of CI/CD for data pipelines and MLOps integration. - Familiarity with industrial data sources like OPC-UA, MQTT, and SCADA systems. - Excellent leadership, documentation, and stakeholder communication skills. (Note: Any additional details of the company were not included in the provided Job Description),