Lead Data Ops

Role Overview: As the Lead Data Infrastructure Developer at CBG, your primary responsibility will be to oversee the development and management of a robust data infrastructure and pipelines within the network. This infrastructure plays a crucial role in delivering data as a product, ensuring that high-quality, accessible, and timely data is available for advanced analytics, reporting, and decision-making across all operational and business functions. Key Responsibilities: - Designing, implementing, and managing scalable data architecture for collecting, storing, and processing large volumes of data from various CBG plant systems such as SCADA, PLC, IoT devices, SAP, EMS, and LIMS. - Overseeing the cloud/on-prem data lake, data warehouse, and structured databases that support real-time and batch processing. - Developing and maintaining robust, automated data pipelines using modern ETL/ELT tools, and ensuring the reliability, efficiency, and monitoring of all data flows from source to destination systems. - Implementing processes to ensure data accuracy, consistency, completeness, and freshness, working closely with Data Governance and Compliance teams to define standards, validation rules, and audit trails. - Collaborating with data scientists, business analysts, application teams, and plant operations to understand and prioritize data requirements, enabling self-service data access through APIs, secure dashboards, and curated datasets. - Maintaining a data catalogue and lineage tracking system to improve data discoverability and reusability across the organization, providing documentation and training on data schema, usage, and access policies. - Ensuring data security and compliance by storing and accessing data securely, following best practices in encryption, role-based access, and regulatory compliance. Qualifications Required: - B.E. / B.Tech degree - Expertise in SQL, Python, DevOps, and distributed data technologies such as Spark and Kafka - Experience with cloud platforms like AWS, Azure, or GCP and associated data services - Strong understanding of CI/CD for data pipelines and MLOps integration - Familiarity with industrial data sources like OPC-UA, MQTT, and SCADA systems - Excellent leadership, documentation, and stakeholder communication skills (Note: No additional details of the company were provided in the job description.),