DevOps/ Ops Data Engineer

Job Description

DevOps Engineer Lets be unstoppable together! At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to diversity, equity, and inclusion as we believe in the undeniable strength that diversity brings to our business, employees, clients, and communities. With us, you can always bring your full self to work. Join our inclusive, committed team to be a challenger, own outcomes, and stay curious together. Circana is proud to be Certified by Great Place To Work. This prestigious award is based entirely on what current employees say about their experience working at Circana. Learn more at www.circana.com. What will you be doing? At Circana, customer experience is at the forefront of everything we do. To help us build functional systems that improve the customer experience, were looking for a DevOps engineer who can be responsible for deploying product updates, identifying production issues, and implementing integrations that meet our customers needs. The ideal candidate will have a solid background in software engineering and be familiar with Python and will work with developers and engineers to ensure that software development follows established processes and works as intended. Job Responsibilities Monitoring Data Loads: Continuously monitor data loading processes in production, identifying potential bottlenecks, errors, or anomalies in real-time using monitoring tools. Troubleshooting Data Issues: Diagnose and resolve data loading errors, including data format issues, connectivity problems, mapping errors, and data integrity concerns. Root Cause Analysis: Investigate the root cause of recurring data loading problems, and implement preventive measures to mitigate future issues. Data Validation: Perform quality checks on loaded data to ensure accuracy and consistency with expected data patterns. Data Integration Support: Develop scripts to automate visualization Incident Management: Respond to data loading incidents promptly, escalating critical issues to relevant stakeholders as needed. Documentation and Knowledge Sharing: Maintain clear documentation of data loading procedures, troubleshooting guides, and best practices to support team knowledge transfer. Required skills and qualifications 2 6 years work experience in large data integration and Data warehousing environment Experience as a DevOps engineer or in a similar software engineering role Proficiency with Git and GitHub workflows Good knowledge of Python, Unix, SQL, Shell Scripting Exposure to using automated scripts for data extraction, loading and validations Exposure to handling data from various sources (Flat files, Excel, Access, Oracle/Hadoop, Azure, GCP, AWS etc.) Working knowledge of databases and SQL Job scheduling thru Control-M, Airflow Problem-solving attitude Collaborative team spirit Preferred skills and qualifications Bachelor of science degree (or equivalent) in computer science, engineering, or relevant field Experience with CI/CD and containerized environments/deployments. Kubernetes and Ansible/Terraform preferred Experience in building or maintaining ETL processes Ready to work in 24x7 environment Circana Behaviors As well as the technical skills, experience and attributes that are required for the role, our shared behaviors sit at the core of our organization. Therefore, we always look for people who can continuously champion these behaviors throughout the business within their day-to-day role: Stay Curious: Being hungry to learn and grow, always asking the big questions. Seek Clarity: Embracing complexity to create clarity and inspire action. Own the Outcome: Being accountable for decisions and taking ownership of our choices. Center on the Client: Relentlessly adding value for our customers. Be a Challenger: Never complacent, always striving for continuous improvement. Champion Inclusivity: Fostering trust in relationships engaging with empathy, respect, and integrity. Commit to each other: Contributing to making Circana a great place to work for everyone. Location This position can be located in the following area(s): Circana India Office, Bangalore Location