Petonic Infotech - Senior Data Engineer - MySQL/Python

We're seeking a highly motivated Senior Data Engineer with 7-8+ years of experience to design, deploy, and maintain robust data pipelines and cloud-native data solutions. In this critical role, you'll support cutting-edge AI/ML initiatives, optimize complex data systems, and ensure seamless data flow for advanced analytics.If you're a hands-on engineer with a passion for building scalable data infrastructure in the cloud and optimizing database performance, we encourage you to apply!

Key Responsibilities

• Data Pipeline Development : Design, develop, and maintain highly scalable and reliable data pipelines for both batch and real-time processing, ensuring data quality and integrity.
• Cloud Data Solution Deployment : Lead the deployment and management of cloud-based data solutions and services on major cloud platforms such as AWS, Azure, or Google Cloud Platform.
• CI/CD & Automation : Implement and optimize CI/CD pipelines for automated deployment of data infrastructure, applications, and configurations using infrastructure-as-code principles.
• Database Management : Administer, manage, and optimize performance for both relational databases (PostgreSQL, MySQL) and NoSQL databases (MongoDB), ensuring robust backup, recovery, and replication strategies.
• Infrastructure Oversight : Oversee server provisioning, deployment, configuration, and monitoring of the entire data infrastructure in cloud and hybrid environments.
• AI/ML Collaboration : Collaborate closely with AI/ML teams to streamline data workflows, optimize data ingestion for model training, and ensure efficient data delivery for model inference.
• Security & Compliance : Implement and maintain robust security measures, ensure data integrity, and adhere to compliance standards across all data systems and pipelines.
• Performance Monitoring & Troubleshooting : Proactively monitor system performance, identify bottlenecks, and troubleshoot complex data infrastructure and database-related issues to ensure high availability and reliability.
  

Ideal Candidate Profile

• Experience : 7-8+ years of progressive experience in data engineering and infrastructure deployment roles.
• Database Expertise : Strong expertise in database management and optimization for PostgreSQL, MySQL, and MongoDB. This includes performance tuning, indexing, backup/restore, and high availability configurations.
• Cloud Platforms : Hands-on experience with at least two major cloud platforms (AWS, Google Cloud Platform, or Azure) and proficiency in deploying and managing data services within these environments.
• Infrastructure as Code : Proven experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation, Azure Resource Manager).
• CI/CD Proficiency : Proficiency with CI/CD tools and practices using platforms like Jenkins, GitLab CI/CD, or GitHub Actions.
• Scripting Skills : Strong scripting skills in Python for automation, data processing, and infrastructure management.
• Server/Database Administration : Solid understanding of server and database administration principles in cloud and hybrid environments.
• AI/ML & MLOps : Familiarity with AI/ML data workflows, feature engineering, and MLOps concepts is a significant plus.
• Soft Skills : Excellent communication, collaboration, and problem-solving skills, with the ability to work effectively in cross-functional teams.
  

(ref:hirist.tech)