Job
Description
As a Senior Data Engineer at MLAI Digital Ltd, your role will involve designing, developing, and maintaining scalable and secure data pipelines and architectures. You will be responsible for optimizing ETL workflows to ensure high performance and reliability. Additionally, you will implement and monitor data governance frameworks to maintain data quality and integrity. Collaboration with data scientists, software engineers, and product teams will be key to delivering end-to-end data solutions. Your analytical skills will be utilized to analyze large and complex datasets to identify actionable trends, patterns, and insights. Developing robust data models that support business intelligence and reporting needs will also be part of your responsibilities. Ensuring data security, compliance, and privacy in accordance with company policies is essential. Integration of structured and unstructured data from various internal and third-party sources will be required, along with troubleshooting and resolving data-related issues with minimal supervision. You will be expected to drive innovation by recommending and implementing improvements in data engineering practices and work closely with stakeholders in BFSI to understand requirements and translate them into technical solutions. Key Responsibilities: - Design, develop, and maintain scalable and secure data pipelines and architectures - Optimize ETL workflows to ensure high performance and reliability - Implement and monitor data governance frameworks, ensuring data quality and integrity - Collaborate with data scientists, software engineers, and product teams to deliver end-to-end data solutions - Analyze large and complex datasets to identify actionable trends, patterns, and insights - Develop robust data models that support business intelligence and reporting needs - Ensure data security, compliance, and privacy in accordance with company policies - Integrate structured and unstructured data from various internal and third-party sources - Troubleshoot and resolve data-related issues with minimal supervision - Drive innovation by recommending and implementing improvements in data engineering practices - Work closely with stakeholders in BFSI to understand requirements and translate them into technical solutions Required Skillsets: - Expertise in SQL and Python for data processing and automation - Hands-on experience with ETL tools and data pipeline orchestration (e.g., Apache Airflow, Luigi) - Strong knowledge of data warehousing concepts and solutions (e.g., Snowflake, Redshift, BigQuery) - Proficient in working with relational and NoSQL databases (e.g., PostgreSQL, MongoDB, Cassandra) - Solid understanding of data architecture, data governance, and data lifecycle management - Experience in cloud platforms such as AWS, GCP, or Azure - Familiarity with containerization (Docker, Kubernetes) and CI/CD processes for data deployment - Exposure to machine learning pipelines and AI-driven applications is a plus - Experience in BFSI or fintech environments is highly desirable MLAI Digital Ltd is a leading Artificial Intelligence fintech company specializing in delivering cognitive solutions for major BFSI institutions in India. Their platform automates repetitive tasks using cutting-edge ML and DL algorithms, enhancing operational efficiency. The company's flagship product, Automatic Speech Recognition, provides intelligent voice bots and advanced call center analytics engines to empower financial institutions. As a Senior Data Engineer at MLAI Digital Ltd, your role will involve designing, developing, and maintaining scalable and secure data pipelines and architectures. You will be responsible for optimizing ETL workflows to ensure high performance and reliability. Additionally, you will implement and monitor data governance frameworks to maintain data quality and integrity. Collaboration with data scientists, software engineers, and product teams will be key to delivering end-to-end data solutions. Your analytical skills will be utilized to analyze large and complex datasets to identify actionable trends, patterns, and insights. Developing robust data models that support business intelligence and reporting needs will also be part of your responsibilities. Ensuring data security, compliance, and privacy in accordance with company policies is essential. Integration of structured and unstructured data from various internal and third-party sources will be required, along with troubleshooting and resolving data-related issues with minimal supervision. You will be expected to drive innovation by recommending and implementing improvements in data engineering practices and work closely with stakeholders in BFSI to understand requirements and translate them into technical solutions. Key Responsibilities: - Design, develop, and maintain scalable and secure data pipelines and architectures - Optimize ETL workflows to ensure high performance and reliability - Implement and monit
