Senior Data Engineer - SQL/Python

As a Senior Data Engineer at MLAI Digital Ltd, you will be responsible for designing, developing, and maintaining scalable and secure data pipelines and architectures. Your role involves optimizing ETL workflows to ensure high performance and reliability while implementing and monitoring data governance frameworks to maintain data quality and integrity. Collaboration with data scientists, software engineers, and product teams is crucial to delivering end-to-end data solutions. You will analyze large and complex datasets to identify actionable trends, patterns, and insights, as well as develop robust data models that support business intelligence and reporting needs. Maintaining data security, compliance, and privacy in alignment with company policies is a key aspect of your responsibilities. Integration of structured and unstructured data from various internal and third-party sources is essential, along with troubleshooting and resolving data-related issues with minimal supervision. Driving innovation by recommending and implementing improvements in data engineering practices is encouraged, and you will work closely with stakeholders in BFSI to understand requirements and translate them into technical solutions. The ideal candidate must have expertise in SQL and Python for data processing and automation, hands-on experience with ETL tools and data pipeline orchestration (e.g., Apache Airflow, Luigi), and strong knowledge of data warehousing concepts and solutions (e.g., Snowflake, Redshift, BigQuery). Proficiency in working with relational and NoSQL databases (e.g., PostgreSQL, MongoDB, Cassandra), along with a solid understanding of data architecture, data governance, and data lifecycle management is required. Experience in cloud platforms such as AWS, GCP, or Azure, familiarity with containerization (Docker, Kubernetes), and CI/CD processes for data deployment are also essential. Exposure to machine learning pipelines and AI-driven applications is a plus, and experience in BFSI or fintech environments is highly desirable.,