Sr Data Engineer

As a Senior Data Engineer, you will be responsible for leading the design, development, and optimization of scalable data pipelines and infrastructure. Your role will involve collaborating with cross-functional teams to create data solutions that support business intelligence, analytics, and machine learning initiatives. This hands-on position requires a combination of deep technical expertise, strategic thinking, and mentorship capabilities. Your key responsibilities will include designing, building, and maintaining scalable and reliable data pipelines for both batch and streaming data. You will also be involved in developing and optimizing ETL/ELT processes to facilitate data integration from various sources. Additionally, you will play a crucial role in architecting and managing modern data platforms such as cloud-based data lakes/warehouses, implementing data governance, security, and compliance protocols. Collaboration with data scientists, analysts, and product teams is essential for delivering high-quality data solutions. You will also be expected to monitor data quality, implement tools for detecting and resolving data issues, and drive best practices in data engineering, including code reviews, testing, and CI/CD processes. Furthermore, mentoring junior data engineers and contributing to the scaling of engineering processes and standards will be part of your responsibilities. To enhance data pipeline efficiency, anomaly detection, and predictive analytics, you will leverage AI tools and methodologies. Utilizing Microsoft Fabric, specifically Notebooks, for designing and orchestrating data pipelines will also be a part of your role.,