Senior/Lead Data Engineer

As a Lead Data Engineer at Srijan, a Material company, you will play a crucial role in designing and delivering scalable, high-performance data platforms for real-time and batch analytics. Your deep expertise in data engineering, data modeling, data warehousing, Snowflake, and Azure services will be essential in building and optimizing data pipelines end-to-end. Key Responsibilities: - Architect, design, and build scalable batch and real-time data pipelines using Azure Data Engineering services such as ADF, Synapse, Data Lake, Event Hub, and Functions, along with PySpark. - Apply orchestration and load optimization strategies to ensure reliable, high-throughput pipelines. - Implement both streaming (low-latency) and batch (high-volume) processing solutions. - Drive best practices in data modeling, data warehousing, and SQL development. - Design and optimize data ingestion pipelines into Snowflake from multiple sources, ensuring availability, scalability, and cost efficiency. - Implement ELT/ETL patterns, partitioning, clustering, and performance tuning for large datasets in Snowflake. - Develop and maintain data models and data warehouses leveraging Snowflake-specific features. - Design and implement event-driven architectures using Kafka (optional), ensuring high-throughput, low-latency stream processing and data reliability. - Partner with data scientists, ML engineers, and business stakeholders to deliver high-quality, trusted datasets. - Translate business requirements into scalable, reusable data engineering solutions. - Provide technical leadership, mentoring, and knowledge-sharing within the team. Qualifications Required: - 5+ years of Data Engineering experience in large-scale enterprise projects. - Strong expertise in Snowflake, including ELT/ETL pipelines, performance tuning, query optimization, and advanced features. - Hands-on experience with Azure Data Engineering stack, such as ADF, Event Hub, Synapse, Databricks, Data Lake, Functions, and scaling/load balancing strategies. - Proficiency in Python and PySpark for distributed, high-performance data processing. - Demonstrated success in delivering real-time and batch pipelines in cloud environments. Preferred Skills: - CI/CD, Docker, DevOps, and server management. - Monitoring experience with Azure Monitor and Log Analytics. - Knowledge of Kafka is preferred but optional. Join us at Srijan, where you will have the opportunity to work with cutting-edge technology, collaborate with a talented team, and contribute to transforming relationships between businesses and their customers.,