Sr. Data Engineer

• Design, develop, and maintain scalable, reliable, and high-performance data pipelines using Azure Data Services
• Build and optimise ETL/ELT pipelines using Azure Databricks (PySpark)
• Ingest, transform, and process structured and unstructured data from multiple data sources
• Implement data models to support analytics, reporting, and machine learning use cases
• Ensure data quality, data validation, and governance standards are met
• Optimise performance and cost for large-scale data processing workloads
• Integrate data pipelines with downstream systems such as Power BI, data science models, and enterprise applications
• Collaborate with cross-functional teams, including Data Science, Analytics, DevOps, and Product
• Implement CI/CD pipelines for data workloads and follow DevOps best practices
• Support production deployments and troubleshoot data pipeline issues

10+ Years Strong experience with Microsoft Azure, including:

• Azure Data Lake Storage (ADLS Gen2)
• Azure Data Factory (ADF)
• Azure Synapse Analytics

• Hands-on experience with Azure Databricks

• Strong proficiency in Python for data engineering
• Hands-on experience with PySpark / Spark SQL
• Experience working with notebooks, jobs, and workflows in Databricks

• Experience with relational databases (Azure SQL, SQL Server, PostgreSQL)
• Experience with NoSQL / big data stores (Delta Lake, Cosmos DB preferred)
• Strong SQL skills for data transformation and optimisation

• Strong understanding of data warehousing, lakehouse architecture, and distributed systems
• Experience implementing Delta Lake, partitioning, indexing, and performance tuning
• Knowledge of batch and near-real-time data processing

• Experience with CI/CD pipelines (Azure DevOps preferred)
• Familiarity with version control (Git)
• Exposure to infrastructure as code (ARM / Terraform good to have)
• Understanding of monitoring, logging, and alerting for data platforms

• Experience with streaming platforms (Kafka, Azure Event Hubs, or Spark Structured Streaming)
• Exposure to data governance, security, and compliance frameworks
• Experience supporting ML pipelines and feature engineering
• Power BI or other BI tool integration experience

• bachelors degree in computer science, Information Systems, Engineering, Computer Applications, or related field.

• In addition to competitive salaries and benefits packages, Nisum India offers its employees some unique and fun extras:
• Continuous Learning - Year-round training sessions are offered as part of skill enhancement certifications sponsored by the company on an as-needed basis. We support our team to excel in their field.
• Parental Medical Insurance - Nisum believes our team is the heart of our business, and we want to make sure to take care of the heart of theirs. We offer opt-in parental medical insurance in addition to our medical benefits.
• Activities -From the Nisum Premier Leagues cricket tournaments to hosting a Hack-a-thon, Nisum employees can participate in a variety of team-building activities, such as skits, dance performance in addition to festival celebrations.
• Free Meals - Free snacks and dinner are provided daily, in addition to subsidised lunch.