Data Engineer

**Urgent Hiring for the Role of Data Engineer**

Role: Data Engineer

Duration: 6 month Contract to Hire

Location: Chennai, Hyderabad, Pune, and Delhi

Required Qualifications

• 5-10 years of overall IT experience, including a minimum of 3 years in big data engineering on Microsoft Azure.
• Expert-level SQL skills with the ability to write, optimize, and troubleshoot complex queries in Azure SQL, Synapse, or similar cloud data platforms.
• Strong knowledge of Spark architecture and core APIs (RDD, DataFrame, Dataset).
• Deep hands-on experience with the Databricks ecosystem, including Notebooks, Workflows, Unity Catalog, SQL Warehouse, Serverless compute, and other recent Databricks features.
• Proven ability to design and build scalable, high-performance data pipelines and automated workflows in Azure Databricks using PySpark and Spark SQL.
• Experience creating, orchestrating, and managing complex, parameter-driven pipelines in Azure Data Factory.
• Familiarity with both batch and streaming data processing.
• Solid understanding of data modeling techniques (dimensional, 3NF) and data warehousing principles.
• Hands-on experience delivering at least one end-to-end Azure Data Lakehouse solution using the Medallion Architecture.
• Knowledge of common file formats such as Delta Lake, Avro, Parquet, JSON, and CSV.
• Advanced programming, debugging, and unit-testing skills in Python, PySpark, and SQL.
• Understanding of data security, governance, and lifecycle management practices across Azure environments.
• Experience with DevOps concepts including CI/CD, Git, and automated deployments.
• Strong collaboration skills with the ability to work closely with cross-functional stakeholders and take ownership of deliverables.

Preferred Qualifications

• Exposure to building LLM or Generative AIenabled applications.
• Knowledge of NoSQL databases.
• Experience supporting BI and Data Science teams with secure, well-governed data access.
• Microsoft Azure or Databricks certifications are a plus.

Note: Interested candidates can drop their resumes at aagnihotri@fcsltd.com