Senior Data Engineer

Job Title: Data Engineer
Location: Hyderabad, India
Experience: 4–8 Years

Job Summary:

We are looking for skilled Data Engineers with expertise in Python, PySpark, and Azure Data Platform to design, build, and optimize large-scale data processing systems. The ideal candidate should have hands-on experience in handling structured/unstructured data, implementing data pipelines, and working in cloud-based environments.

Key Responsibilities:

• Design, develop, and maintain data pipelines and ETL processes using Python and PySpark.
• Work with Azure Data Lake, Azure Data Factory, Synapse, and Databricks to build scalable solutions.
• Optimize data pipelines for performance, scalability, and cost-efficiency.
• Collaborate with business and analytics teams to understand data requirements.
• Ensure data quality, governance, and security standards are followed.
• Troubleshoot and resolve issues in production data workflows.
• Support CI/CD implementation and automation for data engineering projects.

Required Skills & Qualifications:

• 4–8 years of experience in Data Engineering.
• Strong programming skills in Python & PySpark.
• Hands-on experience with Azure Data Services (Data Lake, Data Factory, Databricks, Synapse).
• Solid understanding of SQL and database concepts.
• Experience in working with big data frameworks and large-scale distributed systems.
• Knowledge of ETL design patterns, data modeling, and data warehousing concepts.
• Familiarity with Agile methodology and DevOps practices (Git, CI/CD pipelines).

Nice to Have:

• Exposure to Delta Lake and Azure ML.
• Experience with streaming data (Kafka, Event Hub, Spark Streaming).
• Knowledge of performance tuning in PySpark and Azure.

Job Type: Full-time

Pay: ₹511,159.50 - ₹1,860,422.66 per year

Work Location: In person