Senior Data Engineer/Analyst

As a Data Engineer / Analyst at this company in Hyderabad (Hybrid work model), your responsibilities will include: - Designing, developing, and maintaining data solutions on Azure Databricks using Python, SQL, and PySpark. - Working extensively with Delta Lake and relational databases to build scalable data pipelines. - Performing analysis, design, implementation, and automated testing of data solutions. - Enhancing the consistency check engine for sub-ledger data and other tenants. - Optimizing Spark performance for very large datasets (10s of billions of rows, 200+ columns). - Identifying, troubleshooting, and resolving data issues proactively. - Collaborating with cross-functional teams to ensure data reliability, consistency, and performance. Qualifications required for this role: - Bachelors or Masters degree in Computer Science or Electrical Engineering. - Proven software engineering experience in building complex systems. - Strong programming skills in Python (core software engineering, not just scripting). - Hands-on experience with SQL and relational data models. - Mandatory: Spark / PySpark experience in production projects. - Good analytical, problem-solving, and debugging skills. - Self-starter with the ability to work independently and take initiative. - Strong communication skills - highly proficient in English (both written and verbal). The company operates on a Contract-to-Hire basis with an initial contract length of 12 months. Please ensure you meet the above qualifications and responsibilities before applying.,