Senior Data Engineer/Analyst

As a Data Engineer / Analyst at our company, your main responsibilities will include: - Designing, developing, and maintaining data solutions on Azure Databricks using Python, SQL, and PySpark. - Working extensively with Delta Lake and relational databases to build scalable data pipelines. - Performing analysis, design, implementation, and automated testing of data solutions. - Enhancing the consistency check engine for sub-ledger data and other tenants. - Optimizing Spark performance for very large datasets (10s of billions of rows, 200+ columns). - Identifying, troubleshooting, and resolving data issues proactively. - Collaborating with cross-functional teams to ensure data reliability, consistency, and performance. Qualifications required for this role: - Bachelor's or Master's degree in Computer Science or Electrical Engineering. - Proven software engineering experience in building complex systems. - Strong programming skills in Python (core software engineering, not just scripting). - Hands-on experience with SQL and relational data models. - Mandatory experience with Spark / PySpark in production projects. - Good analytical, problem-solving, and debugging skills. - Self-starter with the ability to work independently and take initiative. - Strong communication skills highly proficient in English (both written and verbal). Please note that this is a Contract-to-Hire position with an initial contract length of 12 months. The work location is in person at Hyderabad (Hybrid). If you have: 1. Total IT experience 2. Strong programming skills in Python 3. Hands-on experience with SQL and relational data models 4. Strong Spark / PySpark experience 5. Notice period of 30 days or less We encourage you to apply for this exciting opportunity.,