Azure Databricks writing code in Python and SQL with PySpark

As a Data Engineer Grade 5 at our company, you will be responsible for building solutions against delta lakes and relational databases. Your main tasks will include working on Azure Databricks, writing code in Python and SQL with PySpark, and performing analysis, design, implementation, and testing. We highly value automated testing to ensure the quality of our solutions. Key Responsibilities: - Extend the functionality of the consistency check engine for the sub-ledger data and any other tenants - Dive deeply into spark performance optimization due to large data volume (datasets with 10s of billion rows, 200+ columns) Qualifications Required: - Bachelor's or master's degree in computer science or electrical engineering - Expert software engineering skills with proven experience developing complex software systems - Strong core Python software engineering experience - Good understanding and significant experience with projects using relational data models and SQL - Spark experience is a must - Good work ethic and self-starter mentality - Strong analytical skills and ability to break down complexity into achievable steps - Highly proficient in English (written and verbal) If you meet the qualifications and are ready to take on this exciting opportunity, please share your CV at krishna.bhagdeo@infoorigin.com. APPLY NOW and join us in creating innovative solutions!,