Lead I - Software Engineering - Spark & Databricks Developers

You are invited to join a dynamic team for a long-term project as a Spark & Databricks Developer. Your role involves designing, developing, and optimizing big data pipelines using Apache Spark, building scalable data solutions on Databricks, collaborating with cross-functional teams for data integration, and managing version control using GitHub. Your responsibilities also include ensuring data quality, performance tuning, and participating in code reviews, testing, and documentation. Key Responsibilities: - Design, develop, and optimize big data pipelines using Apache Spark - Build and maintain scalable data solutions on Databricks - Collaborate with cross-functional teams for data integration and transformation - Manage version control and code collaboration using GitHub - Ensure data quality, performance tuning, and job optimization - Participate in code reviews, testing, and documentation Qualifications Required: - 4+ years of experience in data engineering or related roles - Strong hands-on expertise in Apache Spark (batch & streaming) - Proficiency in using Databricks for developing and managing data workflows - Experience with GitHub for code versioning, pull requests, and branching strategies - Good understanding of data lake/data warehouse architectures - Strong SQL and Python scripting skills About UST: UST is a global digital transformation solutions provider that partners with clients from design to operation. With over 30,000 employees in 30 countries, UST embeds innovation and agility into their clients" organizations, impacting billions of lives in the process.,