Lead I - Data Engineering - Databricks developer

You are looking for an experienced Databricks Developer with strong expertise in Python/PySpark, Databricks, and advanced SQL. Your role will involve designing, developing, and maintaining data pipelines using Databricks, Python/PySpark, and SQL. You will be responsible for implementing scalable ETL solutions to process structured and unstructured data. Working closely with data architects, analysts, and business stakeholders to understand data needs will be a key aspect of your job. Optimizing data workflows for performance, scalability, and reliability, ensuring data quality and integrity across systems, and monitoring production data pipelines are also part of your responsibilities. Writing clear, maintainable code and documentation, collaborating in Agile environments, and contributing to sprint planning and reviews are important aspects of this role. You must have strong hands-on experience with the Databricks platform, expertise in Python and PySpark for data engineering tasks, and advanced SQL skills for complex data querying and transformation. Experience working with large-scale datasets in distributed environments and a good understanding of data warehousing concepts and cloud data architecture are essential. It would be nice to have experience with Azure Data Lake, Delta Lake, or AWS S3, familiarity with CI/CD pipelines and version control (Git), and exposure to data governance, cataloging, and security best practices. A Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field is required. UST is a global digital transformation solutions provider that partners with clients from design to operation to embed innovation and agility into their organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact, touching billions of lives in the process.,