SAS Consultant

Title - SAS Data Engineer Type - Contract Location - Remote Roles and Responsibilities: - Lead the migration of code and processes from SAS to Databricks, ensuring seamless integration and functionality. - Develop, test, and optimize PySpark and Python code within the Databricks environment to improve performance and efficiency. - Design and implement data pipelines and workflows using Databricks notebooks and job clusters. - Schedule and manage jobs in Databricks to ensure timely data processing and availability. - Collaborate with the portfolio analytics team to understand data requirements and deliver solutions that meet business needs. - Mentor junior analysts, providing guidance and training on best practices in data engineering and the use of Databricks. - Prepare and present training materials, starting with a general introduction to the position and its responsibilities. - Utilize version control systems, such as GitHub, to manage and document code changes effectively. - Work with Snowflake and Snowpark to write complex, optimized queries across large datasets. - Employ Airflow scheduler for orchestrating and automating complex data workflows (preferred). Qualifications: - Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field. - Minimum of 5-8 years of hands-on experience in Databricks workspace, Databricks notebooks, and job clusters. - Strong experience in PySpark and Python coding within the Databricks environment. - Proven experience in performance tuning and optimizing code in Databricks. - Familiarity with SAS and experience supporting migration to Databricks. - Strong working knowledge of Snowflake and Snowpark for data querying and manipulation. - Experience with version control systems, particularly GitHub. - Experience with Airflow scheduler is preferred. - Excellent problem-solving skills and attention to detail. - Strong communication skills, with the ability to mentor and train junior team members. Tools and Technologies: - Databricks - PySpark - Python - Snowflake and Snowpark - GitHub - Airflow (preferred) - SAS (for migration purposes) Show more Show less