AWS Databricks/ Pyspark Engineer

As an AWS Databricks/ PySpark Engineer, you will play a crucial role in designing, developing, and maintaining scalable data pipelines using Databricks and AWS. Your responsibilities will include: - Designing, developing, and maintaining scalable data pipelines using Databricks and AWS - Implementing ETL processes to ingest, transform, and load large datasets efficiently - Collaborating with data architects and business stakeholders to understand data requirements and deliver solutions - Optimizing data workflows for performance, scalability, and reliability within Azure cloud environments - Ensuring data quality governance and security best practices are followed - Monitoring and troubleshooting data pipeline issues to maintain operational stability - Staying updated with the latest trends and technologies in data engineering and cloud platforms - Providing technical guidance and mentorship to junior team members - Participating in Agile development processes and contributing to continuous improvement initiatives Qualifications required for this role include: - 8+ years of experience in AWS Databricks/ PySpark engineering - Proficiency in Databricks, PySpark, AWS Cloud, ETL, Data Engineering, and SQL If you are interested in this position and believe you have the required skills and experience, please share your updated resume to sai.a@s3staff.com.,