Senior Databricks Engineer

As a Senior Data Engineer at our company, you will play a crucial role in designing, building, and optimizing scalable data pipelines on AWS. Your responsibilities will include implementing data ingestion, transformation, and integration solutions using Databricks, Glue, and SQL. You will also be tasked with managing and optimizing cloud storage and compute environments, as well as ensuring robust, automated deployments with Terraform and Jenkins. Collaborating with cross-functional teams to deliver high-quality data products will be a key part of your role. Key Responsibilities: - Design, build, and optimize scalable data pipelines on AWS - Implement data ingestion, transformation, and integration solutions using Databricks, Glue, and SQL - Manage and optimize cloud storage and compute environments - Ensure robust, automated deployments with Terraform and Jenkins - Collaborate with cross-functional teams to deliver high-quality data products Qualifications Required: - Strong programming skills in Python, Databricks - Hands-on experience with Apache Spark & Databricks for big data processing on AWS cloud - Proficiency with AWS services such as S3, Glue, Redshift, EMR, Lambda - Strong SQL skills for data transformation and analytics - Expertise in setting up and managing CI/CD pipelines with Jenkins Additionally, you will have the opportunity to work on cutting-edge data engineering projects in healthcare analytics. Our hybrid work model offers flexibility and collaboration, and you will have the chance to grow in a fast-paced, innovation-driven environment. If you are excited about the prospect of contributing to impactful projects in the healthcare analytics space and possess the required technical skills and experience, we encourage you to apply now by sending your updated resume to careers@sidinformation.com. Join us on this exciting journey!,