Senior Data Engineer

As a Data Solutions Specialist at Quantiphi, you will be part of a global and diverse culture that values transparency, diversity, integrity, learning, and growth. We take pride in fostering an environment that encourages innovation and excellence, not only in your professional endeavors but also in your personal life. Key Responsibilities: - Utilize your 3+ years of hands-on experience to deliver data solutions that drive business outcomes. - Develop data pipelines using PySpark within Databricks implementations. - Work with Databricks Workspaces, Notebooks, Delta Lake, and APIs to streamline data processes. - Utilize your expertise in Python, Scala, and advanced SQL for effective data manipulation and optimization. - Implement data integration projects using ETL to ensure seamless data flow. - Build and deploy cloud-based solutions at scale by ingesting data from sources like DB2. Preferred Skills: - Familiarity with AWS services such as S3, Redshift, and Secrets Manager. - Experience in implementing data integration projects using ETL, preferably with tools like Qlik Replicate & QlikCompose. - Proficiency in using orchestration tools like Airflow or Step Functions for workflow management. - Exposure to Infrastructure as Code (IaC) tools like Terraform and Continuous Integration/Continuous Deployment (CI/CD) tools. - Previous involvement in migrating on-premises data to the cloud and processing large datasets efficiently. - Knowledge in setting up data lakes and data warehouses on cloud platforms. - Implementation of industry best practices to ensure high-quality data solutions. If you are someone who thrives in an environment of wild growth and enjoys collaborating with happy, enthusiastic over-achievers, Quantiphi is the place for you to nurture your career and personal development. Join us in our journey of innovation and excellence!,