Job
Description
As a Data Engineer at our organization, you will play a crucial role in our data team by utilizing your expertise in Python and PySpark to design, develop, and maintain scalable data pipelines and infrastructure. Your responsibilities will involve powering our analytics and machine learning initiatives through the creation of robust and high-performance data workflows. With a minimum of 5 years of experience in data engineering or a related field, you will be expected to design and implement data pipelines using PySpark and Python, develop ETL/ELT workflows for data ingestion, transformation, and loading, and optimize data processing jobs for enhanced performance and cost-efficiency in distributed environments. Collaboration with data scientists, analysts, and business stakeholders to comprehend data requirements will be a key aspect of your role. Ensuring data quality, integrity, and governance across all pipelines, monitoring and troubleshooting production data workflows, and proactively resolving issues will be part of your daily tasks. Leveraging Azure for data storage, processing, and orchestration is essential, along with a strong proficiency in Python for data manipulation and scripting, hands-on experience in PySpark and distributed data processing, and a solid understanding of SQL and relational databases. Additionally, familiarity with data modeling, data warehousing, and performance tuning, as well as experience with version control systems like Git and CI/CD pipelines, will be beneficial in excelling in this role. Join our growing data team and contribute to the transformation of businesses globally through the application of next-generation technology. About Mphasis: Mphasis is dedicated to leveraging cutting-edge technology to drive global business transformations. With a customer-centric approach, Mphasis focuses on providing hyper-personalized digital experiences through cloud and cognitive technologies. The Mphasis Service Transformation approach aids businesses in adapting to a changing world by applying digital technologies across legacy environments. The organization's core reference architectures, tools, and domain expertise facilitate innovation and speed, leading to strong client relationships. Mphasis is an Equal Opportunity Employer committed to providing reasonable accommodations for individuals with disabilities. If you require assistance due to a disability when searching and applying for career opportunities, please contact us at accomodationrequest@mphasis.com with your contact details and the nature of your request.,