Senior AI and Data Consultant at EY - GDS Consulting

Role Overview: You will be responsible for designing, building, and maintaining scalable and efficient data pipelines using Databricks and Python. Your role will involve developing ETL processes, collaborating with cross-functional teams, writing and optimizing Python scripts, ensuring data quality, and staying updated with industry trends in data engineering technologies. Key Responsibilities: - Design, build, and maintain scalable and efficient data pipelines using Databricks and Python. - Develop ETL processes to ingest and transform data from various sources into a structured and usable format. - Collaborate with cross-functional teams to gather requirements and deliver data engineering solutions supporting business objectives. - Write and optimize Python scripts for data extraction, transformation, and loading tasks. - Ensure data quality and integrity by implementing best practices and standards for data engineering. - Monitor and troubleshoot ETL processes, performing root cause analysis, and implementing fixes to improve performance and reliability. - Document data engineering processes by creating clear and concise technical documentation for data pipelines and architectures. - Stay current with industry trends and advancements in data engineering technologies and methodologies. Qualifications: - Bachelor's degree in Computer Science, Information Technology, or a related field. - Minimum of 3-5 years of experience in data engineering, focusing on Databricks and Python scripting for ETL implementation. - Strong understanding of data warehousing concepts, experience with SQL and NoSQL databases. - Proficiency in Python and familiarity with data engineering libraries and frameworks. - Experience with cloud platforms (e.g., AWS, Azure) and big data technologies is a plus. - Excellent problem-solving skills and attention to detail. - Ability to work independently and as part of a collaborative team. Company Details: EY is building a better working world by creating new value for clients, people, society, and the planet while building trust in capital markets. Enabled by data, AI, and advanced technology, EY teams help clients shape the future with confidence and develop solutions for pressing issues. EY offers a dynamic work environment with a strong emphasis on delivering high-quality data solutions and the opportunity to work with a diverse team on impactful projects.,