Data Engineer - Pyspark - C12 - Chennai

The Data Engineer is responsible for developing high-quality data products to support the bank's regulatory requirements and data-driven decision-making. As a Data Engineer, you will set an example for other team members, collaborate closely with customers, and address any obstacles that may arise. With your expertise in data architecture standards, data warehousing, data structures, and business intelligence, you will contribute to business outcomes within an agile team. Your responsibilities will include developing and supporting scalable, extensible, and highly available data solutions, ensuring alignment with the broader architectural vision, identifying and mitigating risks in the data supply chain, adhering to technical standards, and designing and developing analytical data models. To excel in this role, you should possess a First-Class Degree in Engineering/Technology, have 9 to 11 years of experience implementing data-intensive solutions using agile methodologies, be proficient in relational databases and SQL for data querying and manipulation, have experience in modelling data for analytical consumers, and demonstrate the ability to automate and streamline data pipelines. You must also have experience in cloud-native technologies, a keen interest in learning new technologies, excellent communication and problem-solving skills, and a willingness to mentor and lead medium-sized components independently. **Required Qualifications & Work Experience:** - First-Class Degree in Engineering/Technology - 9 to 11 years of experience in implementing data-intensive solutions using agile methodologies - Proficiency in relational databases and SQL - Experience in modelling data for analytical consumers - Ability to automate and streamline data pipelines - Experience in cloud native technologies - Passion for learning new technologies - Excellent communication and problem-solving skills - Inclination to mentor and lead independently **Technical Skills (Must Have):** - ETL: Hands-on experience with platforms such as Ab Initio, Apache Spark, Talend, or Informatica - Big Data: Experience with platforms like Hadoop, Hive, or Snowflake - Data Warehousing & Database Management: Expertise in relational and NoSQL database design - Data Modeling & Design: Exposure to data modeling techniques - Languages: Proficiency in Python, Java, or Scala - DevOps: Exposure to CI/CD platforms, version control, automated quality control - Data Governance: Understanding of data quality, security, privacy, and compliance **Technical Skills (Valuable):** - Ab Initio: Experience in developing Co>Op graphs and full suite of Ab Initio toolsets - Cloud: Exposure to public cloud data platforms - Data Quality & Controls: Familiarity with data validation, cleansing, and controls - Containerization: Understanding of containerization platforms - File Formats: Experience with formats like Avro, Parquet, Protobuf, etc. - Others: Exposure to Job schedulers and Business Intelligence tools Certifications in any of the mentioned topics would be advantageous. This is a full-time position in the Digital Software Engineering job family group within the Technology department at the bank. If you require any accommodations due to a disability, please review the Accessibility at Citis policy.,