Sr Data Engineer

Job Description

At Visa, the Corporate Information Technology, Billing Incentives Platforms team, enables Visas revenue growth through flexible pricing engines and global revenue platforms built on next-generation technologies. This includes managing system requirements, evaluating cutting-edge technologies, design, development, integration, implementation, and maintenance of corporate revenue applications. The team works closely with business owners of these services to deliver customer developed solutions, as we'll as implement industry leading packaged software. This team has embarked on a major transformational journey to build and implement best of breed revenue and billing applications to transform our business as we'll as technology. This position is for a candidate with solid background in development and production, who will be able to navigate both data engineering and data science disciplines to build effective engineering solutions which will improve the current framework and help to speed up the processes. This position is ideal for an engineer who is passionate about solving challenging business problems and building applications that provide excellent user experience. The candidate will be extensively involved in hands-on activities including POCs, design, documentation, development, and testing of new functionality. Candidate must be flexible and willing to switch tasks based on teams needs. Key Responsibilities Responsible for the design, development, and implementation Work on development of new products iteratively by building quick POCs and converting ideas into real products. Work closely with architects, business, and technical stakeholders to develop high quality products and services that meet business requirements and expectations while applying the latest available tools and technology. Develop code to ensure deliverables are on time, within budget, and with good code quality. Have a passion for delivering zero defect code and be responsible for ensuring the teams deliverables meet or exceed the prescribed defect SLA. Coordinate Continuous Integration activities, testing automation frameworks, and other related items in addition to contributing core product code. Present technical solutions, capabilities, considerations, and features in business terms. Effectively communicate status, issues, and risks in a precise and timely manner Identify opportunities for further enhancements and refinements to standards and processes. Mentor junior team members, develop departmental procedures and best practices standards. With active engagement, collaboration, effective communication, quality, integrity, and reliable delivery develop and maintain a trusted and valued relationship with the team, customers, and business partners. This is a hybrid position. Expectation of days in office will be confirmed by your Hiring Manager. Basic Qualifications 2+ years of relevant work experience and a Bachelors degree, OR 5+ years of relevant work experience Preferred Qualifications 3 or more years of work experience with a Bachelor s Degree or more than 2 years of work experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) Minimum of 7 years of software development experience (with a concentration in data centric initiatives), with demonstrated expertise in leveraging standard development best practice methodologies Bachelor s Degree or an Advanced Degree (e.g. Masters) in Computer Science/ Engineering, Information Science or a related discipline Minimum of 5 years of hands-on experience in building large-scale applications or Framework using open-source technologies like Hadoop, Spark, Scala, Hive, Kafka Hands-on expertise in Oozie, Tuber Must have experience with Unix/Shell or Python scripting Experienced with highly distributed, scalable, concurrent, and low latency systems working with one or more of the following database technologies: MySQL, Oracle , Mongo Experienced with building SQL for extracting, aggregating, and processing big data Pipelines using Hadoop, EMR & NoSQL Databases. Hands on experience in Version control using SVN, Git, Bitbucket Experience in Automating data processing using Control-M, ESP Series Experience in building Automation Framework is a plus Experience working in an Agile and Test-Driven Development environment Should be self- sufficient in Testing the Framework and Workflows as well Strong knowledge of API development is highly desired Strategic thinker and good business acumen to orient data engineering to the business needs of internal and external clients Demonstrated intellectual and analytical rigor, strong attention to detail, team oriented, energetic, collaborative, diplomatic, and flexible style Previous exposure to financial services is a plus