Job
Description
As a Sr Data Engineer, youd be functioning as a design/development expert in a scrum team of 8-10 members. Youd have end-to-end ownership of your stories and deliveries. Youd be reporting to a Director of Authentication. Essential Functions: Demonstrates relevant technical working knowledge to understand requirements. Work with Product owners, architects and other relevant stakeholders to gather and refine requirements for one or more products, taking in to account the existing tools and solutions across departments. Translates functional requirements into system designs for one or more components and communicates how the components will interact. Demonstrates understanding of non-functional requirements (NFR) and their impact on the system. Leads junior engineers in understanding requirements. Design, Code, test, document and implement new applications & as well as existing programs. Develop code that complies with design specifications and meets security and coding best practices. Work independently and provide guidance to junior developers. Work with team members on technical software development issues, problem analysis and resolution. Participate in design and code review sessions as appropriate - to ensure the quality of work delivered by teammates is in accordance with development standards. Write automation scripts to functionally automate the testing. Learn and adopt technologies, like generative AI, that provide developer productivity improvements. Engages with product engineering teams and product owners during code/design reviews, regular meetings, on-call rotations, and incident responses throughout product development and operations cycles. Leverages advanced knowledge of systems or platforms and telemetry analyses to propose isolated improvements in code, processes, and designs to deliver on customer/business objectives more effectively. Basic Qualifications 3 - 7 years of work experience with a Bachelor s Degree or with an Advanced Degree. Proven hands-on capability on development of data pipelines. Experience in creating data driven business solutions and solving data problems using a wide variety of technologies such as Hadoop, Hive, Spark, Cassandra, NoSQL, as well as traditional data technologies (DB2 - RDBMS). Design and development skills with Big Data technologies like Hadoop, Spark, Hive, Presto and Map Reduce Ability to program in one or more scripting / programming languages such as Python, Java or Scala Experience developing large scale, enterprise class distributed pipelines that require high availability, low latency & strong data consistency computing is a plus. Experience with Continuous Integration and Automated Test tools such as Jenkins, Artifactory, Git, Bitbucket. Experience in Graph processing technologies and graph databases such as GraphX and Neo4j is a plus. Excellent communication skills (Written and Verbal) Proactive & Collaborative mindset towards problem solving, automation and innovation in solution delivery. Working knowledge of Machine Learning, Predictive AI & Generative AI is a plus.
