Senior Data Engineer

Senior Data Engineer

Experience Range:

Location:

Responsibilities and Duties of the Role:

• Build components of large-scale data platform for real-time and batch processing, and own features of big data applications to fit evolving business needs
• Build next-gen cloud based big data infrastructure for batch and streaming data applications, and continuously improve performance, scalability and availability
• Contribute to the best engineering practices, including the use of design patterns, CI/CD, code review and automated test
• Chip in ground-breaking innovation and apply the state-of-the-art technologies
• As a key member of the team, contribute to all aspects of the software lifecycle: design, experimentation, implementation and testing
• Collaborate with team to develop software architectures which are robust, fault-tolerant, and cloud-native
• Possess AWS managed service solution design and implementation experience.
• Reason logically and creatively, identifying problems, drawing valid conclusions from the data available, and develop effective solutions while applying creative thinking in the design and development of high performing data applications
• Collaborate with fellow engineers to keep the teams technology radar and architecture principles aligned to the industry and needs of our users
• Deliver multiple projects utilizing an Agile methodology
• Take a high ownership, self-sufficient, hands-on position on the team to collaborate and drive quality, maintain application stability
• Write complex programs, analyze code changes and suggest improvements
• Check-in valuable, clean code on a daily basis that adds new features and capabilities
• Investigate and resolve any production issues from end user to persistence layer and work to prevent them
• Work with leads, product managers and managers to ensure that all project deliverables are on time and high quality
• Work collaboratively with other service teams

Basic Qualifications

• Hold a Bachelors degree in Computer Science, Computer Information Systems, Engineering, or another technical field
• Have 4+ years of experience in big data application development in a large enterprise environment using Java, Scala, Python, including familiarity with modern frameworks and platforms (e.g., Spark, Flink, Singlestore, Kafka, Nifi and AWS big data technologies)
• Be able to demonstrate experience working with relational databases, SQL and newer NoSQL data stores as well as event streaming platforms
• Demonstrated ability with cloud infrastructure technologies, including Terraform, K8S, Spinnaker, IAM, ALB, etc.
• Have a strong interest in open source technology
• Knowledge of building highly available and scalable services
• Passion about technologies and openness to interdisciplinary work
• Possess good communication skills and enjoy helping others to succeed as a team
• Care about your craft and have opinions about the right way to do things with technology

Preferred Qualifications

• Master's degree in Computer Science, Software Engineering or related technical discipline is desirable
• Previous work experience in advertising industry-based applications
• Experience with Databricks, Snowflake, Presto, Kinesis
• Experience working with vendor teams to deliver high quality results
• Knowledge of performance testing and application profiling.