Senior Software Engineer

Job Description

Overview About Business Unit: The Product team forms the crux of our powerful platforms and helps connect millions of customers worldwide with the brands that matter most to them. This team of innovative thinkers develops and builds products that position Epsilon as a differentiator, fostering an open and balanced marketplace built on respect for individuals, where every brand interaction holds value. Our full-cycle product engineering and data teams chart the future and set new benchmarks for our products, by leveraging industry best practices and advanced capabilities in data, machine learning, and artificial intelligence. Driven by a passion for delivering smart end-to-end solutions, this team plays a key role in Epsilon s success story. We are looking for a skilled Big Data Administrator with 4-7 years of experience to support and manage cloud-based big data infrastructure using AWS managed services and Databricks. The ideal candidate will have strong expertise in Linux, automation, and operational support of services like EMR, Kafka, MSK, and Databricks clusters. Why we are looking for you: We are looking for Senior Software Engineer to work on groundbreaking multichannel SaaS Digital Marketing Platform that focuses on uniquely identify the customer s patterns, effectively interact with them across channels and achieve a positive return on marketing investment (ROMI). The platform helps consolidate and integrates the features and functionality typically found in stand-alone services and channel-specific messaging platforms to give marketers a tightly integrated, easily orchestrated, insights-driven, cross channel marketing capability. Primary role of the Senior Software Engineer is to envision and build internet scale services on Cloud using Python and distributed technologies. Responsible for development and maintenance of applications with technologies involving Enterprise Python and Distributed technologies. Collaborate with developers, product manager, business analysts and business users in conceptualizing, estimating and developing new software applications and enhancements. Assist in the development, and documentation of software s objectives, deliverables, and specifications in collaboration with internal users and departments. Collaborate with QA team to define test cases, metrics, and resolve questions about test results. Assist in the design and implementation process for new products, research and create POC for possible solutions. Develop components based on business and/or application requirements Create unit tests in accordance with team policies & procedures Advise, and mentor team members in specialized technical areas as well as fulfill administrative duties as defined by support process Create Value-adds that would contribute to Cost Optimizations/ Scalability/ Reliability/Secure solutions What you will enjoy in this role About the Team and opportunities The India Product Engineering team forms the crux of our powerful PeopleCloud platform and connects millions of customers. The 400+ strong product organization in Epsilon India, is a full-cycle Engineering team that drives architecture, POCs, implementation, Quality Automation, product management, support, operations and DevOps. There are, 25+ Scrum teams as part of the India Engineering center, driving outcomes across the breadth of the Epsilon PeopleCloud suite of products. This team of innovative thinkers develops and builds products that help Epsilon be a market differentiator. They map the future and set new standards for our products, empowered with industry best practices, ML and AI capabilities. The team passionately delivers intelligent end-to-end solutions and plays a key role in Epsilon s success story Tech Stack: Our integrated suite of modular products is designed to help deliver personalized experiences and drive meaningful outcomes. Our tech stack caters to a fusion of data and technology with SaaS offerings developed as a Cloud-first approach. Here, a solid understanding of software security practices including user authentication and authorization and being data-savvy would be key. You should also come with the ability to leverage best practices in design patterns, and design algorithms for software development that focus on high quality and agility. You must also have a good understanding of Agile Methodologies like SCRUM. You can refer this article also. What you will do: You would - Be responsible for development and maintenance of applications with technologies involving Enterprise Python and Distributed technologies. Collaborate with developers, product manager, business analysts and business users in conceptualizing, estimating and developing new software applications and enhancements. Assist in the development, and documentation of software s objectives, deliverables, and specifications in collaboration with internal users and departments. Collaborate with QA team to define test cases, metrics, and resolve questions about test results. Assist in the design and implementation process for new products, research and create POC for possible solutions. Develop components based on business and/or application requirements Create unit tests in accordance with team policies & procedures Advise, and mentor team members in specialized technical areas as well as fulfill administrative duties as defined by support process Create Value-adds that would contribute to Cost Optimizations/ Scalability/ Reliability/Secure solutions Click here to view how Epsilon transforms marketing with 1 View, 1 Vision and 1 Voice. Responsibilities Key Responsibilities: Administer and support Linux-based big data environments hosted on AWS Cloud and on-prem environments. Manage and maintain AWS-managed big data services including Amazon EMR, Amazon MSK, and Amazon Managed Kafka. Administer HBase clusters, ensuring optimal performance, scalability, and data integrity. Manage and monitor Databricks All-Purpose Clusters, Job Clusters, and SQL Warehouses, ensuring efficient resource utilization and high availability. Perform cluster upgrades and patching for EMR and MSK to enhance system stability and performance. Implement automation for cluster provisioning, configuration, and operational tasks using Ansible and Shell scripting. Monitor job performance and resource usage across data pipelines, taking corrective actions as needed. Collaborate with data engineers and developers to support ETL workflows and optimize pipeline reliability. Configure IAM roles, networking, and security policies to secure big data environments. Implement proactive monitoring, logging, and alerting using CloudWatch, Databricks metrics, or third-party tools. Troubleshoot cluster failures, job execution issues, and data inconsistencies across services. Maintain backups and support disaster recovery strategies for critical data and metadata stores. Document infrastructure components, operational runbooks, upgrade processes, and best practices. Analyze and optimize performance and cost-efficiency of cloud-based big data workloads. Stay updated with emerging big data and cloud technologies and contribute to architectural improvements. Qualifications Bachelor s degree or equivalent in computer science Strong experience in Linux system administration. Hands-on expertise with AWS services: EMR, MSK, Kafka, S3, IAM, and VPC. Experience managing HBase in distributed environments. Deep understanding of Databricks clusters, job scheduling, and SQL Warehouse monitoring. Proficiency in Ansible and Shell scripting for automation and orchestration. Experience with EMR/MSK upgrades, tuning, and troubleshooting. Strong analytical, communication, and problem-solving skills. Additional Information Epsilon is a global data, technology and services company that powers the marketing and advertising ecosystem. For decades, we ve provided marketers from the world s leading brands the data, technology and services they need to engage consumers with 1 View, 1 Vision and 1 Voice. 1 View of their universe of potential buyers. 1 Vision for engaging each individual. And 1 Voice to harmonize engagement across paid, owned and earned channels. Epsilon s comprehensive portfolio of capabilities across our suite of digital media, messaging and loyalty solutions bridge the divide between marketing and advertising technology.