2 Analytical Pipelines Jobs

Are you ready for the best destination of your career Spotnana is transforming the $11 trillion travel industry by building modern infrastructure that brings freedom, simplicity, and trust to travelers worldwide. Backed by over $115M in funding from top-tier investors, including ICONIQ, Durable, Mubadala, Madrona, and Sandberg Bernthal Ventures, we are addressing some of the travel industry's most complex challenges, and we need your expertise to help us succeed. We are looking for a hands-on person, leading a team of top talent engineers in the design, development, test, and deployment of Spotnana. Air Pod is responsible for providing the best experience to all personas throughout the air travel lifecycle from agents booking on behalf of travelers to travelers getting the latest information on the Trips page. You are a leader with progressive technical experience, a demonstrated progression of management scope, and a passion for managing engineering talent in a fast-paced environment. You stay current with your technical skills and possess exceptional project management and communication skills. **What you'll own:** - Architect, design and implement scalable, highly available, performant, and reliable systems from the ground up. - Build an easy debugging and monitoring framework for all the microservices. - Manage the infrastructure on AWS, GCP, and Azure cloud. - Build a very strong engineering culture of extensive testing, quality code reviews, documentation, and integrations. - Guide and grow junior engineers in the company. **Experience to bring with you:** - Bachelor's degree or equivalent in Computer Science. - Total 12+ years of engineering experience. - Minimum 5 years of experience in Java, Spring, gRPC, AWS, Docker, etc. - Minimum 5 years experience developing/deploying/running metrics processing and monitoring systems. - Hands-on person with 70% work towards hands-on work and remaining 30% team management. - Minimum 5 years of experience in distributed systems, networking, and multithreaded programming. - Minimum 5 years of experience in various SQL/no-SQL databases, Kafka, Caching systems, and Analytical pipelines. - Experience with CI platforms (Jenkins, CircleCI, Travis, etc). - Expert in JPA, Hibernate, and Spring Data JPA. - Very hands-on with writing beautiful, bug-free code and architecting large-scale systems. - At least 1+ years of experience managing engineering teams of 3 people or more. - Foster an environment of continuous learning, provide constructive feedback, and support individual career growth paths to maximize team potential and productivity. - Set clear goals, define key performance indicators (KPIs), conduct regular performance reviews, and ensure consistent delivery against objectives. - Promote open communication, encourage cross-functional teamwork, resolve conflicts effectively, and ensure all team members feel valued and empowered. **Let's talk compensation:** Spotnana strives to offer fair, industry-competitive, and equitable compensation. Our approach holistically assesses total compensation, including cash, company equity, and comprehensive benefits. Our market-based compensation approach uses data from trusted third party compensation sources to set salary ranges that are thoughtful and consistent with the role, industry, company size, and internal equity of our team. Each employee is paid within the minimum and maximum of their position's compensation range based on their skills, experience, qualifications, and other job-related specifications. We care for the people who make everything possible - our benefits offerings include: - Equity in the form of stock options which provides partial ownership in the company so you can share in the success of the company as it grows. - Comprehensive benefit plans covering medical for self, spouse, children and parents, Free doctor consultations, Employee assistance program effective on your hire date. - 18 Privilege leaves, 12 casual/sick leave days per year in addition to 12 company holidays, 4 company recharge/wellness days and an end of year company shutdown. - Up to 26 weeks of Parental Leave. - Monthly cell phone / internet stipend. - Meal allowance. - Wellness/Gym Reimbursement. - Relocation assistance to new joiners. - Employee retirement planning such as corporate NPS and EPF.,

Our Client in India is one of the leading providers of risk, financial services and business advisory, internal audit, corporate governance, and tax and regulatory services. Our Client was established in India in September 1993, and has rapidly built a significant competitive presence in the country. The firm operates from its offices in Mumbai, Pune, Delhi, Kolkata, Chennai, Bangalore, Hyderabad , Kochi, Chandigarh and Ahmedabad, and offers its clients a full range of services, including financial and business advisory, tax and regulatory. Our client has their client base of over 2700 companies. Their global approach to service delivery helps provide value-added services to clients. The firm serves leading information technology companies and has a strong presence in the financial services sector in India while serving a number of market leaders in other industry segments. Job Requirements Mandatory Skills Bachelor s or higher degree in Computer Science or a related discipline or equivalent (minimum 7+ years work experience). At least 6+ years of consulting or client service delivery experience on Azure Microsoft data engineering. At least 4+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases such as SQL server and data warehouse solutions such as Synapse/Azure Databricks, Microsoft Fabric Hands-on experience implementing data ingestion, ETL and data processing using Azure services: Fabric, onelake, ADLS, Azure Data Factory, Azure Functions, services in Microsoft Fabric etc. Minimum of 5+ years of hands-on experience in Azure and Big Data technologies such as Fabric, databricks, Python, SQL, ADLS/Blob, pyspark/SparkSQL. Minimum of 3+ years of RDBMS experience Experience in using Big Data File Formats and compression techniques. Experience working with Developer tools such as Azure DevOps, Visual Studio Team Server, Git, etc. Preferred Skills Technical Leadership & Demo Delivery: oProvide technical leadership to the data engineering team, guiding the design and implementation of data solutions. oDeliver compelling and clear demonstrations of data engineering solutions to stakeholders and clients, showcasing functionality and business value. oCommunicate fluently in English with clients, translating complex technical concepts into business-friendly language during presentations, meetings, and consultations. ETL Development & Deployment on Azure Cloud: oDesign, develop, and deploy robust ETL (Extract, Transform, Load) pipelines using Azure Data Factory (ADF), Azure Synapse Analytics, Azure Notebooks, Azure Functions, and other Azure services. oEnsure scalable, efficient, and secure data integration workflows that meet business requirements. oPreferably to have following skills Azure doc intelligence, custom app, blob storage oDesign and develop data quality frameworks to validate, cleanse, and monitor data integrity. oPerform advanced data transformations, including Slowly Changing Dimensions (SCD Type 1 and Type 2), using Fabric Notebooks or Databricks. oPreferably to have following skills Azure doc intelligence, custom app, blob storage Microsoft Certifications: oHold relevant role-based Microsoft certifications, such as: DP-203: Data Engineering on Microsoft Azure AI-900: Microsoft Azure AI Fundamentals. oAdditional certifications in related areas (e.g., PL-300 for Power BI) are a plus. Azure Security & Access Management: oStrong knowledge of Azure Role-Based Access Control (RBAC) and Identity and Access Management (IAM). oImplement and manage access controls, ensuring data security and compliance with organizational and regulatory standards on Azure Cloud. Additional Responsibilities & Skills: oTeam Collaboration: Mentor junior engineers, fostering a culture of continuous learning and knowledge sharing within the team. oProject Management: Oversee data engineering projects, ensuring timely delivery within scope and budget, while coordinating with cross-functional teams. oData Governance: Implement data governance practices, including data lineage, cataloging, and compliance with standards like GDPR or CCPA. oPerformance Optimization: Optimize ETL pipelines and data workflows for performance, cost-efficiency, and scalability on Azure platforms. oCross-Platform Knowledge: Familiarity with integrating Azure services with other cloud platforms (e.g., AWS, GCP) or hybrid environments is an added advantage. Soft Skills & Client Engagement: oExceptional problem-solving skills with a proactive approach to addressing technical challenges. oStrong interpersonal skills to build trusted relationships with clients and stakeholders. Ability to manage multiple priorities in a fast-paced environment, ensuring high-quality deliverables.