35104 Spark Jobs - Page 11

Create Solution Outline and Macro Design to describe end to end product implementation in Data Platforms including, System integration, Data ingestion, Data processing, Serving layer, Design Patterns, Platform Architecture Principles for Data platform Contribute to pre-sales, sales support through RfP responses, Solution Architecture, Planning and Estimation Contribute to reusable components / asset / accelerator development to support capability development Participate in Customer presentations as Platform Architects / Subject Matter Experts on Big Data, Azure Cloud and related technologies Participate in customer PoCs to deliver the outcomes Participate in delivery reviews / product review...

The ability to be a team player The ability and skill to train other people in procedural and technical topics Strong communication and collaboration skills Required education Bachelor's Degree Required technical and professional expertise Able to write complex SQL queries ; Having experience in Azure Databricks Preferred technical and professional experience Excellent communication and stakeholder management skills

Focus Areas Build applications and solutions that process and analyze large-scale data. Develop data-driven applications and analytical tools. Implement business logic, algorithms, and backend services. Design and build APIs for secure and efficient data exchange. Key Responsibilities Develop and maintain data processing applications using Apache Spark and Hadoop. Write MapReduce jobs and complex data transformation logic. Implement machine learning models and analytics solutions for business use cases. Optimize code for performance and scalability; perform debugging and troubleshooting. Work hands-on with Databricks for data engineering and analysis. Design and manage Airflow DAGs for orche...

Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. 7+ Yrs total experience in Data Engineering projects & 4+ years of relevant experience on Azure technology services and Python Azure Azure data factory, ADLS- Azure data lake store, Azure data bricks, Mandatory Programming languages Py-Spark, PL/SQL, Spark SQL Database SQL DB Experience with AzureADLS, Databricks, Stream Analytics, SQL DW, COSMOS DB, Analysis Services, Azure Functions, Serverless Architecture, ARM Templates Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with object-oriented/object function scripting languagesPython...

About The Role Grade Level (for internal use): 11 The Team Revenue Operations sits at the centre of our sales and booking processes, playing a pivotal role in shaping how these processes should look and function. Our team is dedicated to driving efficiency and effectiveness across all operations, ensuring seamless integration and optimization. We value collaboration, innovation, and a proactive approach to problem-solving, making decisions that impact the entire organization. Responsibilities And Impact Acquire a comprehensive understanding of Revenue Operations processes and collaborate with operations managers to identify, prioritize, and implement initiatives focused on lean methodologies...

The Principal Data Engineer will be a senior individual contributor responsible for designing, building, and optimizing advanced data solutions that power enterprise-wide analytics, AI/ML, and data-driven decision-making. Reporting directly to the Senior Director of Data Platforms, this role will serve as a technical expert and thought partner in scaling modern data architectures, enabling AI orchestration, and delivering robust, secure, and compliant data products. This position is highly hands-on, requiring expertise in data engineering, Databricks, Python, AI/ML platforms, and orchestration frameworks. The Principal Engineer will work across functional teams to design and implement high-p...

Job Overview Summary The Lead Data Architect is a strategic and technical leadership role responsible for architecting, scaling, and evolving enterprise-grade data platforms that enable advanced analytics, AI/ML, and data-driven decision-making. Reporting to the Senior Director of Data Platforms , this role will lead the design and governance of modern data architectures, drive innovation in AI orchestration, and ensure the delivery of secure, compliant, and high-performing data solutions. This position combines hands-on engineering expertise with architectural vision and cross-functional leadership. The Lead Data Architect will guide engineering teams, influence platform strategy, and estab...

Develop, test, and maintain ETL pipelines from TMS source systems to canonical layers. Implement data transformation, cleansing, and validation logic. Support QA by fixing data defects and ensuring completeness of load. Mandatory Competencies ETL - ETL - Tester Beh - Communication ETL - ETL - AWS Glue Data Science and Machine Learning - Data Science and Machine Learning - Databricks

The Principal Data Engineer will be a senior individual contributor responsible for designing, building, and optimizing advanced data solutions that power enterprise-wide analytics, AI/ML, and data-driven decision-making. Reporting directly to the Senior Director of Data Platforms, this role will serve as a technical expert and thought partner in scaling modern data architectures, enabling AI orchestration, and delivering robust, secure, and compliant data products. This position is highly hands-on, requiring expertise in data engineering, Databricks, Python, AI/ML platforms, and orchestration frameworks. The Principal Engineer will work across functional teams to design and implement high-p...

Hi, Wishes from GSN !!! Pleasure connecting with you!!! We been into Corporate Search Services for Identifying & Bringing in Stellar Talented Professionals for our reputed IT / Non-IT clients in India. We have been successfully providing results to various potential needs of our clients for the last 20 years. At present, GSN is hiring DATA ENGINEER for one of our leading MNC client. PFB the details for your better understanding : ******** Looking for SHORT JOINERS ******** WORK LOCATION: Bangalore/ Hyderabad / Pune Job Role: Data Engineer Mandatory Skills: Python, AWS, Spark, Airflow, Databricks EXPERIENCE: 6+ Yrs CTC Range: 15 LPA - 30 LPA Work Type: WFO (5 Days) Who are we looking for : An...

About The Role Grade Level (for internal use): 11 The Team Revenue Operations sits at the centre of our sales and booking processes, playing a pivotal role in shaping how these processes should look and function. Our team is dedicated to driving efficiency and effectiveness across all operations, ensuring seamless integration and optimization. We value collaboration, innovation, and a proactive approach to problem-solving, making decisions that impact the entire organization. Responsibilities And Impact Acquire a comprehensive understanding of Revenue Operations processes and collaborate with operations managers to identify, prioritize, and implement initiatives focused on lean methodologies...

The Company PayPal has been revolutionizing commerce globally for more than 25 years. Creating innovative experiences that make moving money, selling, and shopping simple, personalized, and secure, PayPal empowers consumers and businesses in approximately 200 markets to join and thrive in the global economy. We operate a global, two-sided network at scale that connects hundreds of millions of merchants and consumers. We help merchants and consumers connect, transact, and complete payments, whether they are online or in person. PayPal is more than a connection to third-party payment networks. We provide proprietary payment solutions accepted by merchants that enable the completion of payments...

This role is for one of Weekday's clients Min Experience: 6 years Location: Chennai JobType: full-time Requirements We are looking for a highly skilled and motivated Senior Data Engineer to join our clients team. You will play a key role in designing, implementing, and optimizing data architectures and pipelines to support scalable data solutions for our business. Qualifications: 6-9 years of experience in data engineering, with a focus on building and managing data pipelines Strong proficiency in relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra) Experience in building data pipelines with data warehouses like Snowflake, Redshift Experience in proce...

We are looking for a highly skilled and experienced Business Value Architect Director to lead our team in driving business growth through data-driven insights. The ideal candidate will have a strong background in software services and experience in architecting solutions that drive business value. Roles and Responsibility Develop and implement comprehensive business strategies aligned with organizational goals. Lead cross-functional teams to design and deliver high-quality solutions that meet business needs. Collaborate with stakeholders to identify opportunities for process improvements and cost savings. Provide technical leadership and guidance on best practices for data management and ana...

About the Role We are seeking an AI Engineer to architect and optimize our agent-based forecasting and decision systems. You'll work at the intersection of LLMs, distributed computing, and statistical forecasting to build intelligent agents that transform how enterprises plan their supply chains. This role combines hands-on development of AI agents with rigorous evaluation frameworks to ensure our systems deliver measurably superior business outcomes. Core Responsibilities Agent Development & Context Engineering Design and implement intelligent agents using Pydantic AI and similar frameworks for demand planning and decision-making Craft sophisticated system prompts and agent instructions tha...

Be the spark that brightens days and ignite your career with TTEC’s award-winning employment experience. As a Chat Customer Service Representative working on site in Ahmedabad, Gujarat (Opp. L.J. Group of Institutes, Off S.G. Highway, Makarba), you’ll be a part of bringing humanity to business. #experienceTTEC Apply in-person for immediate interview - Monday to Friday - 10:30 AM to 4:00 PM Interested in Relocating? Virtual interviews accepted as well What You’ll Be Doing Do you have a passion for helping others and giving them peace of mind? In this role, you'll work to resolve customer issues via chat services including chat, text, email, social media, direct messaging as well as other nonv...

LiveRamp is the data collaboration platform of choice for the world’s most innovative companies. A groundbreaking leader in consumer privacy, data ethics, and foundational identity, LiveRamp is setting the new standard for building a connected customer view with unmatched clarity and context while protecting precious brand and consumer trust. LiveRamp offers complete flexibility to collaborate wherever data lives to support the widest range of data collaboration use cases—within organizations, between brands, and across its premier global network of top-quality partners. Hundreds of global innovators, from iconic consumer brands and tech giants to banks, retailers, and healthcare leaders tur...

Description Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...

About Amgen Amgen harnesses the best of biology and technology to fight the world’s toughest diseases, and make people’s lives easier, fuller and longer. We discover, develop, manufacture and deliver innovative medicines to help millions of patients. Amgen helped establish the biotechnology industry more than 40 years ago and remains on the cutting-edge of innovation, using technology and human genetic data to push beyond what’s known today. About The Role Role Description: We are looking for an Associate Data Engineer who can maintain complex data engineering workflows and pipelines and data solutions in 24X7 Shifts. The ideal candidate will be responsible for developing, optimizing and mai...

GCP DE Responsibilities Work closely with our data science team to help build complex algorithms that provide unique insights into our data Use agile software development processes to make iterative improvements to our back-end systems Model front-end and back-end data sources to help draw a more comprehensive picture of user flows throughout the system and to enable powerful data analysis Build data pipelines that clean, transform, and aggregate data from disparate sources Develop models that can be used to make predictions and answer questions for the overall business Required skills and qualifications 7 or more years of experience with Python, SQL, and data visualization/exploration tools...

Key Responsibilities: Bachelors/masters degree in computer science, Information Systems or equivalent. Strong knowledge of object-oriented design, .NET framework, and design patterns. Strong command of essential technologies: C#, SQL Server Expertise in building event-driven scalable & resilient systems Experience with software development lifecycle (SDLC) methodologies like Agile, Test-driven development. Experienced with developing solutions involving relational database technologies on SQL Server platform, stored procedure programming experience using Transact SQL. Experience with Authentication Methods like OATH / JWT Experience with debugging, logging, performance monitoring, data visua...

Key Responsibilities: Develop Python-based solutions using Git/Poetry for code and library management. Work with data processing libraries such as Pandas, Polars, and others. Deploy and manage data pipelines on Databricks and Azure Blob Storage. Monitor and troubleshoot pipelines, logs, and cloud resources. Required Skills & Qualifications: Proficiency in Python , including experience with Git/Poetry for code and dependency management. Expertise in data processing libraries such as Pandas, PySpark, Dataframes, Polars, or equivalent. Familiarity with Azure cloud services , Databricks , and Azure Blob Storage . Ability to read and analyze logs for debugging and performance monitoring . Strong ...

The Role We are looking for intermediate full-stack software engineers who are passionate about solving business problems through innovation and engineering practices. This role will be responsible for writing code, pairing with other developers as appropriate, decomposing acceptance criteria to understand team backlog deliverables, complexities, and risk, while working as a strong contributor on an agile team. From a technical standpoint, the Software Engineer has full-stack coding and implementation responsibilities and adheres to best practice principles, including modern cloud-based software development, agile and scrum, code quality, and tool usage. The Software Engineer works to unders...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics (D&A) – Manager – Azure Data Architect As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. The opportunity We’re looking for M...

JLL supports the Whole You, personally and professionally . Our people at JLL and JLL Technologies are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and personalized benefits to manage life in and outside of work. Whether you’ve got deep experience in commercial real estate, skilled trades, and technology, or you’re looking to apply your relevant experience to a new industry, we empower you to shape a brighter way forward so you can thrive professionally and personally. What t...