35346 Spark Jobs - Page 40

Job Summary : We are seeking a highly skilled and mathematically grounded Machine Learning Engineer to join our AI team. The ideal candidate will have 5+ years of ML experience with a deep understanding of machine learning algorithms, statistical modeling, and optimization techniques, along with hands-on experience in building scalable ML systems using modern frameworks and tools. Key Responsibilities : - Design, develop, and deploy machine learning models for real-world applications. - Collaborate with data scientists, software engineers, and product teams to integrate ML solutions into production systems. - Understand the mathematics behind machine learning algorithms to effectively implem...

The Azure Data Bricks Engineer plays a critical role in establishing and maintaining an efficient data ecosystem within an organization. This position is integral to the development of data solutions leveraging the capabilities of Microsoft Azure Data Bricks. The engineer will work closely with data scientists and analytics teams to facilitate the transformation of raw data into actionable insights. With increasing reliance on big data technologies and cloud-based solutions, having an expert on board is vital for driving data-driven decision-making processes. The Azure Data Bricks Engineer will also be responsible for optimizing data workflows, ensuring data quality, and deploying scalable d...

Job Description: Information Designer Location: Noida; for projects across India Note: "This is a short-term contractual role with a contract duration of 11 months." About Varahe Analytics: Varahe Analytics is one of India’s premier integrated political consulting firms, specializing in building data-driven 360-degree election management. We help our clients with strategic advice and implementation, combining data-backed insights and in-depth ground intelligence into a holistic electoral campaign. We are passionate about our democracy and the politics that shape our world. We draw on some of the sharpest minds from distinguished institutions and diverse professional backgrounds to help us ac...

Job Title : Machine Learning Engineer Job Type : Full-Time Experience Level : Mid to Senior [5+ Years] Department : Data Science / AI Engineering Job Summary : We are seeking a highly skilled and mathematically grounded Machine Learning Engineer to join our AI team. The ideal candidate will have 5+ years of ML experience with a deep understanding of machine learning algorithms, statistical modeling, and optimization techniques, along with hands-on experience in building scalable ML systems using modern frameworks and tools. Key Responsibilities : - Design, develop, and deploy machine learning models for real-world applications. - Collaborate with data scientists, software engineers, and prod...

Job Title : Machine Learning Engineer Job Type : Full-Time Experience Level : Mid to Senior [5+ Years] Department : Data Science / AI Engineering Job Summary : We are seeking a highly skilled and mathematically grounded Machine Learning Engineer to join our AI team. The ideal candidate will have 5+ years of ML experience with a deep understanding of machine learning algorithms, statistical modeling, and optimization techniques, along with hands-on experience in building scalable ML systems using modern frameworks and tools. Key Responsibilities : - Design, develop, and deploy machine learning models for real-world applications. - Collaborate with data scientists, software engineers, and prod...

Job Title : Machine Learning Engineer Job Type : Full-Time Experience Level : Mid to Senior [5+ Years] Department : Data Science / AI Engineering Job Summary : We are seeking a highly skilled and mathematically grounded Machine Learning Engineer to join our AI team. The ideal candidate will have 5+ years of ML experience with a deep understanding of machine learning algorithms, statistical modeling, and optimization techniques, along with hands-on experience in building scalable ML systems using modern frameworks and tools. Key Responsibilities : - Design, develop, and deploy machine learning models for real-world applications. - Collaborate with data scientists, software engineers, and prod...

We are seeking a skilled Senior Palantir Data Software Engineer to join our team and contribute to a complex Data Transformation project within the Insurance domain. In this role, you will have the opportunity to design and implement advanced data pipelines and analytics solutions, leveraging cutting-edge Big Data and Machine Learning technologies to solve emerging challenges and support critical business decision-making. Responsibilities Design and implement robust data pipelines using Palantir Foundry to enable data-driven decision-making Optimize and maintain ETL processes utilizing Python, PySpark, and SQL to transform large-scale datasets efficiently Apply data warehousing concepts and ...

Job Description The Oracle Cloud Infrastructure (OCI) team offers a unique opportunity to design, build, and operate a comprehensive suite of large-scale, integrated cloud services within a broadly distributed, multi-tenant cloud environment. With a commitment to delivering exceptional cloud products, OCI empowers customers to tackle some of the world's most pressing challenges, providing tailored solutions that meet their evolving needs. Are you passionate about designing and building large-scale distributed monitoring and analytics solutions for the cloud? Do you thrive in environments that combine the agility and innovation of a startup with the resources and stability of a Fortune 100 co...

This role is for one of the Weekday's clients Salary range: Rs 2300000 - Rs 2500000 (ie INR 23-25 LPA) Min Experience: 5 years Location: Chennai, Trichy JobType: full-time We are seeking a Senior Data Engineer with a strong foundation in software development, distributed systems, and large-scale data processing. The ideal candidate is passionate about clean, efficient code and thrives in building reliable, scalable data pipelines that empower data-driven decision-making. Requirements Key Responsibilities Design, develop, and maintain scalable data pipelines and distributed systems using tools like Airflow, Spark, Kafka, Kinesis, and BigQuery. Apply advanced programming expertise (in Python o...

Key Responsibilities: -Design, develop, and maintain robust data pipelines using Kafka, Airflow, and Spark. -Implement data models and schemas for efficient querying. -Develop and optimize code in Scala and Java for data processing tasks. -Monitor and troubleshoot data pipeline performance, ensuring data integrity and availability. -Collaborate with cross-functional teams to ensure seamless data integration and flow across systems. -Stay up-to-date with industry trends and best practices in data engineering and big data technologies. Required Skills: -1-3 years of experience in data engineering space. -Proficiency in Kafka, Airflow, Spark, Scala, SQL, and Java. -Experience in designing and m...

Job Description The Oracle Cloud Infrastructure (OCI) team offers a unique opportunity to design, build, and operate a comprehensive suite of large-scale, integrated cloud services within a broadly distributed, multi-tenant cloud environment. With a commitment to delivering exceptional cloud products, OCI empowers customers to tackle some of the world's most pressing challenges, providing tailored solutions that meet their evolving needs. Are you passionate about designing and building large-scale distributed monitoring and analytics solutions for the cloud? Do you thrive in environments that combine the agility and innovation of a startup with the resources and stability of a Fortune 100 co...

Job Description The Oracle Cloud Infrastructure (OCI) team offers a unique opportunity to design, build, and operate a comprehensive suite of large-scale, integrated cloud services within a broadly distributed, multi-tenant cloud environment. With a commitment to delivering exceptional cloud products, OCI empowers customers to tackle some of the world's most pressing challenges, providing tailored solutions that meet their evolving needs. Are you passionate about designing and building large-scale distributed monitoring and analytics solutions for the cloud? Do you thrive in environments that combine the agility and innovation of a startup with the resources and stability of a Fortune 100 co...

The future is our choice At Atos, as the global leader in secure and decarbonized digital, our purpose is to help design the future of the information space. Together we bring the diversity of our people’s skills and backgrounds to make the right choices with our clients, for our company and for our own futures. Roles & Responsibilities Provide technical leadership and mentorship to a team of data engineers. Collaborate with stakeholders to define project requirements and deliverables. Ensure best practices in data security, governance, and compliance. Requirements 10+ years of experience in working on Azure Databricks or Apache Spark-based platforms. Proven track record of building and opti...

Job Title: Data Test Engineer Job Description We are seeking a skilled Data Quality Engineer to join our data team. The successful candidate will be instrumental in ensuring the quality, accuracy, and reliability of our data pipelines, machine learning models, and cloud-based solutions. Key Responsibilities: Test Strategy and Planning: Develop and implement comprehensive test strategies for data processing and machine learning pipelines, ensuring alignment with business requirements. Test Automation: Design, build, and maintain automated test frameworks using Python to validate Apache Spark jobs, Iceberg table operations, and complex data pipelines. Data Validation and Quality Assurance: Imp...

Our vision is to transform how the world uses information to enrich life for all . Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. Responsibilities and Tasks Understand the Business Problem and the Relevant Data Maintain and understanding of company and department strategy Translate analysis requirements into data requirements Identify and understand the data sources that are relevant to the business problem Develop conceptual models that capture relationships within the data Define the data-quality objectives for the solu...

Job Title: Data Engineer Employment Type:- Full Time, Permanent Position Location: Noida/Hyderabad Qualifications: BE/B.Tech/MCA Degree in Computer Science, Engineering, or similar relevant field Total Experience 3+ years Working Model Work from Office ABOUT THE ROLE We are seeking a skilled Data Engineer/ Senior Data Engineer to design, build, and maintain robust data infrastructure and pipelines that enable our organization to leverage data for strategic decision making. The ideal candidate will have strong technical expertise in data engineering, cloud technologies, and data architecture, with a passion for building scalable and efficient data solutions. PRIMARY RESPONSIBILITIES: • Transl...

Job Description The Oracle Cloud Infrastructure (OCI) team offers a unique opportunity to design, build, and operate a comprehensive suite of large-scale, integrated cloud services within a broadly distributed, multi-tenant cloud environment. With a commitment to delivering exceptional cloud products, OCI empowers customers to tackle some of the world's most pressing challenges, providing tailored solutions that meet their evolving needs. Are you passionate about designing and building large-scale distributed monitoring and analytics solutions for the cloud? Do you thrive in environments that combine the agility and innovation of a startup with the resources and stability of a Fortune 100 co...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Apache Spark Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are optimized for performance and usability. You will engage in problem-solving discussion...

Job Title: Key Account Manager – Online Business 7 Bazaari Department: Sales & Business Development Location: Naraina Industrial Area Ph 1, New Delhi, 110028 Reports To: Founder Salary : 8-10 LPA If interested please drop in your cv on aaditya@7bazaari.com Role Purpose Responsible for managing strategic partnerships with major e-commerce platforms (BlinkIt, Amazon, Flipkart, Zepto, etc.), driving revenue growth, ensuring product visibility, optimizing pricing and promotions, and achieving P&L targets for the e-commerce business. About 7 Bazaari 7 Bazaari is reimagining indulgence with bold, modern flavors that blend tradition and innovation. From fusion Indian sweets to artisanal chocolates ...

Position Overview Job Title: Lead AI Engineer, VP Location: Pune, India Role Description Innovation and the TDI Chief Strategy Office Deutsche Bank’s Innovation team identifies, evaluates, and incubates cutting-edge technical innovation. It is part of the Chief Strategy Office of the bank’s Technology, Data & Innovation (TDI) function and works globally with all business lines and infrastructure functions of the bank. A focus of the team is to create value for clients and the bank using Generative Artificial Intelligence like Large Language Models (LLM), AI agents and other advanced data-driven technologies. As a Lead AI Engineer in the Innovation team of the TDI Chief Strategy Office you wi...

Communication, problem-solving Responsibilities: * Collaborate with cross-functional teams on pipeline design & governance * Design, develop & maintain AWS data pipelines using GLUE, Redshift, Lambda & Python Provident fund

Who We Are Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact. To succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate...

Who We Are Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact. To succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate...

Who We Are Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact. To succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate...

Profile Description Division We’re seeking someone to join our team as Data Engineer is expected to code, conduct code reviews, and test framework as needed, along with participating in application architecture and design and other phases of the automation WM_Technology Wealth Management Technology is responsible for the design, development, delivery, and support of the technical solutions behind the products and services used by the Morgan Stanley Wealth Management Business. Practice areas include: Analytics, Intelligence, & Data Technology (AIDT), Client Platforms, Core Technology Services (CTS), Financial Advisor Platforms, Global Banking Technology (GBT), Investment Solutions Technology ...