139 Spark Jobs - Page 5

As an Applications Development Sr Programmer Analyst in the Information Management team of Services Technologies, you will be focusing on Big Data and public cloud adoption projects. Your role involves the establishment and implementation of new or revised application systems and programs in coordination with the Technology team, with the primary objective of contributing to applications systems analysis and programming activities. **Key Responsibilities:** - Conduct feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish new or revised applications systems and programs to meet specific business needs or user area...

As a Data Scientist in our team, your role will be to lead the development and implementation of advanced analytics solutions to derive actionable consumer insights from large datasets. **Key Responsibilities:** - Design and implement statistical models and machine learning algorithms to analyze consumer behavior and market trends. - Analyze large datasets to identify consumer preferences, behaviors, and market trends. - Communicate insights effectively through compelling visualizations and presentations. - Collaborate with cross-functional teams to translate insights into actionable business strategies. **Qualifications Required:** - Master's or PhD degree in a quantitative field. - 5 years...

JLL supports the Whole You, personally and professionally. Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology to our clients. We are committed to hiring the best, most talented people in our industry; and we support them through professional growth, flexibility, and personalized benefits to manage life in and outside of work. Whether you’ve got deep experience in commercial real estate, skilled trades, and technology, or you’re looking to apply your relevant experience to a new industry, we empower you to shape a brighter way forward so you can thrive professionally and personally. POSITION GOALS The Facilitie...

5–8 years of experience designing and building data pipelines using Apache Spark, Databricks or equivalent bigdata frameworks. Handson expertise with streaming and messaging systems such as Apache Kafka (publish subscribe architecture), Confluent Cloud, RabbitMQ or Azure Event Hub. Experience creating producers, consumers and topics and integrating them into downstream processing. Deep understanding of relational databases and CDC. Proficiency in SQL Server, Oracle or other RDBMSs; experience capturing change events using Debezium or native CDC tools and transforming them for downstream consumption. About Virtusa Teamwork, quality of life, professional and personal development: values that V...

As a member of the GDS Consulting team at EY, you will be a part of the NCLC team dedicated to delivering services specific to Microsoft accounts. Your role will involve working with the latest Microsoft BI technologies and collaborating with other teams within Consulting services. **Key Responsibilities:** - Manage multiple client engagements effectively. - Analyze business requirements, work with stakeholders, and develop information architecture and solution approaches. - Independently gather requirements, cleanse and load data. - Translate business requirements into technical code. - Create interactive dashboards and reports using Power BI, connecting to various data sources and implemen...

As a Bigdata Engineer with over 5 years of experience based in Hyderabad and currently working on a contract basis, you are equipped with the skills required to excel in this role. Your primary expertise lies in Spark, Scala, and Python, with a strong command over Apache Spark and Scala programming language. Your in-depth knowledge of Spark's core concepts, RDDs, DataFrames, and Spark SQL enables you to develop optimized and scalable Spark applications efficiently. Key Responsibilities: - Demonstrating proficiency in Apache Spark and Scala programming language - Utilizing your knowledge of Spark's core concepts, RDDs, DataFrames, and Spark SQL to develop optimized applications - Handling lar...

As a Data Engineer for Generative AI projects, you will be responsible for designing and developing data pipelines using a variety of technologies like Vector DB, Graph DB, Airflow, Spark, PySpark, Python, LangChain, AWS Functions, Redshift, and SSIS. Your role will involve integrating these tools efficiently to create high-performance data flows that support the data requirements of cutting-edge AI initiatives. You will collaborate with data scientists, AI researchers, and stakeholders to understand data needs and implement effective data engineering solutions. - Manage the movement, organization, and quality assessment of large datasets to build a Knowledge base for RAG systems and model t...

Job Description We are looking for an enthusiastic Junior Software Engineer to contribute to the CrossCore Platform team at Experian. Key Responsibilities - You will be #LI-hybrid based in Hyderabad and report to the Engineering Manager. - Develop high-quality software in an agile team, ensuring delivery aligned with business requirements and agile principles. - Translate business requirements into clean, scalable, low-defect code. - Collaborate with cross-functional teams to design, develop, test, and release software. - Contribute to development practices supporting continuous integration, delivery, and improvement. - Integrate DevSecOps practices into the development lifecycle, using stat...

As an Applications Development Senior Programmer Analyst at our organization, your role will involve collaborating with the Technology team to establish and implement new or updated application systems and programs. Your main goal will be to contribute to application systems analysis and programming activities. **Responsibilities:** - Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas. - Monitor and control all phases of the development process including analysis, design, const...

In the Global Assessments & People Analytics & Insights group at Citigroup, you will be solving business problems with workforce and business data. Analyzing data to facilitate evidence-based decision making will be a key responsibility. Utilizing statistical models to predict future outcomes and providing actionable insights will be integral to your role. The mission is to equip decision makers with data-driven insights through analytics to make informed decisions about individuals, teams, and organizations in order to enhance business performance. - Collaborate with cross-functional teams, including data scientists, project managers, HR partners, and business stakeholders. - Understand dat...

Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Apache Spark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform components. Your typical day will involve collaborating with Integration Architects and Data Architects ...

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Apache Hadoop Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will analyze, design, code, and test multiple components of application code across one or more clients. You will perform maintenance, enhancements, and/or development work in a dynamic environ...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Apache Spark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL proce...

We are seeking an experienced Senior Data Engineer with strong hands-on expertise in Databricks and AWS to design, develop, and optimize scalable data pipelines and modern data platforms. The ideal candidate will have deep experience with big data ecosystems, cloud-based data solutions (AWS), and ETL/ELT frameworks using Python, PySpark, and SQL. Key Responsibilities: Design, build, and maintain data pipelines and ETL workflows using Databricks (PySpark, Spark SQL) and AWS services (S3, EMR, Glue, Lambda, RDS, DynamoDB). Implement data lakehouse architectures integrating Delta Lake, Snowflake, and AWS storage layers. Develop and deploy automated and scalable data ingestion frameworks to proc...

DESCRIPTION Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...

Join the AI and Data Platforms team at Apple, where we build and manage cloud-based data platforms handling petabytes of data at scale. We are looking for a passionate and independent Software Engineer specializing in reliability engineering for data platforms, with a strong understanding of data and ML systems. If you thrive in a fast-paced environment, love crafting solutions that don't yet exist, and possess excellent communication skills to collaborate across diverse teams, we invite you to contribute to Apple’s high standards in an exciting and dynamic setting. Description As part of our team, you will be responsible for developing and operating our big data platform using open source o...

DESCRIPTION Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...

ABOUT AMGEN Amgen harnesses the best of biology and technology to fight the world’s toughest diseases, and make people’s lives easier, fuller and longer. We discover, develop, manufacture and deliver innovative medicines to help millions of patients. Amgen helped establish the biotechnology industry more than 40 years ago and remains on the cutting-edge of innovation, using technology and human genetic data to push beyond what’s known today. ABOUT THE ROLE Role Description: Let’s do this. Let’s change the world. We are looking for highly motivated expert Senior Data Engineer who can own the design & development of complex data pipelines, solutions and frameworks. The ideal candidate will be ...

JOB DESCRIPTION We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorganChase within the Corporate Risk Technology, you are an integral part of an agile E&A team that works to design, build, enhance and deliver advanced data engineering solutions and trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm’s business objectives. Job responsibilities Executes creative software soluti...

JOB DESCRIPTION We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Software Engineer III at JPMorganChase within the Corporate Risk Technology, you are an integral part of an agile E&A team that works to design, build, enhance and deliver advanced data engineering solutions and trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm’s business objectives. Job responsibilities Executes creative software solutio...

Overview Viva Learning is on a mission to empower individuals, teams, and organizations with the skills they need to thrive in the age of AI and Copilot. We are building intelligent learning agents that deliver personalized, task-based microlearning experiences embedded in the flow of work. As a Senior Data Scientist , you will play a pivotal role in shaping the intelligence layer of Viva Learning - leveraging data from Microsoft Graph, M365, and external learning platforms to drive hyper-personalized learning journeys. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower ...

Experience : 5.00 + years Salary : INR 4500000.00 / year (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Indefinite Contract(40 hrs a week/160 hrs a month) (*Note: This is a requirement for one of Uplers' client - B2B SaaS Singapore based Transportation, Logistics, Supply Chain and Storage platform) What do you need for this opportunity? Must have skills required: Spark, Generative AI models, LLM, rag, AWS, Docker, GCP, Kafka, Kubernetes, Machine Learning, Python, SQL B2B SaaS Singapore based Transportation, Logistics, Supply Chain and Storage platform is Looking for: About the role: We are loo...

hackajob is collaborating with American Express to connect them with exceptional tech professionals for this role. At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. American Express is on an exciting Big Data Clou...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Designation-AIOps Manager Job Description Architect and implement enterprise-grade AIOps solutions to automate incident detection, root cause analysis, and remediation across cloud and hybrid environments. Lead the integration of telemetry data from tools like Prometheus, Grafana, AppDynamics, Dynatrace, and Azure Monitor into centralized AIOps platforms for unified observability and intelligent event correlation. Design and maintain ML models in Python for anomal...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Designation-AIOps Manager Job Description Architect and implement enterprise-grade AIOps solutions to automate incident detection, root cause analysis, and remediation across cloud and hybrid environments. Lead the integration of telemetry data from tools like Prometheus, Grafana, AppDynamics, Dynatrace, and Azure Monitor into centralized AIOps platforms for unified observability and intelligent event correlation. Design and maintain ML models in Python for anomal...