9690 Big Data Jobs - Page 3

About this role: Wells Fargo is seeking a Senior Software Engineer In this role, you will: Lead moderately complex initiatives and deliverables within technical domain environments Contribute to large scale planning of strategies Design, code, test, debug, and document for projects and programs associated with technology domain, including upgrades and deployments Review moderately complex technical challenges that require an in-depth evaluation of technologies and procedures Resolve moderately complex issues and lead a team to meet existing client needs or potential new clients needs while leveraging solid understanding of the function, policies, procedures, or compliance requirements Collab...

About this role: Wells Fargo is seeking a Senior Systems Operations Engineer In this role, you will: Lead or participate in managing all installed systems and infrastructure within the Systems Operations functional area Contribute in increasing system efficiencies and lowering the human intervention time on related tasks Review and analyze moderately complex operational support systems, application software, and system management tools to ensure the highest levels of systems and infrastructure availability Work with vendors and other technical personnel for problem resolution Lead team to meet technical deliverables while leveraging solid understanding of technical process controls or standa...

An ideal individual is someone who has deep data engineering skills around ETL, data modeling, database architecture and big data solutions. This individual should have strong business judgement, excellent written and verbal communication skills. 1. Develop data products, infrastructure and data pipelines leveraging AWS services (such as Redshift, Kinesis, EMR, Lambda etc.) and internal BDT tools (Datanet, Cradle, QuickSight etc. 2. Improve existing solutions/build solutions to improve scale, quality, IMR efficiency, data availability, consistency & compliance. 3. Partner with Software Developers, Business Intelligence Engineers, MLEs, Scientists, and Product Managers to develop scalable and...

Analyze existing Hadoop, Pig, and Spark scripts from Dataproc and refactor them into Databricks-native PySpark. Implement data ingestion and transformation pipelines using Delta Lake best practices. Apply conversion rules and templates for automated code migration and testing. Conduct data validation between legacy and migrated environments (schema, count, and data-level checks). Collaborate on developing AI-driven tools for code conversion, dependency extraction, and error remediation. Ensure best practices for code versioning, error handling, and performance optimization. Participate in UAT, troubleshooting, and post-migration validation activities. Technical Skills Core: Python, PySpark, ...

Executes standard software solutions, design, development, and technical troubleshooting Applies knowledge of tools within the Software Development Life Cycle toolchain to improve the value realized by automation Gathers, analyzes, and draws conclusions from large, diverse data sets to identify problems and contribute to decision-making in service of secure, stable application development Learns and applies system processes, methodologies, and skills for the development of secure, stable code and systems Contributes to team drive for continual improvement of development process and innovative solutions to meet business needs Applies appropriate dedication to support the business goals throug...

Experience At least 5 years of experience in AWS based projects. Technical skills Proficiency in Python and PySpark for data engineering tasks. Big Data Strong knowledge of Big Data technologies and data warehousing concepts. AWS services Experience with AWS Data Engineering stack, including S3, RDS, Athena, Glue, Lambda, and Step Functions. SQL Strong SQL skills for data manipulation and querying. CI CD Experience with CI CD tools like Terraform and Git Actions. Soft skills Good communication skills and ability to work in a multicultural team.

About the Role We are seeking an experienced Big Data & Azure Engineer to join our data platform team. This role is critical to supporting and optimizing our enterprise-scale data infrastructure, managing migrations from on-premises Big Data systems to Azure cloud services, and ensuring seamless 24x7 production operations. The ideal candidate will combine strong technical expertise in both traditional Big Data technologies and modern cloud platforms with excellent problem-solving abilities. Required Skills and Qualifications Technical Expertise : Strong experience in Big Data technologies (Hive, Impala). Hands-on experience with Azure services : Network, VMs, Synapse, Databricks. Proficiency...

The L6 360AO role will be critical to increase the impact and efficiency of this Capability by facilitating knowledge sharing and expertise across ICC and PepsiCo regions, executing ad-hoc projects by using all sources of information available in the program and supporting to create compelling stories. This role will be based in Hyderabad and the candidate is expected to have extensive previous Social listening tools/ creative testing tools / innovation testing tools, qualitative & quantitative consumer research project management and analysis experience. Responsibilities Functional Responsibilities: Support the PBUS 360AO Lead in the management of this program (good application of governanc...

We are looking for Director in Software Engineering to join our technology team at Clarivate. The role involves supporting and managing the delivery needs of Clarivates LSH Group Commercial Technology teams, by helping define and deliver the Continuous Improvement opportunities and best in practice software development processes. The successful candidate needs to be from a software development background with having a strong delivery focus supported by demonstrable platform scale software delivery of consumer facing applications built and delivered using cloud native principles along with AI. About You experience, education, skills, and accomplishments: Bachelor /master's degree in computer ...

The team works within the Americas App Solutions to design, deliver and support software solutions used by the Risk Management function globally. The team is responsible for several applications both internally developed and third-party products with a heavy focus on the internally developed .NET/ETL applications. There is a substantial pipeline of work, including market-wide initiatives, Security focused transformation and major cloud migrations . We are seeking an experienced ETL Developer to support and evolve our enterprise data integration workflows. The ideal candidate will have deep expertise in Informatica PowerCenter, excellent hands-on experience with Azure Data Factory and Databri...

Responsibilities: *Machine Learning or Generative AI projects * Hands on experience in deploying machine learning or deep learning models in production environment * Proficiency in one of the programming languages: Python, Java, R, C++, Scala .

As a Technical Lead - Cloud Data Platform (Azure) at Incedo, you will be responsible for managing and optimizing the Microsoft Azure environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or GCP and have experience with data warehousing technologies such as Azure Synapse Analytics. You will be responsible for configuring and optimizing the Azure environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team to e...

As a Senior Cloud Data Platform (Azure) Engineer at Incedo, you will be responsible for managing and optimizing the Microsoft Azure environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or GCP and have experience with data warehousing technologies such as Azure Synapse Analytics. You will be responsible for configuring and optimizing the Azure environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team to en...

Amex GBT is a place where colleagues find inspiration in travel as a force for good and - through their work - can make an impact on our industry. We re here to help our colleagues achieve success and offer an inclusive and collaborative culture where your voice is valued. Amex GBT seeks an innovative AI Solutions Architect at a senior level to drive transformative artificial intelligence strategies and implementations across our global enterprise. Key responsibilities will include Design and implement comprehensive AI/ML solutions. The candidate will be a member of the AI/ML and the Data Science team and will lead efforts around building solutions in the big data, data science, data quality...

As a Staff Software Engineer on the Batch data platform team, you will play a critical role in driving Uber s batch data infrastructure to the cloud. You ll be responsible for building scalable, reliable systems that automate dataset replication, orchestrate workload migrations, and ensure data integrity and performance across hybrid environments. You will collaborate with infra, platform, and product teams to migrate hundreds of PBs of data and thousands of pipelines, minimizing customer impact and ensuring strong observability and resilience during the transition. This role is central to delivering on Uber s long-term cost, performance, and scalability goals. What youll do Lead initiatives...

Position Summary... What youll do... About Team This is the team which builds reusable technologies that aid in acquiring customers, onboarding and empowering merchants besides ensuring a seamless experience for both these stakeholders. We also optimize tariffs and assortment, adhering to the Walmart philosophy - Everyday Low Cost. In addition to ushering in affordability, we also create personalized experiences for customers the omnichannel way, across all channels - in-store, on the mobile app and websites. Marketplace is the gateway to domestic and international Third-Party sellers; we enable them to manage their end-to-end onboarding, catalog management, order fulfilment, return ; refund...

Amex GBT is a place where colleagues find inspiration in travel as a force for good and - through their work - can make an impact on our industry. We re here to help our colleagues achieve success and offer an inclusive and collaborative culture where your voice is valued. Amex GBT seeks an innovative AI/ML Solutions Engineer to drive transformative artificial intelligence strategies and implementations across our global enterprise. Key responsibilities will include design and implement comprehensive AI/ML solutions. The candidate will be a member of the AI/ML and the Data Science team and will support building solutions in the big data, data science, data quality and ML space. An ideal cand...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporati...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You’ll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you’ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you’ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporatin...

As an Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: * Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, in...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data PlatformResponsibilities:Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFSExperienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platformExperience in developing streaming...

As an Associate Software Developer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big ...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporat...

As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You’ll contribute to data gathering, storage, and both batch and real-time processing.Collaborating closely with diverse teams, you’ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you’ll tackle obstacles related to database integration and untangle complex, unstructured data sets.In this role, your responsibilities may include:Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporating a...