12368 Big Data Jobs - Page 24

Position Purpose The Data Architect is to support the work for ensuring that systems are designed, upgraded, managed, de-commissioned and archived in compliance with data policy across the full data life cycle. This includes complying with the data strategy and undertaking the design of data models and supporting the management of metadata. The Data Architect mission will integrate a focus on GDPR law, with the contribution to the privacy impact assessment and Record of Process & Activities relating to personal Data. The scope is CIB EMEA and CIB ASIA Responsibilities Direct Responsibilities Engage with key business stakeholders to assist with establishing fundamental data governance process...

Job Summary: We are seeking a meticulous and technically skilled Data QA Engineer to ensure the accuracy, reliability, and performance of our data platforms and pipelines. The ideal candidate will have strong expertise in SQL, data profiling, ETL testing, and data quality validation, and will work closely with data engineers, analysts, and business stakeholders in an Agile environment. Key Responsibilities: Develop, document, and execute comprehensive test plans, test cases, and test strategies for complex data solutions. Ensure quality is embedded throughout the data lifecycle, from source to target. Work within an Agile/Scrum framework and actively participate in sprint planning, stand-ups...

OVERVIEW OF THE ROLE We are looking for a Lead Data Engineer to join the Data and Platforms team within Flutter Functions Global Platforms department. Youll be working within a squad dedicated to our Global Sportsbook and Trading business vertical. GSTs mission is to empower our brands to shape the future of sports betting. Youll be provided to work on a greenfield data platform based on AWS and Databricks with datasets that range from the global Bet Stream processes 4B bets yearly through to our odd pricing services which can generate hundreds of thousands updates for a single sporting event. We are building a unique operating model where we are lead by our Data as a Product mindset. This r...

Role Description: The role is responsible for designing, building, maintaining, analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large datasets, developing reports, supporting and executing data governance initiatives and visualizing data to ensure data is accessible, reliable, and efficiently managed. The ideal candidate has strong technical skills, experience with big data technologies, and a deep understanding of data architecture and ETL processes Roles & Responsibilities: Hands on work, building and maintaining Anaplan models to support pricing, rebate, and provider contracting workflows Integrate Anaplan mode...

Job Details: Skill: Data Engineer Experience: 5+ Years Location: - PUNE Notice Period: Immediate Joiners Employee type : Full time Job Description: 5+ years of relevant experience in the field of Data Engineering Advance skills in big data technologies like Hadoop, Python, Spark, SQL. Must have experience building data APIs. Bachelors in Computer Science or related disciplines Knowledge of Data Structures and Algorithm. Strong Python programming skills with ability to implement OOPs and functional programming. Knowledge of Scala/Java would be plus. Strong knowledge on RDBMS and NoSQL databases with the ability to implement them from scratch. Knowledge of Graph databases will be a plus. Stron...

Architecting and designing analytics platform solution for clients Identifying data sources and defining data pipeline, segmentation, and performance engineering for scale Managing team of Data Analyst/ Data Engineers assigning work and reviewing quality of deliverables. Experience in building business reports and dashboards with latest data warehousing and BI tools such as Snowflake/ Cognos/ Tableau/Superset/PowerBI Strong understanding of data modeling, data warehousing concepts and various analytical data models Familiarity with business domains such as healthcare Migration experience highly preferred Azure Cloud experience highly preferred Perform research with new technologies and third...

Skill: Hadoop-hive, Pyspark, SQL and Unix 4.5 to 5.5 years experience as Data Engineering side using Big Data, Postgres, Spark skillsAbility to work as an independent developer Good in understand the tables structures and ability to write Complex SQL queries Good understanding on the DHW concepts and Basic knowledge on Unix/Shellscript Good in Written and communication skills Design end-to-end Data pipeline and optimize Data ingestion Pipelines and manage data flow to the upstream for consumption

Objective: Build and maintain data pipelines and infrastructure to support data storage and processing. Key Responsibilities : - Design, develop, and optimize data pipelines using Azure Databricks. - Ensure data reliability, scalability, and quality. - Integrate data sources into a unified platform. - Monitor and troubleshoot data workflows. Skills Required : - Expertise in Azure Databricks, Spark, and big data tools. - Strong programming skills (e.g., Python, Scala, SQL). - Knowledge of ETL processes and cloud technologies. - Familiarity with CI/CD practices for data pipelines. - -Developer / Software Engineer - Four to Six Years,Azure Databricks - Four to Six Years-PSP Defined SCU in Data ...

Job Summary: Supports, develops, and maintains a data and analytics platform to effectively and efficiently process, store, and make data available to analysts and other consumers. Works with Business and IT teams to understand requirements and best leverage technologies for agile data delivery at scale. Though the role category is listed as Remote, this position is designated as Hybrid. Key Responsibilities: Product & Business Alignment Collaborate with the Product Owner to align data solutions with business objectives and product vision. Data Pipeline Development Design, develop, and implement efficient data pipelines for ingesting, transforming, and transporting data into Cummins Digital ...

AWS Redshift, Aurora, AWS Glue, AWS Lambda, etc. Extensive experience with Data gathering and ingestion (from multiple sources), and manipulation, orchestration and optimization on AWS Cloud Spark / Python Developing RESTful APIs Skilled in using ETL tools Proven track record of leading multi-shore teams on sizable Cloud + Data initiatives Working in an Agile Environment Excellent communication, presentation and client interaction skills Ability to work in a very dynamic environment with multiple onshore stakeholders Mandatory Competencies ETL - ETL - AWS Glue Agile - Agile - Extreme Programming Cloud - AWS - AWS Lambda,AWS EventBridge, AWS Fargate Cloud - AWS - Tensorflow on AWS, AWS Glue, ...

Job Summary We are looking for a skilled Senior Data Engineer with 24 years of experience to join our team. The role is hands-on and focuses on building, optimizing, and supporting scalable big data solutions using modern data engineering technologies and cloud platforms. You will work closely with cross-functional teams in an Agile environment to deliver high-quality data solutions. Key Responsibilities - Design, develop, implement, and support scalable and high-performance data engineering solutions - Write, test, and optimize production-grade code - Work closely with Tech Leads, product owners, architects, and analysts - Build and maintain real-time and batch data pipelines - Troubleshoot...

We are looking for engineers who enjoy both hands-on technical work and designing thoughtful, scalable services for Wallet and Apple Pay Our team s vision is to be the engine of intelligent transformation, leveraging a unified, reliable data platform to build and deploy innovative and solutions that drive significant business impact and enable data-driven decision-making throughout the organization We are seeking pragmatic AI Big Data Engineers to join our dynamic team to build and optimize data and analytics solutions as we'll as perform ML enablement and participate in generative AI initiatives to craft the future of Wallet and Apple Pay You will collaborate with cross-functional teams acr...

Role Overview : We are looking for an Adobe Experience Platform (AEP) Solution/Data Architect with strong expertise in Real-Time CDP and hands-on experience designing end-to-end customer experience ecosystems The candidate will be responsible for solution architecture, data modelling, identity strategy, ingestion patterns, and integration with activation platforms such as Adobe Journey Optimizer (AJO) and Customer Journey Analytics (CJA) The role involves partnering with business, marketing, and engineering teams to define scalable AEP-driven personalization and audience activation strategies Key ResponsibilitiesAct as the primary architect for AEP solution design, ensuring scalable, secure,...

Interested candidates, please share your updated profile at: Mishra.Neha@net2source.co.in Were Hiring | Engineer (Big Data) | Pune, MH We are hiring an Engineer (Big Data) for an exciting opportunity with one of our reputed clients. If you have strong experience in Apache Spark and modern data engineering platforms, this role could be a great fit for you. Job Title: Engineer Work Location: Pune, Maharashtra Experience Required: 4+ relevant years Required Skills Microsoft Azure Agile Way of Working Google Data Engineering Databricks About the Role Design, develop, and optimize large-scale data processing pipelines Strong hands-on experience with Apache Spark Proficiency in Scala is preferred ...

SUMMARY Wissen Technology is Hiring for Quantexa Developer About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia . Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting - edg...

We are seeking a highly motivated and skilled Associate Software Engineer to join our AI Platform team . This role is ideal for someone passionate about building scalable, reliable, and high-performance AI infrastructure and services. You will work closely with machine learning engineers, data scientists, and platform architects to design and implement core components of our AI/ML platform, enabling seamless development, deployment, and monitoring of AI models across the enterprise. You will contribute to the development of reusable platform components, automation of ML workflows, and integration of AI capabilities into production systems. This is a hands-on engineering role requiring strong...

SUMMARY OVERVIEW OF THE ROLE: Our Data Science and AI Competence Center is looking for a motivated and versatile expert, who will work on developing and deploying AI & machine learning solutions for our business. As a Sr. Data Scientist (ML and AI), you will collaborate with an industry-leading team and enhance your skills in delivering groundbreaking solutions to continue driving innovation. This role follows a hybrid approach to working, allowing you to combine working from home with working in our modern office in Hyderabad, India. WHAT YOU WILL DO: Across areas such as Sports Betting, Gaming, and other products, you will have the opportunity to develop advanced ML Engineering solutions t...

The Associate Principal will lead the client engagements at a cross-office level encompassing the areas of digital transformation, analytics, business intelligence, information management, reporting and mobility; provide thought leadership in developing the firm’s services and offerings in Health Payers and Providers space and add leverage to the overall leadership span for the group in India. The person in this role will be responsible for growing the capabilities in the Business Technology group by developing and managing the existing client relationships and generating new business engagements. This person will need to fully understand the company and its service lines and actively assess...

The Associate Principal will lead the client engagements at a cross-office level encompassing the areas of digital transformation, analytics, business intelligence, information management, reporting and mobility; provide thought leadership in developing the firm’s services and offerings in Health Payers and Providers space and add leverage to the overall leadership span for the group in India. The person in this role will be responsible for growing the capabilities in the Business Technology group by developing and managing the existing client relationships and generating new business engagements. This person will need to fully understand the company and its service lines and actively assess...

Must Have: ? SQL: Ability to read, write, test, and maintain complex SQL queries ? BigQuery: Working knowledge, including aspects like internal vs external tables, partitioning, clustering, etc. ? Python: Hands-on expertise in writing Python application code ? Big Data Engineering: Experience in Big Data Engineering projects Good to Have (Added Advantage) ? Knowledge/experience with DBT and Alembic (availability of these skills will be a big push) Experience Requirement: ? Mid-level engineer with 3 to 5 years of experience

We seek a skilled Data Engineer to build and optimize our data infrastructure. As a key contributor, you will collaborate closely with cross-functional teams to design and implement robust data pipelines that efficiently extract, transform, and load data into our AWS-based data lake and data warehouse. Your expertise will be instrumental in empowering data-driven decision making through advanced analytics and predictive modeling. Roles & Responsibilities: Building and optimizing data pipelines, data warehouses, and data lakes on the AWS and Databricks platforms. Managing and maintaining the AWS and Databricks environments. Ensuring data integrity, accuracy, and consistency through rigorous q...

Role: Head of Data Platform Location: Fully Remote (NCR) Experience: 12+ Years Role Overview We are seeking an experienced and visionary Head of Data Platform to lead the design, development, and evolution of our enterprise-scale data platform. This role requires a strong hands-on technical background combined with proven leadership experience to drive data strategy, scalability, security, and business alignment. Key Responsibilities Define and own the data platform vision, roadmap, and technical strategy aligned with business objectives Lead, mentor, and scale high-performing data and backend engineering teams Architect and review high-level (HLD) and low-level designs (LLD) for scalable, r...

Role & responsibilities Strong experience in Big Data Testing and ETL/Data Warehouse Testing . Hands-on experience with Hadoop ecosystem tools such as HDFS, Hive, Spark, Kafka, Sqoop, or NiFi. Strong proficiency in SQL , HiveQL , or Spark SQL for validating large datasets. Good understanding of ETL concepts , data pipelines, and data transformation logic. Knowledge of distributed computing concepts and large-scale data processing. Experience with relational databases (Oracle, SQL Server, MySQL) for data source validation. Ability to create and execute detailed test plans , test cases , and test data . Strong analytical, debugging, and problem-solving skills. Good communication and collaborat...

Role & responsibilities Analyze, organize and process raw data using Bigdata technologies and Scala Perform data validation, cleaning and transformation using big data technologies, Spark and Scala Ingest and manage data in HDFS/Hive and analyse data using Spark and produce meaningful insights for the business team. 6+ years of high-tech industry and/or IT work experience in Data project hands on development and solution engineering roles. Experience with Spark Development. Hands on experience in any programming language like Scala. Have worked on debugging & performance tuning of data/spark application. Experience in architect and design platforms to run at scale in the cloud leveraging. De...

Python Data Engineer Job Highlights Experience: 3 8 Years CTC: Open (Up to 40 LPA) Location: Pune / Remote Employment Type: Full-Time Job Description We are seeking a Python-centric Data Engineer to design, build, and maintain scalable, high-performance data pipelines for large and complex datasets. This role focuses heavily on object-oriented Python development and distributed data processing, with secondary exposure to cloud platforms (AWS preferred). Roles & Responsibilities Design, develop, and optimize data ingestion and transformation pipelines using Python Apply object-oriented design principles to create modular, reusable, and maintainable data components Work with distributed data p...