12368 Big Data Jobs - Page 9

We are hiring a Cloud Data Engineer to design, build, and maintain data solutions in cloud environments, supporting large-scale analytics, AI/ML, and business intelligence workloads. Key Responsibilities: Build data pipelines and workflows for ingestion, transformation, and storage. Implement and manage data lake and warehouse solutions. Work with structured and unstructured data using distributed processing tools. Optimize data performance, reliability, and governance in the cloud. Support data scientists, analysts, and stakeholders with accessible datasets. Required Skills & Qualifications: Experience with cloud data tools (AWS Redshift, Azure Synapse, GCP BigQuery). Strong knowledge of ET...

We are looking for a skilled Senior Data Engineer with 5 to 10 years of experience to join our team in Gurugram. The ideal candidate will have expertise in building Data Lakes, Data Warehouses using Big data & cloud stack, and data modeling. Roles and Responsibility Design and develop scalable data pipelines and architectures. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems and databases. Ensure data quality and integrity through data validation and testing procedures. Implement Agile development methodologies to ensure timely delivery of projects. Optimize data storage and retrieval processes for improved...

Job Purpose Creates the data structures from various sources including the data infrastructure or defines new ways of capturing data to be used for analysis and runs advanced analytics models to generate insights, in accordance with TechnipFMC standards, procedures, processes, schedules, and budget, with a continuous concern for quality, targets, and customer satisfaction. Proposes and drives tactical actions. Job Description Coaches the Data Analyst Team. Participates in the selection of data analytics technology with the Technical Teams. Develops organisational policies, standards, and guidelines around data analysis. Plans and co-ordinates the backlog with the Data Stakeholders. Plans and...

The Role and Responsibilities We have open positions ranging from Data Scientist to Director, providing talented and motivated professionals with excellent career and growth opportunities. We seek individuals with relevant prior experience in quantitatively intense areas to join our team. Youll be working with varied and diverse teams to deliver unique and unprecedented solutions across all industries. In the data scientist track, you will be primarily responsible for managing and delivering analytics projects and helping teams design analytics solutions and models that consistently drive scalable high-quality solutions. Your responsibilities will include Working alongside Oliver Wyman consu...

Your future duties and responsibilities: Lead data bricks developer with 7-9 years of experience We are seeking a skilled Azure Databricks Developer to design, develop, and optimize big data pipelines using Databricks on Azure The ideal candidate will have strong expertise in PySpark, Azure Data Lake, and data engineering best practices in a cloud environment Key Responsibilities : Design and implement ETL/ELT pipelines using Azure Databricks and PySpark Work with structured and unstructured data from diverse sources (e.g, ADLS Gen2, SQL DBs, APIs) Optimize Spark jobs for performance and cost-efficiency Collaborate with data analysts, architects, and business stakeholders to understand data ...

Role & responsibilities strong development experience in Snowflake, Cloud (AWS, GCP), SCALA, Python, Spark, Big Data and SQL. • Work closely with stakeholders, including product managers and designers, to align technical solutions with business goals. • Maintain code quality through reviews and make architectural decisions that impact scalability and performance. • Performs Root cause Analysis for any critical defects and address technical challenges, optimize workflows, and resolve issues efficiently. • Expert in Agile, Waterfall Program/Project Implementation. • Manages strategic and tactical relationships with program stakeholders. • Successfully executing projects within strict deadlines...

Job Summary: CGI is looking for a Lead Big Data Developer who will design, build, and optimize large-scale data pipelines and processing systems. The ideal candidate is a hands-on technologist with deep expertise in Python, PySpark, and SQL, capable of leading data initiatives, mentoring team members, and ensuring delivery of high-performance data solutions across the organization. Your future duties and responsibilities: Lead the design and development of scalable, efficient, and reliable data pipelines using PySpark, Python, and SQL Collaborate with data architects, analysts, and business stakeholders to understand data requirements and translate them into technical solutions Optimize data...

Position Description: Technologies Used: Odoo Platform v15+ Based Development Experience with Odoo development and customization Odoo User base (Logged-in users) - 1000 Users Odoo on Kubernetes (Microservices Based Architecture) with DevOps understanding Knowledge of Odoo modules, architecture, and APIs Ability to integrate Odoo with other systems and data sources Capable of creating custom modules Scale Odoo deployments for a large number of users and transactions Programming Languages: Proficiency in Python is essential Experience with other programming languages (e.g, Java, Scala) is a plus Data Analysis and Reporting: Ability to analyse and interpret complex data sets. Your future duties...

Job description We are seeking a highly skilled and motivated Big Data Engineer to join our data engineering team. The ideal candidate will have hands-on experience with Hadoop ecosystem, Apache Spark, and programming expertise in Python (PySpark), Scala, and Java. You will be responsible for designing, developing, and optimizing scalable data pipelines and big data solutions to support analytics and business intelligence initiatives. Qualification We are seeking a highly skilled and motivated Big Data Engineer to join our data engineering team The ideal candidate will have hands-on experience with Hadoop ecosystem, Apache Spark, and programming expertise in Python (PySpark), Scala, and Java...

Job description Position Summary The ETL Tester is responsible for validating and verifying data extraction transformation and loading processes to ensure data accuracy and integrity This role involves designing and executing test cases identifying data quality issues and collaborating with data engineers to resolve discrepancies The ETL Tester will also develop automated testing frameworks to enhance testing efficiency and coverage A strong understanding of ETL processes and data warehousing concepts is essential for success in this role Minimum Qualification At least 6 years of IT experience with minimum 4 years of experience in below skills Work experience in ETL testing Proficiency in SQ...

Job description Design and execute test plans for ETL processes, ensuring data accuracy, completeness, and integrity. Develop automated test scripts using Python or R for data validation and reconciliation. Perform source-to-target data verification, transformation logic testing, and regression testing. Collaborate with data engineers and analysts to understand business requirements and data flows. Identify data anomalies and work with development teams to resolve issues. Maintain test documentation, including test cases, test results, and defect logs. Participate in performance testing and optimization of data pipelines. Required Skills & Qualifications: Strong experience in ETL testing acr...

Role Overview: As a highly skilled Senior Vice President (SVP) in the Applications Development Group, your role is crucial in leading and overseeing the design, development, and implementation of scalable and robust technology solutions. You will provide hands-on technical expertise in Java, Python, and Database management to guide teams and ensure high-quality deliverables. Your deep understanding of modern technologies will drive innovation and technical excellence across the organization. Collaboration with cross-functional teams to define technical strategies aligned with business objectives is key, as well as mentoring and guiding technical teams to foster a culture of innovation and co...

Job Description: You will play a crucial role in evangelizing and demonstrating the value and impact of analytics for informed business decision making. Your responsibilities will include developing and deploying analytical solutions, as well as providing data-driven insights to business stakeholders to understand and solve various lending business nuances. Key Responsibilities: - Utilize your 2-5 years of experience in the analytics domain, specifically in analytics consulting and/or BFSI industry - Hold a Bachelors or Masters degree in statistics, economics, engineering, math, or relevant quantitative discipline with a strong academic performance - Demonstrate strong expertise in machine l...

Job Description: As the Head of GPS Data Platform at HSBC, you will have the opportunity to work closely with key Engineering leadership to develop and implement the roadmap for data platforms. Your responsibilities will include ensuring the upkeep and availability of systems to meet operational requirements with a strong focus on Risk and Control governance. You will also be accountable for finances, application design, development, testing, production implementation, and support/maintenance. Your role will involve providing thought leadership on DevOps and Agile development methodologies, innovation, and transformation, as well as managing cross-skilling and up-skilling initiatives within ...

As a Data Engineer, you will work with multiple teams to deliver solutions on the Azure Cloud using core cloud data warehouse tools (Azure Data Factory, Azure Databricks, Azure SQL DW and other Big Data related technologies). You will be responsible for developing the next generation of application data platforms and/or enhancing recent implementations. Your role will involve analyzing data, developing strategies for populating data lakes, and coding complex solutions using U-SQL, Scala or Python, and T-SQL. Responsibilities: - Work as part of a team to develop Cloud Data and Analytics solutions - Participate in development of cloud data warehouses, data as a service, and business intelligen...

As a senior member of the Engineering team in Pune, your role will involve leveraging advanced data technologies to drive business outcomes in the media and advertising sector. Your primary focus will be on scalability and performance optimization, collaborating across teams to implement comprehensive data strategies and ensure robust, secure data management. - Design and implement an overall data strategy based on business requirements, including data model designs, database development standards, and management of data warehouses and analytics systems. - Identify internal and external data sources and define a plan for data management in alignment with the business data strategy. - Collabo...

Position- Staff Software Engineer (Big Data, GenAI): Experience - 8 Years+ Location- Remote Shift Time- 1PM -10 PM IST Notice Period - (Immediate Joiners are required) Employment Type- FTE Are you energized by the idea of innovating with Generative AI? Do you want to create global impact while tackling challenges at the forefront of Artificial Intelligence? Do you dream of building ground-breaking products that define the future of AI-driven network management? Then come, advance with us . This is a greenfield opportunity to shape next-gen networking experiences at the cutting edge of Generative AI, Machine Learning, Big Data, and Cloud Computing. Youll help define every aspect of the user j...

Position- Senior Software Engineer (Generative AI) Experience - 8 Years+ Location- Remote Shift Time- 1PM -10 PM IST Notice Period - (Immediate Joiners are required) Employment Type- FTE Job Responsibilities : Serve as a thought leader and forward thinkerdriving innovative vision across products and platforms, designing and launching strategic ML solutions, and delivering business-wide innovation Lead the full software development lifecycle (design, testing, deployment, and operations), guide technical discussions and strategy, and actively participate in design reviews, code reviews, and implementation Develop high-performance, production-ready ML code for next-generation real-time ML platf...

As a Big Data Engineer focusing on the Hadoop ecosystem in an IT services and enterprise data engineering sector, your primary role will involve designing, deploying, and maintaining Hadoop ecosystem clusters (HDFS, YARN) to ensure stability, scalability, and security for production workloads. You will be responsible for developing and optimizing batch ETL pipelines using tools like Spark, Hive, and Sqoop to ingest, transform, and store large datasets. Additionally, building and operating streaming data pipelines using Kafka to ensure low-latency delivery and fault tolerance will be a key part of your responsibilities. Performance tuning, capacity planning, and cluster troubleshooting will a...

You should have experience in giving training on Tableau, Excel, SQL, Python, R Programming, and Statistics. It is important to have good knowledge of Data Analysis concepts, Machine Learning, Big Data, and Business Intelligence Tools. Additionally, you should have rich experience in providing classroom training. **Key Responsibilities:** - Provide training on Tableau, Excel, SQL, Python, R Programming, and Statistics - Ensure a good understanding of Data Analysis concepts, Machine Learning, Big Data, and Business Intelligence Tools - Conduct classroom training sessions effectively **Qualifications Required:** - Minimum 5 years of experience in software training (Preferred) You should have e...

Infosys Hirings for PYSPARK Developer Experience: 5-10 years Mandatory Skills: Pyspark, Spark, Python Education: B.Tech/BE/M.Tech/ME/BSC/MSC/BCA/MCA Location: PAN INDIA

Job Description Summary The Sr Data Scientist Engineer delivers end-to-end Data Science and Machine Learning solutions for industrial operations with a focus ontime-series forecasting, anomaly detection, and predictive maintenance. You will lead assigned workstreams as an individual contributor,translate business goals into technical requirements, and productionize models on cloud platforms in partnership with data/platformengineering. The emphasis is on rigorous model development, validation, and lifecycle execution to achieve measurable outcomes (reliability,availability, efficiency, emissions, cost). Candidates should have a minimum of 4 years experience in operations within at least one ...

We are seeking a highly experienced Azure Data Engineer with expertise in Microsoft Azure data services and extensive experience in designing, implementing, and optimizing enterprise-grade data solutions. The ideal candidate will lead data architecture initiatives, ensure high performance, reliability, and security Key Responsibilities: Architect, develop, and optimize scalable, high-performance data solutions using Azure Data Services. Lead the design and implementation of Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, Azure Databricks, Azure SQL Database, and Cosmos DB. Optimize and manage Azure databases including Cosmos DB, SQL Managed Instance, PostgreSQL, MySQL, ensuring...

Position Description: Azure data bricks developer with 3-6 years of experience We are seeking a skilled Azure Databricks Developer to design, develop, and optimize big data pipelines using Databricks on Azure. The ideal candidate will have strong expertise in PySpark, Azure Data Lake, and data engineering best practices in a cloud environment. Key Responsibilities: Design and implement ETL/ELT pipelines using Azure Databricks and PySpark Work with structured and unstructured data from diverse sources (e g , ADLS Gen2, SQL DBs, APIs) Optimize Spark jobs for performance and cost-efficiency Collaborate with data analysts, architects, and business stakeholders to understand data needs Develop re...

DBT responsibilities include designing, developing, and handling technical architecture, data pipelines, and performance scaling using tools to integrate Talend data and ensure data quality in a big data environment The candidate must be very strong in PL/SQL, including queries, procedures, and JOINs Experience in Snowflake SQL, writing SQL queries against Snowflake, and developing scripts using Unix, Python, etc , to perform Extract, Load, and Transform operations is essential It is good to have knowledge and hands-on experience with Fivetran Candidates who have worked in production support would be preferred Hands-on experience with Snowflake utilities such as SnowSQL, SnowPipe, Python, Ta...