6547 Big Data Jobs - Page 37

Job description : We are seeking an experienced and driven Data Engineer with 5+ years of hands-on experience in building scalable data infrastructure and systems. You will play a key role in designing and developing robust, high-performance ETL pipelines and managing large-scale datasets to support critical business functions. This role requires deep technical expertise, strong problem-solving skills, and the ability to thrive in a fast-paced, evolving environment. Key Responsibilities : - Design, develop, and maintain scalable and reliable ETL/ELT pipelines for processing large volumes of data (terabytes and beyond). - Model and structure data for performance, scalability, and usability. -...

Job description : We are seeking an experienced and driven Data Engineer with 5+ years of hands-on experience in building scalable data infrastructure and systems. You will play a key role in designing and developing robust, high-performance ETL pipelines and managing large-scale datasets to support critical business functions. This role requires deep technical expertise, strong problem-solving skills, and the ability to thrive in a fast-paced, evolving environment. Key Responsibilities : - Design, develop, and maintain scalable and reliable ETL/ELT pipelines for processing large volumes of data (terabytes and beyond). - Model and structure data for performance, scalability, and usability. -...

This is a remote position. 1. Python & PySpark 2. Azure Cloud Services such Synapse & Data Bricks & Data Factory (Data Bricks is mandatory) 3. OOPS Concept 4. Data Modelling with scalability Assure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements Solution design using Microsoft Azure services and other tools The ability to automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.) Load transformed data into storage and reporting structures in destinations including data warehouse, high speed indexes, real-time reporting systems and analytics application...

We are seeking experienced Data Engineers to join our growing team, with positions open for both senior (9+ years) and mid-level (5\u20139 years) professionals. This role focuses on developing scalable data solutions in cloud or relational database environments and requires strong hands-on experience with large datasets and implementation projects. The ideal candidate will have a strong foundation in Data Engineering or Data Warehousing (DWH), deep SQL skills, and a proven track record of working on real-world, implementation-focused data projects (not support roles). You\u2019ll be responsible for designing, developing, and optimising end-to-end data flows, ensuring clean, secure, and high-...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

We are seeking an experienced and driven Data Engineer with 5+ years of hands-on experience in building scalable data infrastructure and systems. You will play a key role in designing and developing robust, high-performance ETL pipelines and managing large-scale datasets to support critical business functions. This role requires deep technical expertise, strong problem-solving skills, and the ability to thrive in a fast-paced, evolving environment. Key Responsibilities : - Design, develop, and maintain scalable and reliable ETL/ELT pipelines for processing large volumes of data (terabytes and beyond). - Model and structure data for performance, scalability, and usability. - Work with cloud i...

Notice Period : Immediate - 30 days Mandatory Skills : Big Data, Python, SQL, Spark/Pyspark, AWS Cloud JD and required Skills & Responsibilities : - Actively participate in all phases of the software development lifecycle, including requirements gathering, functional and technical design, development, testing, roll-out, and support. - Solve complex business problems by utilizing a disciplined development methodology. - Produce scalable, flexible, efficient, and supportable solutions using appropriate technologies. - Analyse the source and target system data. Map the transformation that meets the requirements. - Interact with the client and onsite coordinators during different phases of a pro...

Notice Period : Immediate - 30 days Mandatory Skills : Big Data, Python, SQL, Spark/Pyspark, AWS Cloud JD and required Skills & Responsibilities : - Actively participate in all phases of the software development lifecycle, including requirements gathering, functional and technical design, development, testing, roll-out, and support. - Solve complex business problems by utilizing a disciplined development methodology. - Produce scalable, flexible, efficient, and supportable solutions using appropriate technologies. - Analyse the source and target system data. Map the transformation that meets the requirements. - Interact with the client and onsite coordinators during different phases of a pro...

We are seeking an experienced and driven Data Engineer with 5+ years of hands-on experience in building scalable data infrastructure and systems. You will play a key role in designing and developing robust, high-performance ETL pipelines and managing large-scale datasets to support critical business functions. This role requires deep technical expertise, strong problem-solving skills, and the ability to thrive in a fast-paced, evolving environment. Key Responsibilities : - Design, develop, and maintain scalable and reliable ETL/ELT pipelines for processing large volumes of data (terabytes and beyond). - Model and structure data for performance, scalability, and usability. - Work with cloud i...

We are seeking an experienced and driven Data Engineer with 5+ years of hands-on experience in building scalable data infrastructure and systems. You will play a key role in designing and developing robust, high-performance ETL pipelines and managing large-scale datasets to support critical business functions. This role requires deep technical expertise, strong problem-solving skills, and the ability to thrive in a fast-paced, evolving environment. Key Responsibilities : - Design, develop, and maintain scalable and reliable ETL/ELT pipelines for processing large volumes of data (terabytes and beyond). - Model and structure data for performance, scalability, and usability. - Work with cloud i...

Job Title: Developer Experience: 4-6 Years Work Location: Chennai, TN || Bangalore, KA || Hyderabad, TS Skill Required: Digital : Bigdata and Hadoop Ecosystems Digital : PySpark Job Description: Need to work as a developer in Bigdata, Hadoop or Data Warehousing Tools and Cloud Computing ? Work on Hadoop, Hive SQL?s, Spark, Bigdata Eco System Tools.? Experience in working with teams in a complex organization involving multiple reporting lines.? The candidate should have strong functional and technical knowledge to deliver what is required and he/she should be well acquainted with Banking terminologies. ? The candidate should have strong DevOps and Agile Development Framework knowledge.? Creat...

You will be joining Capgemini Engineering, the world leader in engineering services, where a global team of engineers, scientists, and architects collaborate to support innovative companies in unleashing their potential. From autonomous cars to life-saving robots, our digital and software technology experts are known for their out-of-the-box thinking and provide unique R&D and engineering services across all industries. A career with us offers endless opportunities where you can truly make a difference, and each day brings new challenges and excitement. We are currently seeking a Trainer with 6 to 10 years of experience who will be responsible for providing training to both experienced emplo...

As a Data Engineer with expertise in Machine Learning, Spark, Scala, and Java, your responsibilities will include utilizing your Big Data experience and 3+ years of hands-on experience in Java, Python, Scala, Spark, and Machine Learning. Your role will involve data mining, data analysis, and gathering and processing raw data at scale. In this position, you will be expected to work closely with the engineering team to integrate and build algorithms. You will also be responsible for processing unstructured data into a suitable form for analysis, supporting business decisions with ad hoc analysis, and extracting data from relational databases. Additionally, you will manipulate and explore data ...

The Data Analytics Sr Lead Analyst is a strategic professional who closely follows the latest trends in the field and adapts them for application within your role and the business. You are part of a select group of individuals within the business who provide the same level of expertise. Excellent communication skills are required for negotiating internally, often at a senior level. You must possess developed communication and diplomacy skills to guide, influence, and convince others, especially colleagues in different areas and occasional external customers. You are accountable for significant direct business results or authoritative advice regarding the operations of the business, with a de...

At Solidatus, we are revolutionizing the way organizations comprehend their data. We are an award-winning, venture-backed software company often referred to as the Git for Metadata. Our platform enables businesses to extract, model, and visualize intricate data lineage flows. Through our unique lineage-first approach and active AI development, we offer organizations unparalleled clarity and robust control over their data's journey and significance. As a rapidly growing B2B SaaS business with fewer than 100 employees, your contributions play a pivotal role in shaping our product. Renowned for our innovation and collaborative culture, we invite you to join us as we expand globally and redefine...

Mandate Skills: Scala Spark Responsibility: Overall, more than 5 Yrs of experience in Big Data projects. Experience in Big Data technologies including Scala Spark Who have a good understanding of data structures and algorithms Has worked in Implementation projects building data pipelines transformation logics and data models Strong experience in SQL.

Mandate Skills: Scala Spark Responsibility: Overall, more than 5 Yrs of experience in Big Data projects. Experience in Big Data technologies including Scala Spark Who have a good understanding of data structures and algorithms Has worked in Implementation projects building data pipelines transformation logics and data models Strong experience in SQL.

Mandate Skills: Scala Spark Responsibility: Overall, more than 5 Yrs of experience in Big Data projects. Experience in Big Data technologies including Scala Spark Who have a good understanding of data structures and algorithms Has worked in Implementation projects building data pipelines transformation logics and data models Strong experience in SQL.

Mandate Skills: Scala Spark Responsibility: Overall, more than 5 Yrs of experience in Big Data projects. Experience in Big Data technologies including Scala Spark Who have a good understanding of data structures and algorithms Has worked in Implementation projects building data pipelines transformation logics and data models Strong experience in SQL.

Mandate Skills: Scala Spark Responsibility: Overall, more than 5 Yrs of experience in Big Data projects. Experience in Big Data technologies including Scala Spark Who have a good understanding of data structures and algorithms Has worked in Implementation projects building data pipelines transformation logics and data models Strong experience in SQL.

Mandate Skills: Scala Spark Responsibility: Overall, more than 5 Yrs of experience in Big Data projects. Experience in Big Data technologies including Scala Spark Who have a good understanding of data structures and algorithms Has worked in Implementation projects building data pipelines transformation logics and data models Strong experience in SQL.

Experienced in software delivery with 7+ years in Scala/Java/Python. Skilled in Big Data (Spark, Databricks, Hadoop, ADLS), cloud (Azure/AWS/GCP), CI/CD pipelines, and building scalable data lakes & pipelines for enterprise solutions hr@rmtech.co.in Health insurance Provident fund

We are seeking a Staff Software Engineer(5I) (ETL) with 8-10 years of experience to join our ETL Development team. This role will report to the Engineering Manager and the candidate will be involved in the planning, design, and implementation of our centralized data warehouse solution for data acquisition, Ingestion and large data processing and automation/optimization across all the company products. About the Role: Candidate will play a crucial role in designing, developing, and leading the implementation of ETL processes and data architecture solutions. Will collaborate with various stakeholders to ensure the seamless integration, transformation, and loading of data to support our data wa...