9747 Big Data Jobs - Page 37

We are looking for a skilled Data Engineer with 7 to 10 years of experience to join our team in Bangalore, Hyderabad, Chennai, and Pune. The ideal candidate will have expertise in data engineering, Azure cloud, Snowflake, and Snowflake ELT methodologies. Roles and Responsibility Design and develop scalable data pipelines using Azure cloud and Snowflake. Implement ETL processes on Azure and manage data management tasks. Develop automation scripts using Python, Scala, or other languages. Collaborate with cross-functional teams to ensure seamless data integration. Ensure data integrity and accuracy during migration efforts. Optimize data processing workflows for improved efficiency. Job Require...

SUMMARY Job Description Key Responsibilities: Python Development: Proficient in Python, with strong knowledge of design patterns and both object-oriented and functional programming paradigms. Hands-on experience with modern IDEs such as VS Code, PyCharm, and tools like CoPilot or Cursor for efficient development and testing. Familiarity with searching and sorting algorithms, with the ability to apply them effectively in problem - solving. Experience working with multi-module and package-based project structures. Strong expertise in unit testing frameworks such as pytest and unittest, with a focus on writing robust and maintainable test cases. Proficient in managing virtual environments using...

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Data Warehouse ETL Testing Good to have skills : NA Minimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform components. Your typical day will involve collaborating with Integration A...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Microsoft Azure Databricks Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creat...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Apache Airflow, PySpark Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your typical day will involve collaborating w...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Microsoft Azure Databricks Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve cre...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Palantir Foundry, PySpark, Python (Programming Language), MySQL Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing solutions that align with business objectives, and ensuring that applications ...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Apache Airflow, PySpark Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your day will involve collaborating with team...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Snowflake Data Warehouse Good to have skills : Microsoft SQL Server, AWS Relational Database Service (RDS), Apache Airflow Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your typica...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Google BigQuery Good to have skills : NA Minimum 15 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will also engage in problem-so...

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : Engineering graduate preferably Computer Science graduate 15 years of full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platf...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Microsoft Azure Databricks Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creat...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Business Agility Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data p...

Responsibilities: Perform exploratory data analysis and various data analysis Build robust data pipeline jobs Design, implement and monitor Machine Learning models Conduct A/B testing Collaborate with cross-functional teams Required Qualifications : Proficiency in Python. Bachelors's degree in Mathematics, Statistics, or a related field. Strong proficiency in data analytics and statistical analysis Excellent problem-solving skills and ability to deliver actionable insights. Strong communication skills and ability to collaborate effectively with cross-functional teams. Preferred Qualifications: Proficiency in PySpark and SQL Master's degree in Mathematics, Statistics, or a related field. Expe...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing...

About The Role Job Title Data Science/Data Engineering ML9 - Sales Excellence COE - Data Engineering Specialist Management Level :ML9 Location:Open Must have skills: strong GCP cloud technology experience, Big query, Data Science basics. Good to have skills: Build and maintain data models from different sources. Experience: Minimum 5 year(s) of experience is required Educational Qualification: Graduate/Post graduate Job Summary : The Center of Excellence (COE) makes sure that the sales and pricing methods and offerings of Sales Excellence are effective. The COE supports salespeople through its business partners and Analytics and Sales Operations teams. The Data Engineer helps manage data sou...

As a Senior Software Engineer I, you will be responsible for leading a Scrum team that designs and delivers scalable, robust solutions in Java, Spring Boot, RESTful APIs, Spark, Scala and AWS services such as EMR. You will collaborate with Product Management, Data Management, and Architecture teams to build modern, distributed systems that handle massive data volumes. Your excellent problem-solving abilities and architectural vision will be critical to shaping our technology roadmap. You will also mentor junior engineers, instill best practices, and advocate a culture of continuous improvement. Primary Responsibilities: Own the Delivery of a Scrum Team Plan, estimate, and coordinate developm...

Experience : 5 to 10 Years Notice Period : Immediate to 60 days Mode of Interview - In-Person (Pune - 8th Nov 2025) Skillset: Azure Databricks + PySpark Developer Azure Synapse Developer Snowflake + DBT Developer AWS Data Engineer Developer AWS + Python Developer Bigdata + Pyspark Developer Google BigQuery- GCP Developer Spark Scala Developer SAS Developer Ab Initio Developer Datastage Developer Informatica IICS Developer AI/ML Gen AI MLOps Informatica MDM Reltio MDM Stibo SAP MDG Informatica Data Quality- IDQ

Job Title : GCP Data Engineer Location: Bengaluru Mode :Face 2 Face Experience Range : 5 to 10 years Date- 08 Nov 25 (Saturday) Please apply only if you can attend In Person drive at TCS Office on 08 Nov 25 (Saturday). If interested, Method to confirm: Share your updated CV with the below-required details at the earliest to Pavithra.gopal@tcs.com. After validation will share invite. Subject line as: TCS - Bengaluru - 8th Nov 2025-Confirmation to attend Walkin Name: PAN ID: Email: Skill: Contact: Total Years of exp: Current CTC: Expected CTC: Current Company: Preferred Location: Notice Period: Highest qualification which is full time: Any gaps/breaks in career/Education: If any, please mentio...

As a Reconciliation Data Analyst, * Requires 47 years in analytics or financial ops, strong SQL, Python, Tableau skills, and experience with cloud-scale data systems. * Youll lead high-volume reconciliations across internal ledgers, payment systems, and banking partners. * Youll automate workflows using Spark SQL, Python, and Big Data tools, build Tableau dashboards, and ensure data accuracy within SLAs. * You\'ll also support root cause analysis, reporting for audits, and compliance. * A key part of the role is applying ML for anomaly detection and forecasting to drive proactive financial risk management. * Youll collaborate with engineering to scale recon pipelines and integrate detection ...

About ProcDNA ProcDNA is a global consulting firm. We fuse design thinking with cutting-edge technology to create game-changing Commercial Analytics and Technology solutions for our clients. We're a passionate team of 275+ across 6 offices, all growing and learning together since our launch during the pandemic. Here, you won't be stuck in a cubicle - you'll be out in the open water, shaping the future with brilliant minds. At ProcDNA, innovation isn't just encouraged; it's ingrained in our DNA. Ready to join our epic growth journey? What we are looking for Youll be driving the adoption of the latest technologies in our solutions, bringing in thought leadership to guide clients on complex dat...

The Role: Your mission is to design, create and maintain our backend applications that power our strategic metadata platform. You possess a profound knowledge of core Java , appreciation for the value of metadata enabling governance and quality and have a preference for creating frameworks rather than utilizing existing ones. The Team The Distribution & Data Platforms development team consists of passionate individuals who thrive on innovation and collaboration. Were responsible for distributing data and metadata to clients , both internal and external . Our distribution platform is widely used within the company and serves many external clients. We value creativity, adaptability, and a comm...

data science Required Skills

As a Senior Cloud Data Platform (GCP) Engineer at Incedo, you will be responsible for managing and optimizing the Google Cloud Platform environment, ensuring its performance, scalability, and security You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments You will be skilled in cloud computing platforms such as AWS or Azure and have experience with big data technologies such as Hadoop or Spark You will be responsible for configuring and optimizing the GCP environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise You will also work with the security team to ensure that the GC...

Position: GoLang Engineer (CE812SF RM 3674) Shift timing : General Shift Education Required: Bachelor s / Masters / PhD : B.E Computers, MCA is preferable Work mode : Hybrid working for 3 days in week from client office Must have skills: Go Lang, Micro service, Kafka, Big Data, Low code No code, AWS, version control systems (Git) Good to have skills: DevOps, CI/CD pipelines for deployments Job Description Mandatory 1. Go Lang for Microservice is a must, and a pro level expertise. 2. Time Series with PostgresDB Intermediate expertise. 3. Kafka Intermediate/Basic expertise. 4. Collector Pattern and OTA Paradigm understanding Other important skills 1. Experience working with Big Data Applicatio...