12278 Big Data Jobs - Page 3

Role - GCP Data Engineer Location – Pune/Hyderabad Migrate and re-engineer existing services from on-premises data centers to Cloud (GCP/AWS) Understanding the business requirements and providing real-time solutions Following the project, development tools like JIRA, Confluence and GIT Write python/shell scripts to automate operations and server management Build and maintain operations tools for monitoring, notifications, trending, and analysis. Define, create, test, and execute operations procedures. Document current and future configuration processes and policies To be successful in this role, you should meet the following requirements Data Engineer Developer with Cloud (GCP) Experts in Py...

Responsibilities: Design and implementation of ETL pipelines using Databricks, following the Medallion Architecture (Bronze Silver Gold). Work with data mapping and transformation based on the Canonical Data Model, ensuring consistency across source systems. Ensure data quality, lineage, and governance standards are followed throughout the pipeline. Mandatory Skills: Databricks / PySpark (ETL Development) Canonical Data Modeling & Medallion Architecture Data Mapping & Validation (ETL Testing Experience) Strong Communication & Stakeholder Collaboration Mandatory Competencies Cloud - Azure - Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage, Event Hubs, HDInsight Big Data - B...

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-c...

Greetings from TCS! TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul. Role- GCP bigdata Engineer Location: Bangalore Experience: 6-10 Years Required Technical skills GCP bigdata with phyton and Bigquery Responsibilities : Engineers for Cornerstone to Lumi Migration InitiativeEngineers with strong SQL knowledge Experienced resources with Big data/ Hadoop implementation Well verse with GCP BigQuery implementation Minimum Qualification: 15 years of full-time education. Minimum percentile of 50% in 10th, 12th, UG & PG (if applicable)

Who We Are Solera is a global leader in data and software services that strives to transform every touchpoint of the vehicle lifecycle into a connected digital experience. In addition, we provide products and services to protect lifes other most important assets: our homes and digital identities. Today, Solera processes over 300 million digital transactions annually for approximately 235,000 partners and customers in more than 90 countries. Our 6,500 team members foster an uncommon, innovative culture and are dedicated to successfully bringing the future to bear today through cognitive answers, insights, algorithms and automation. For more information, please visit solera.com. The Role: The ...

Role & responsibilities Strong functional programming and object oriented programming concepts Strong in Scala programming language Build Rest apis using Play framework Experienced with Akka framework (Actors, Streams) Experienced in Monad design pattern Familiar with using ZIO/Cats/Monix library Experienced in using Slick library Query using Elastic search and Data lake Good knowledge on Mysql/Oracle Good knowledge on Apache kafka, Event driven architecture Understanding about micro services architecture Basic knowledge on Unix Translate complex functional and technical requirements into detailed design. Maintain security and data privacy.

POSITION OVERVIEW : Technical Analyst POSITION GENERAL DUTIES AND TASKS : Informatica Technical Analyst We are seeking a highly skilled and experienced Informatica Lead to join our IT team. The ideal candidate will lead a team of ETL developers and oversee the design, development, and implementation of ETL solutions using Informatica PowerCenter and Cloud Data Integration. This role requires expertise in data integration, leadership skills, and the ability to work in a dynamic environment to deliver robust data solutions for business needs. Responsibilities: Primary Skillset - Informatica, Data Mapping, Data modelling, , Scripting language, SQL, TOAD, Oracle. S2T Mapping Documenting the busi...

Data Engineer Spark/Scala JD Job Description As a Software Development Engineer 2 you will be responsible for expanding and optimising our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an experienced data pipeline design and data wrangler who enjoys optimising data systems and building them from the ground up. The Data Engineer will lead our software developers on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams systems and products. The right candidate will ...

Job Summary Responsible for designing and programming a small module or a large component and designing a feature, set of features, or whole feature area. She/he will work independently and contribute to the immediate team and to other teams across business. She/he will Lead design discussion in a limited manner. Roles and Responsibilities In this role, you will: Identify the scope of the work, provide initial estimate and justify the estimate with facts Demonstrate the understanding of Agile software development lifecycle and able to distinguish the core inputs and outputs in each cycle Engage in technical discussions; participate in technical designs and present technical ideas through whi...

About The Role Management Level :09 - Senior Consultant Location :Gurgaon/Bangalore/Mumbai Must have skills :Python Programming, Machine Learning, Statistical Analysis, Data Science, Generative AI (GPT, DALLE, GANs), Cloud (AWS/Azure/GCP), Model Deployment, API Development, Docker/Kubernetes Good to have skills :PyTorch, TensorFlow, Large-Scale Data Processing, Cloud Integrations, NLP, Computer Vision, Security Best Practices, Performance Optimization, Open-Source Contributions Experience :Minimum 3+ years of experience in Data Science, Machine Learning, or related fields with a focus on Generative AI models (LLMs) and API development . Educational Qualification :Bachelor''s or Master??s in ...

About The Role Skill required: Delivery - Record To Report (R2R) Designation: I&F Decision Sci Practitioner Sr Analyst Qualifications: MCom/Any Graduation Years of Experience: 5 to 8 years What would you do? Accenture is a global professional services company with leading capabilities in digital, cloud and security. Combining unmatched experience and specialized skills across more than 40 industries, we offer Strategy and Consulting, Technology and Operations services, and Accenture Song?? all powered by the world??s largest network of Advanced Technology and Intelligent Operations centers. Our 699,000 people deliver on the promise of technology and human ingenuity every day, serving clients...

About The Role Skill required: Delivery - Record To Report (R2R) Designation: I&F Decision Sci Practitioner Specialist Qualifications: MCom/Any Graduation Years of Experience: 7 to 11 years What would you do? Accenture is a global professional services company with leading capabilities in digital, cloud and security. Combining unmatched experience and specialized skills across more than 40 industries, we offer Strategy and Consulting, Technology and Operations services, and Accenture Song?? all powered by the world??s largest network of Advanced Technology and Intelligent Operations centers. Our 699,000 people deliver on the promise of technology and human ingenuity every day, serving client...

Roles and Responsibilities : Design and implement scalable big data solutions using Azure Data Factory, PySpark, and other relevant technologies. Collaborate with cross-functional teams to gather requirements and develop data warehousing strategies. Develop high-level architecture designs for large-scale data processing pipelines and ensure seamless integration with existing systems. Provide technical guidance on solution architecting best practices to junior team members. Job Requirements : 12-16 years of experience in IT Services & Consulting industry as a Solution Architect or similar role. Strong expertise in big data technologies such as Azure Data Factory, PySpark, and related tools li...

About The Role Project Role : Custom Software Engineer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : .Net Full Stack Development Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innovation, efficiency, and business transformation.Roles & Responsibilities:Lead AI-driven solution design and delivery by applying GenAI and Agentic AI to addres...

About The Role Project Role : Data Modeler Project Role Description : Work with key business representatives, data owners, end users, application designers and data architects to model current and new data. Must have skills : Data Modeling Techniques and Methodologies Good to have skills : NA Minimum 12 year(s) of experience is required Educational Qualification : 15 years full time education summary::About the RoleWe are looking for a Data Engineer ?? Data Modeler with strong expertise in dimensional modeling to design, implement, and maintain enterprise-scale data models that support reporting, analytics, and business intelligence initiatives.The candidate will work closely with data archi...

About the Role: We are looking for a highly experienced and proactive Senior Data Engineer to join our growing team. This role involves working closely with client teams, especially ML engineers and product owners, to architect, optimize, and operationalize cutting-edge data and AI solutions. Key Responsibilities: Provide technical leadership and guidance to clients across the data landscape. Optimize and scale data pipelines, especially using Apache Spark. Collaborate with client ML engineers to define and implement MLOps and LLMOps processes. Support the productionization of Generative AI workflows; prior experience preferred or at least strong foundational knowledge. Work on Databricks fo...

About The Role Project Role : Custom Software Engineer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Java Enterprise Edition Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innovation, efficiency, and business transformation.Roles & Responsibilities:Lead AI-driven solution design and delivery by applying GenAI and Agentic AI to address ...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Data Engineering Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your day will involve collabor...

Role: Data Engineer (Scala) Key responsibilities (please specify if the position is an individual one or part of a team): 1) Should be able to design strategies and programs to collect, store, analyse and visualize data from various sources. 2) Should be able to develop big data solution recommendations and ensure implementation of the chosen big data solution. 3) Needs to be able to program, preferably in different programming/scripting languages such as Scala, Python, Java, Pig or SQL. 4) Proficient knowledge in Big data frameworks Spark, Map Reduce, 5) Should have an understanding of Hadoop, Hive, HBase, MongoDB and/or MapReduce. 6) Should also have experience with one of the large cloud-...

About The Role Project Role : Custom Software Engineer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : .Net Full Stack Development Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innovation, efficiency, and business transformation.Roles & Responsibilities:Lead AI-driven solution design and delivery by applying GenAI and Agentic AI to addres...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Engineering Good to have skills : Python (Programming Language), AWS Redshift, Snowflake Data Warehouse Minimum 15 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day ...

About The Role Project Role : Custom Software Engineer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : .NET Architecture Good to have skills : NA Minimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innovation, efficiency, and business transformation.Roles & Responsibilities:Lead AI-driven solution design and delivery by applying GenAI and Agentic AI to address complex...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Analytics Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and imp...

About The Role Project Role : Custom Software Engineer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : .Net Full Stack Development Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innovation, efficiency, and business transformation.Roles & Responsibilities:Lead AI-driven solution design and delivery by applying GenAI and Agentic AI to addres...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Python (Programming Language) Good to have skills : Java, AWS Administration Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Key Responsibilities :?¢Design, build, and manage robust and scalable data pipelines (batch and real-time).?¢Develop ETL processes to acquire, transform, and integrate data from multiple so...