9747 Big Data Jobs - Page 32

Hands on knowledge of SPARK, scala, etc. Hands on knowledge of RDBMS like MS-SQL/Oracle Knowledge of CI/CD tools like uDeploy Understanding of Vanguard and its landscape will be additional advantage

7+ years of experience in Big Data with strong expertise in Spark and Scala Mandatory Skills Big Data Primarily Spark and Scala Strong Knowledge in HDFS, Hive, Impala with knowledge on Unix , Oracle, Autosys, Good to Have Agile Methodology and Banking Expertise Strong Communication Skills Not limited to Spark batch, need Spark streaming experience No SQL DB Experience HBase/Mongo/Couchbase Core Skills PySpark, Python, SQL Machine Learning ML Libraries, Scikit-learn, PySpark Mlib, Statistical Methods, regression, classification, clustering Bigdata & Cloud Databricks, Hadoop, Hive, Spark Streaming Good to have Scala with Spark, AWS/Azure, GCP bigdata services. Data Visualization Tableau/MSTR C...

7+ years of experience in Big Data with strong expertise in Spark and Scala Mandatory Skills Big Data Primarily Spark and Scala Strong Knowledge in HDFS, Hive, Impala with knowledge on Unix , Oracle, Autosys, Good to Have Agile Methodology and Banking Expertise Strong Communication Skills Not limited to Spark batch, need Spark streaming experience No SQL DB Experience HBase/Mongo/Couchbase

Overview The role will work in developing Machine Learning (ML) and Artificial Intelligence (AI) projects. Specific scope of this role is to develop ML and GenAI solution in support of ML/AI projects using big analytics toolsets in a CI/CD environment. Analytics toolsets may include DS tools/Spark/Databricks along with LLM frameworks like LangChain / LlamaIndex, and other technologies offered by Microsoft Azure or open-source toolsets. This role will also help automate the end-to-end cycle with Azure Machine Learning Services and Pipelines. Responsibilities Understand the existing Proof of concepts that were built to showcase capability of LLMs to deliver the accurate response to any natural...

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to design, build and deploy highly secure and performant data engineering solutions You will analyze the requirements and specifications to understand the client requirements in a detailed manner and translate them into production grade data applications that meet the client requirements. You would be a key contributor to building efficient programs/ systems and if you think you fit right in to help our clients navigate their next in their digital transformation journey If you think you fit righ...

Role Proficiency: Act creatively to develop applications by selecting appropriate technical options optimizing application development maintenance and performance by employing design patterns and reusing proven solutions. Account for others' developmental activities; assisting Project Manager in day to day project execution. Outcomes: Interpret the application feature and component designs to develop the same in accordance with specifications. Code debug test document and communicate product component and feature development stages. Validate results with user representatives integrating and commissions the overall solution. Select and create appropriate technical options for development such...

As a Senior Cloud Data Platform (GCP) Engineer at Incedo, you will be responsible for managing and optimizing the Google Cloud Platform environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or Azure and have experience with big data technologies such as Hadoop or Spark. You will be responsible for configuring and optimizing the GCP environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team to ensure that th...

Title : BigData Developer Location : Bangalore Position type : Full time Requirement: No Remote: All 5 days work from office. Working experience of Hadoop, Hive SQLs, Spark, Bigdata Eco System Tools. • Should be able to tweak queries and work on performance enhancement. • The candidate will be responsible for delivering code, setting up environment, connectivity, deploying the code in production after testing. • The candidate should have strong functional and technical knowledge to deliver what is required and he/she should be well acquainted with Banking terminologies. Occasionally, the candidate may have to be responsible as a primary contact and/or driver for small to medium size projects...

Role & responsibilities ADB- DE: Primary: Azure, Databricks, ADF, Pyspark/Python Secondary: Datawarehouse, Must Have • 10+ Years of IT experience in Datawarehouse and ETL • Hands-on data experience on Cloud Technologies on Azure, ADF, Synapse, Pyspark/Python • Ability to understand Design, Source to target mapping (STTM) and create specifications documents • Flexibility to operate from client office locations • Able to mentor and guide junior resources, as needed Nice to Have • Any relevant certifications • Banking experience on RISK & Regulatory OR Commercial OR Credit Cards/Retail" Preferred candidate profile Any

Walk-In-Interview Location: Pune Date: 8-November-2025 Role & responsibilities ADB- DE: Primary: Azure, Databricks, ADF, Pyspark/Python Secondary: Datawarehouse, Must Have • 10+ Years of IT experience in Datawarehouse and ETL • Hands-on data experience on Cloud Technologies on Azure, ADF, Synapse, Pyspark/Python • Ability to understand Design, Source to target mapping (STTM) and create specifications documents • Flexibility to operate from client office locations • Able to mentor and guide junior resources, as needed Nice to Have • Any relevant certifications • Banking experience on RISK & Regulatory OR Commercial OR Credit Cards/Retail" Preferred candidate profile Any

Role Description As a Senior Cloud Data Platform (GCP) Engineer at Incedo, you will be responsible for managing and optimizing the Google Cloud Platform environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or Azure and have experience with big data technologies such as Hadoop or Spark. You will be responsible for configuring and optimizing the GCP environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team ...

Role Description As a Senior Cloud Data Platform (GCP) Engineer at Incedo, you will be responsible for managing and optimizing the Google Cloud Platform environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or Azure and have experience with big data technologies such as Hadoop or Spark. You will be responsible for configuring and optimizing the GCP environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team ...

Hive/Python/Spark Technical hands on data processing Database SQL knowledge for retrieval of data - transformation queries such as joins (full, left , right) , ranking , group by Database SQL/Oracle Good Communication skills. Additional skills - GitHub , Jenkins , shell scripting would be added advantage, large-scale data processing model implementation, and performance tracking Mandatory Competencies Big Data - Big Data - HIVE Big Data - Big Data - Pyspark Big Data - Big Data - SPARK Data Science and Machine Learning - Data Science and Machine Learning - Data Analyst Database - Oracle - PL/SQL Packages Programming Language - Python - Python Shell Beh - Communication and collaboration

The Professional, Data Engineering job designs, builds and maintains moderately complex data systems that enable data analysis and reporting. With limited supervision, this job collaborates to ensure that large sets of data are efficiently processed Required Candidate profile Minimum requirement of 5 years of relevant work experience. Typically reflects 7 years or more of relevant experience. Design, develop, and maintain scalable ETL pipelines for multi-scale datasets.

6 years relevant in Data Engineering & Data Architecture Good understanding of Data Architecture. Experience in AWS mandatory Experience in Python & pyspark. Required Candidate profile Experience in ETL Development, ETL pipeline. Experience in Data Modelling & Data Pipeline & Data Lake. Experience in SQL. Experience in working as Individual Contributor + Lead.

Provide expertise on database management/design to drive integration of business data, functions, and systems. Establish standards, guidelines, procedures, and other infrastructure necessary to support the objective ofintegration of data. Provide expertise on database management/design to drive integration of business data, functions, and systems. Partnering with IT and Data Ingestion team to transform business requirements to data requirements needed for automation.Validating feasibility of ideas, understanding customer expectations from the product, conducting design due diligence, and evaluating business value and risks.Leading E2E business product test, business process testing, validati...

Location: Bengaluru Designation: Manager What impact will you make Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration and high performance. As the undisputed leader in professional services, Deloitte is where you will find unrivaled opportunities to succeed and realize your full potential Deloitte is where you will find unrivaled opportunities to succeed and realize your full potential. The Team Deloitte s Technology Transformation practice can help you uncover and unlock the value buried deep inside vast amounts of data. Our global network provides strategic guidance and implementation services to help companies manage da...

Job Description : Job Title : Lead, Machine Learning Engineer About us : With over 200 brands sold in nearly 180 countries, we re the world s leading premium drinks company. Bring your passion and use your curiosity as you explore, collaborate, and innovate to build brands consumers love. Together with passionate people from all over the world, you ll test new ideas, learn and grow, and unlock a brighter, more exciting future. Join us to create a career worth celebrating. About the Function: Our Digital and Technology (DT) team are innovators, delivering ground-breaking solutions that will help shape the future of our iconic brands. Technology touches every part of our business, from the sou...

SUMMARY Wissen Technology is Hirin g for Data Engineer About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia . Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge tech...

Programming languages like Python, data handling and analysis, and a deep understanding of machine learning, deep learning algorithms, LLM, RAG, NLP, neural network training and AI model inference. Other essential skills are mathematics (linear algebra, probability, statistics), AI/ML frameworks such as TensorFlow or PyTorch, and experience with big data tools, cloud computing, and model deployment. Qualifications: MTech, BTech - CS / IT or MCA, MSc - CS / IT or Data Science Graduates or Equivalent Kochi | Full Time Years Of Exp Minimum 1 to 5 years of experience. Ready to relocate to Kochi and join immediately

Job Summary: We are seeking an experienced and dynamic Senior Analyst Data Strategy to join the Strategy & Consulting (S&C) Global Network AI team . In this role, you will help organizations unlock the value of their data by defining and implementing data and AI-driven strategies . You will collaborate with business, technology, and analytics teams to shape data foundations, improve governance, and enable enterprise-scale artificial intelligence and analytics adoption. Key Responsibilities: Design and execute data and AI strategies aligned with client business goals and transformation roadmaps. Conduct data maturity assessments , identify improvement areas, and develop actionable recommendat...

Job Summary: We are seeking an experienced and dynamic Senior Analyst Data Strategy to join the Strategy & Consulting (S&C) Global Network AI team . In this role, you will help organizations unlock the value of their data by defining and implementing data and AI-driven strategies . You will collaborate with business, technology, and analytics teams to shape data foundations, improve governance, and enable enterprise-scale artificial intelligence and analytics adoption. Key Responsibilities: Design and execute data and AI strategies aligned with client business goals and transformation roadmaps. Conduct data maturity assessments , identify improvement areas, and develop actionable recommendat...

Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to get to the heart of customer issues, diagnose problem areas, design innovative solutions and facilitate deployment resulting in client delight You will develop a proposal by owning parts of the proposal document and by giving inputs in solution design based on areas of expertise You will plan the activities of configuration, configure the product as per the design, conduct conference room pilots and will assist in resolving any queries related to requirements and solution design You will conduct solution/product demonstrations, POC/Proof of Technology workshops and prepare...

Experienced Azure Data Engineer Tech Lead ( Tech Lead ) with 7 to 10 years of expertise Design, develop, and maintain robust data pipelines using Azure Databricks, Azure Data Factory,Pyspark / Python, Azure Data Lake Gen2, and Azure SQL Database. Integrate and manage data from various source systems, ensuring data quality and consistency. Mandatory Skills :Azure Databrick + Pyspark + Azure Data Facory + SQL +CICD + Strong Coding skills.

AWS Data Engineer 8-11 years AWS Data Engineer, Python Python, S3, RDS, Glue, Lambda, IAM, SNS, SQL , Quicksight