10165 Data Engineering Jobs - Page 38

Management Level: Ind&Func AI Decision Science Consultant Job Location: Bangalore / Gurgaon Must-have Skills: Excellent understanding of Pharma data sets commercial, clinical, Leverage ones hands on experience of working across one or more of these areas such as real-world evidence data, Statistical Models/Machine Learning including Segmentation & predictive modeling, hypothesis testing, multivariate statistical analysis, time series techniques, and optimization. Good-to-have Skills: Programming languages such as R, Python, SQL, Spark, AWS, Azure, or Google Cloud for deploying and scaling language models, Data Visualization tools like Tableau, Power BI. Job Summary This role involves driving...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Data Engineering Good to have skills : Microsoft SQL Server, Python (Programming Language), Snowflake Data WarehouseMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Senior Analyst, Data Engineering, you will be part of the Data and Analytics team, responsible for developing and delivering high-quality data assets and managing data domains for Personal Banking customers and colleagues. You will bring expertise in data handling, curation, and conformity...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Data Engineering Good to have skills : Microsoft SQL Server, Python (Programming Language), Snowflake Data WarehouseMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Senior Analyst, Data Engineering, you will be part of the Data and Analytics team, responsible for developing and delivering high-quality data assets and managing data domains for Personal Banking customers and colleagues. You will bring expertise in data handling, curation, and conformi...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Data Engineering Good to have skills : Microsoft SQL Server, Python (Programming Language), Snowflake Data WarehouseMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Senior Analyst, Data Engineering, you will be part of the Data and Analytics team, responsible for developing and delivering high-quality data assets and managing data domains for Personal Banking customers and colleagues. You will bring expertise in data handling, curation, and conformity...

Support Development, and maintain automated test frameworks, tools, and test cases for Data Engineering and Data Warehouse applications. Collaborate with cross-functional teams, including software developers, data engineers, and data analysts, to ensure comprehensive testing coverage and adherence to quality standards. Conduct thorough testing of data pipelines, ETL processes, and data transformations using Big Data technologies. Apply your knowledge of Data Warehouse/Data Lake methodologies and best practices to validate the accuracy, completeness, and performance of our data storage and retrieval systems. Identify, document, and track software defects, working closely with the development ...

Principal DevOps Engineer Database & Data Operations will drive the strategic implementation of automation, pipelines, and infrastructure solutions supporting large-scale data platforms. This role involves designing and optimizing CI/CD workflows for data services, implementing Infrastructure as Code with Terraform and Ansible, and managing containerized environments. You will partner closely with database and data engineering teams to ensure scalability, reliability, and performance across critical systems. As a senior contributor, youll solve complex technical challenges, guide cross-functional initiatives, and align DevOps practices with organizational goals. Here is how, through this exc...

Advanced Programming Skills in Python,Scala,GoStrong expertise in developing and maintaining microservices in Go (or other similar languages), with the ability to lead and mentor others in this area. Extensive exposure in developing Big Data Applications ,Data Engineering ,ETL and Data Analytics . Cloud ExpertiseIn-depth knowledge of IBM Cloud or similar cloud platforms, with a proven track record of deploying and managing cloud-native applications. Leadership and CollaborationAbility to lead cross-functional teams, work closely with product owners, and drive platform enhancements while mentoring junior team members. Security and ComplianceStrong understanding of security best practices and ...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the client’s needs. Your primary responsibilities include* Design, build, optimize and support new and existing data models and ETL processes based on our client’s business requirements Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachel...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

Required Skills Python / Scala, spark/pyspark, Hive, AWS, EMR, S3, SQL, Airflow/ Github 3-4 years experience developing Data & Analytics solutions Experience building data lake solutions leveraging one or more ofthe followingAWS, EMR, S3, Hive & Spark Experience with relational SQL Experience with scripting languages such as Shell, Python Experience with source control tools such as GitHub and related dev process Experience with workflow scheduling tools such as Airflow In-depth knowledge of scalable cloud Has a passion for data solutions Strong understanding of data structures and algorithms Strong understanding of solution and technical design Has a strong problem-solving and analytical mi...

Databricks Developer Must-have skills Cloud certified in one of these categories Azure Data Engineer Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation . Semantic Modelling/ Optimization of data model to work within Rahona Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. Experience in Sqoop / Hadoop Microsoft Excel (for metadata files with requirements for ingestion) Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud Strong Programming skills with at least one of Python, Scala or Java Location- Pune, Bangalore, Coimbatore, Chennai Mandatory Skills: DataBricks - Data Enginee...

Job Description Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert re...

Role Purpose The purpose of the role is to define, architect and lead delivery of machine learning and AI solutions Do 1. Demand generation through support in Solution development a. Support Go-To-Market strategy i. Collaborate with sales, pre-sales &consulting team to assist in creating solutions and propositions for proactive demand generation ii. Contribute to development solutions, proof of concepts aligned to key offerings to enable solution led sales b. Collaborate with different colleges and institutes for recruitment, joint research initiatives and provide data science courses 2. Revenue generation through Building & operationalizing Machine Learning, Deep Learning solutions a. Devel...

Job Description Role Purpose The purpose of the role is to create exceptional architectural solution design and thought leadership and enable delivery teams to provide exceptional client engagement and satisfaction. Do 1.Develop architectural solutions for the new deals/ major change requests in existing deals Creates an enterprise-wide architecture that ensures systems are scalable, reliable, and manageable. Provide solutioning of RFPs received from clients and ensure overall design assurance Develop a direction to manage the portfolio of to-be-solutions including systems, shared infrastructure services, applications in order to better match business outcome objectives Analyse technology en...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Job Overview : We are looking for a skilled Full Stack Developer who thrives at the intersection of software development, modern data infrastructure, and internal tools. Youll help architect and build robust APIs, manage databases like PostgreSQL and Supabase, and contribute to the frontend when needed all while enabling automation and actionable business insights. This role combines backend craftsmanship with data intuition to power internal tools, data reporting pipelines, and intelligent automation systems. Key Responsibilities : Application & API Development: Design and maintain scalable backend services using Python (Django). Build and optimize RESTful or GraphQL APIs for internal and e...

Company Description Blendis a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to unlocking value and fostering innovation for its clients by harnessing world-class people and data-driven strategy. We believe that the power of people and AI can have a meaningful impact on your world, creating more fulfilling work and projects for our people and clients. For more information, visit www.blend360.com Job Description We are seeki...

Role Description As a Senior Technical Lead - Data Science and Modeling at Incedo, you will be responsible for developing and deploying predictive models and machine learning algorithms to support business decision-making. You will work with data scientists, data engineers, and business analysts to understand business requirements and develop data-driven solutions. You will be skilled in programming languages such as Python or R and have experience in data science tools such as TensorFlow or Keras. You will be responsible for ensuring that models are accurate, efficient, and scalable. Roles & Responsibilities: Developing and implementing machine learning models and algorithms to solve comple...

Role & responsibilities Location: Remote Notice Period : Immediate Mandatory Skills : Azure , Data Engineer , Sql Server ,Python and R. Review and optimisation of our current SQL Database (tables, views) extensive experience in Data Warehousing / Data Engineering on SQL Server Enhancing the documentation of our data warehouse (data dictionary, logical data model) Review of the ETL scripts (developed in Python and/or R) Migration of R scripts to Python along with improvements Establishing guidelines for better structuring our scripts and documenting them properly Implementation of data quality checks, logging and alerting Recommended ways of anonymising some historical data Assessment of usin...

Overview Job Summary : We are looking for a skilled GCP Data Engineer with 3 to 6 years of experience to join our dynamic team. The ideal candidate will have a strong background in data engineering, cloud technologies, and experience with Google Cloud Platform (GCP) services. You will be responsible for designing, building, and maintaining scalable data pipelines and frameworks that support our data analytics and machine learning initiatives. Key Responsibilities : Design and implement data pipelines using GCP services such as BigQuery, Dataflow, and Pub/Sub. Collaborate with data scientists and analysts to understand data needs and deliver appropriate solutions. Optimize data storage and pr...

Job Summary: We are looking for a skilled GCP Data Engineer to design, build, and optimize data pipelines and solutions on Google Cloud Platform. The ideal candidate will have hands-on experience with BigQuery, Composer, Dataproc, Python, PySpark, Airflow, and SQL , and will play a key role in ensuring data reliability, scalability, and efficiency across our data ecosystem. Collaborate with data analysts, scientists, and other stakeholders to deliver reliable data solutions. Monitor and troubleshoot data pipelines and ensure data accuracy and consistency. Optimize cloud resources for cost efficiency and performance . Maintain clear technical documentation for all data processes and workflows...

Responsibilities include: Mandatory Skills: Snowflake experience, Data Architecture experience, ETL process experience, Large Data migration solutioning experience Lead the design and architecture of data solutions leveraging Snowflake, ensuring scalability, performance, and reliability. Oversee the implementation of data pipelines, ETL processes, and data governance frameworks within Snowflake environments. Ensure efficient data extraction from SAP BW/ECC systems Collaborate with stakeholders to understand business requirements and translate them into technical specifications and data models. Develop and maintain data architecture standards, guidelines, and best practices, including data go...