10148 Data Engineering Jobs

We are looking for an innovative AI Technology Specialist to join our team. The ideal candidate will design, build, and deploy AI-powered solutions that solve real business problems like Obligation management, contract drafting and redlining. This role requires a strong background in machine learning, natural language processing (NLP), generative AI, and software engineering. This role is not a permanent role. Responsibilities Design, develop, and deploy AI/ML models (NLP, computer vision, predictive analytics, generative AI). Build end-to-end pipelines: data preprocessing, model training, evaluation, deployment, and monitoring. Work with APIs and frameworks Collaborate with legal team to in...

About the Role Your days are dynamic and impactful. You will spearhead GTM programs aimed at driving significant pipeline and revenue growth. Collaborating closely with the Front End, Inside Sales, and Demand Gen teams, you'll harness extensive knowledge of regional execution performance to identify trends and craft strategies. Your expertise will support the sales organization in smashing their quarterly and yearly pipeline targets, through meticulous project management and strategy execution. A Day in the Life Your days are dynamic and impactful. You will spearhead GTM programs aimed at driving significant pipeline and revenue growth. Collaborating closely with the Front End, Inside Sales,...

We are looking for a highly skilled and experienced Cloud Data Engineer to join our team at Apple India Pvt Ltd. The ideal candidate will have a strong background in designing, developing, and implementing data engineering solutions on cloud platforms. Roles and Responsibility Design and develop scalable and efficient data pipelines using cloud-based technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data architectures on cloud platforms such as AWS or Azure. Ensure data quality and integrity by implementing data validation and testing procedures. Optimize data processing workflows to improve performance and...

We are looking for a skilled Cloud Data Engineering Manager to lead our team in designing and implementing scalable data engineering solutions. The ideal candidate will have a strong background in cloud computing, data engineering, and leadership. Roles and Responsibility Design and implement large-scale data engineering projects on cloud platforms. Lead a team of engineers in developing and deploying data pipelines and architectures. Collaborate with cross-functional teams to identify business requirements and develop solutions. Develop and maintain technical roadmaps and strategies for data engineering initiatives. Ensure high-quality code reviews and adherence to industry standards. Troub...

Job Description We are looking for an experienced Solution Architect with a strong background in Databricks and enterprise data management. The ideal candidate will have extensive experience designing and implementing scalable data solutions using Databricks Unity Catalog , ensuring data governance, security, and performance across analytics platforms. Key Responsibilities Lead the design and implementation of Databricks-based data solutions aligned with business and compliance requirements. Manage Unity Catalog , including tagging, lineage, and access control for data governance. Develop strategies for KPI anonymization , data extraction , and secure data sharing. Collaborate with cross-fun...

We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar frameworks. - Design, implement, and manage data warehouse solutions, schema evolution, and data versioning. - Collaborate with cross-functional teams to deliver high-quality data solutions. Req...

We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, GCP). - Build and manage data warehouse solutions, schema evolution, and data versioning. - Implement and manage workflow orchestration u...

We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar frameworks. - Design, implement, and manage data warehouse solutions, schema evolution, and data versioning. - Collaborate with cross-functional teams to deliver high-quality data solutions. Req...

Once you join our team you will have the opportunity to Access experts across industries for maximum learning opportunities including Weekly Knowledge Sharing Sessions, LinkedIn Learning, and more. Gain exposure to a rich variety of research techniques from knowledgeable professionals. Enjoy a remote first/hybrid work environment with a flexible schedule. Obtain insights into the needs and challenges of your clientsto learn how the worlds leading brands use research. Experience peace of mind working for a company with a commitment to conducting research ethically. Build lasting relationships with fun colleagues in a culture that values each person Position Specifications: Should have 6+ year...

Engineering Manager - Data Engineering Experience: 6-14 Years Salary: Competitive Preferred Notice Period: Upto 45 Days Opportunity Type: Office (Noida) Placement Type: Full-time Note: This is a requirement for one of Uplers' Clients Nuaav: Must have skills: Azure OR synapse OR Data Factory OR Databricks OR Data lake OR Azure Data Lake AND Spark OR Python OR CI - CD AND Hive OR Scala About Nuaav: Nuaav is a boutique technology consulting firm focused on delivering innovative, scalable, and secure data engineering and AI solutions. We partner with corporate clients to drive impactful change through specialized expertise in product engineering, data systems, AI/ML, and user experience. Our ser...

Engineering Manager - Data Engineering Experience: 6-14 Years Salary: Competitive Preferred Notice Period: Upto 45 Days Opportunity Type: Office (Noida) Placement Type: Full-time Note: This is a requirement for one of Uplers' Clients Nuaav: Must have skills: Azure OR synapse OR Data Factory OR Databricks OR Data lake OR Azure Data Lake AND Spark OR Python OR CI - CD AND Hive OR Scala About Nuaav: Nuaav is a boutique technology consulting firm focused on delivering innovative, scalable, and secure data engineering and AI solutions. We partner with corporate clients to drive impactful change through specialized expertise in product engineering, data systems, AI/ML, and user experience. Our ser...

RESPONSIBILITITES - Lead data engineering activities and process from demand management to design to implementation. Act as a trusted advisor to our internal partners (Business Units and IT teams), and proactively communicate operational status, issues & risks in the projects to management. Conceptualize products for existing business problems with business covering full life Cycle -design thinking, business canvas, road map with open source first approach and build products. Lead internal consulting engagements, managing stakeholder expectations (Business Units) and monitor time to time and drive quality of deliverables. Cost Optimization of resources and effective planning at the beginning...

Role Purpose The purpose of this role is to interpret data and turn into information (reports, dashboards, interactive visualizations etc) which can offer ways to improve a business, thus affecting business decisions. Do 1. Managing the technical scope of the project in line with the requirements at all stages a. Gather information from various sources (data warehouses, database, data integration and modelling) and interpret patterns and trends b. Develop record management process and policies c. Build and maintain relationships at all levels within the client base and understand their requirements. d. Providing sales data, proposals, data insights and account reviews to the client base e. I...

Job Title: Data Engineer About Us Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO? You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services indus...

Job Title: Senior Data Engineer (Kafka & AWS) Responsibilities: Develop and maintain real-time data pipelines using Apache Kafka (MSK or Confluent) and AWS services . Configure and manage Kafka connectors , ensuring seamless data flow and integration across systems. Demonstrate strong expertise in the Kafka ecosystem , including producers, consumers, brokers, topics, and schema registry. Design and implement scalable ETL/ELT workflows to efficiently process large volumes of data. Optimize data lake and data warehouse solutions using AWS services such as Lambda, S3, and Glue . Implement robust monitoring, testing, and observability practices to ensure reliability and performance of data platf...

enior Data Engineer (Azure/Databricks) Overview We are seeking a Senior Data Engineer with 5+ years of hands-on experience in building and scaling data solutions within the Azure ecosystem . The ideal candidate will have deep expertise in Databricks , PySpark , and modern data lake architectures , and be adept at designing robust ETL pipelines and data workflows. Key Responsibilities Design, develop, and maintain scalable data pipelines using Azure and Databricks . Build efficient data ingestion and transformation workflows with PySpark and Delta Lake . Develop, optimize, and maintain ETL/ELT pipelines using Python and SQL . Implement data modeling , data quality , and governance best practi...

Senior AWS Data Engineer Experience: 6-12 Role Overview: We are looking for a Senior Big Data Engineer to join our team and work closely with project leads and clients. You will design and develop scalable data processing systems, gather and translate complex business requirements into end-to-end technical solutions, and oversee projects from conception through production. You will also mentor junior team members and ensure delivery of high-quality, robust solutions using cutting-edge technologies. Key Responsibilities: Design and develop scalable big data pipelines and solutions. Collaborate with project leads and clients to gather and refine requirements. Translate complex business needs i...

Role & responsibilities JOB DESCRIPTION Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. Design and implement high-performance data processing and analytics solutions. Ensure data integrity, accuracy, and security across all processing tasks. Troubleshoot and resolve performance issues in Spark, Cloudera, and related te...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Role Purpose The purpose of the role is to define, architect and lead delivery of machine learning and AI solutions. Do 1. Demand generation through support in Solution development a. Support Go-To-Market strategy i. Contribute to development solutions, proof of concepts aligned to key offerings to enable solution led sales b. Collaborate with different colleges and institutes for research initiatives and provide data science courses 2. Revenue generation through Building & operationalizing Machine Learning, Deep Learning solutions a. Develop Machine Learning / Deep learning models for decision augmentation or for automation solutions b. Collaborate with ML Engineers, Data engineers and IT t...

Primary Responsibilities: Design, develop, and deploy scalable AI/ML models to solve complex business challenges Lead end-to-end ML workflows, including data preprocessing, model training, hyperparameter tuning, and deployment Apply classical machine learning techniques (e.g., boosting, ensemble methods) and modern deep learning frameworks (e.g., PyTorch, TensorFlow) to deliver innovative solutions Work with large datasets using tools such as PySpark, Databricks, Pandas, and Numpy to enable data-driven decision-making Develop and fine-tune Generative AI and large language models (LLMs) using tools like Hugging Face, LangChain, and similar frameworks Collaborate with cross-functional teams to...

Role: Engagement Manager Experience Level: 7 to 13 Years Work location: Mumbai/Bangalore Roles & Responsibilities: Client Management: Managing customer communication, relationships and escalation management. Guide the client on technology evaluation, technical thought leadership and direction for data and analytics projects. Constantly sync with the product & Business team to align on business priorities, and plan for long term and short-term architecture goals. Showcase thought leadership on technology roadmaps, agile development methodologies and best practices. Challenge and inspire customers and peers to solve difficult problems with ambitious and novel solutions. Project Delivery: Own t...

Role: Sr AWS Data engineer - Data Migration Experience: 6+ years Location: Hyderabad Fission Labs , headquartered in Sunnyvale, with offices in Dallas & Hyderabad, Fission Labs is a leading software development company, specializing in crafting flexible, agile, and scalable solutions that propel businesses forward. With a comprehensive range of services, including product development, cloud engineering, big data analytics, QA, DevOps consulting, and AI/ML solutions, we empower clients to achieve sustainable digital transformation that aligns seamlessly with their business goals. Responsibilities Experience leading and driving large scale data migration projects Experience in working with all...

As Sr. Associate V&A Transformation Initiatives, you will be at the forefront of solving the US Value & Access teams biggest challenges using cutting edge technology. The AIN Transformation team will be viewed as an innovation engine, constantly testing and refining analytics solutions to address customer needs and opportunities alongside business partners. As an Associate Data Scientist, you will be responsible for developing and deploying advanced machine learning, operational research, semantic analysis, and statistical methods to uncover structure in large data sets. This role involves creating analytics solutions to address customer needs and opportunities. Roles & Responsibilities: Wor...

As Sr. Associate V&A Transformation Initiatives, you will be at the forefront of solving the US Value & Access teams biggest challenges using cutting edge technology. The AIN Transformation team will be viewed as an innovation engine, constantly testing and refining analytics solutions to address customer needs and opportunities alongside business partners. As an Associate Data Scientist, you will be responsible for developing and deploying advanced machine learning, operational research, semantic analysis, and statistical methods to uncover structure in large data sets. This role involves creating analytics solutions to address customer needs and opportunities. Roles & Responsibilities: Wor...