10148 Data Engineering Jobs - Page 3

Databricks and Bigdata Client persistent Role; C2H AMVikas Exp8+ years Budget:30 LPA Location POC:Swathi Patil About The Role 1.Mandatory Skills - Big Data, Data Bricks, SQL, Python, Databricks Sr Data Engineer JD as below-Must have 8+ years of total experience. Hands-on experience in SQL, Python, Pyspark, AWS Databricks. Good knowledge of Big Data, Data Warehousing concepts. Good knowledge of GIT, CI/CD Customer-focused, react well to changes, work with teams and able to multi-task. Must be a proven performer and team player that enjoy challenging assignments in a high-energy, fast growing and start-up workplace. Must be a self-starter who can work well with minimal guidance and in fluid en...

Programming Languages: Proficient in Python and PySpark with a strong understanding software engineering best practices. Cloud Computing: Utilize Azure cloud based data platforms, specifically leveraging Databricks and Delta Live Tables for data engineering tasks, while effectively utilizing services related to storage, compute, and security. Data Pipelines: Design, build, and maintain robust and scalable and automated data pipelines for batch and streaming data ingestion of data and processing. Data Quality: Implement data quality checks and balances throughout the data pipeline, including profiling, validation, and root cause analysis, to ensure data accuracy, completeness, and consistency...

Client expectation apart from JD Longer AWS data engineering experience (glue, spark, ECR ECS docker), python, pyspark, hudi/iceberg/Terraform, Kafka. Java in early career would be a great addition but not a prio. (for the OOP part and java connectors).

JPC REQ--data engineer --4+ YEARS--9.2 LPA--TCS---CTOH---kruppiah mg- SHARVIN

Position Responsibilities: Support: With Solution Architects / Data Architecture support solution design for the service layer for APIs and Data Services for Analytics Lead: API Development, Data migration using ETL/ADF or other means Lead: Develop business logic as needed for developing and consuming API services Lead: Stakeholder requirements / design for taking the project from scratch to completion Lead: SQL query creation for complex business functionalities Support / Lead: With Domain Data Architect for data pipeline methods / service in support of additional data types from the Data Strategy Proactive experimentation with an innovation-inclined mindset Basic Qualifications (Required S...

Job Title: Data Engineer Pharma/Life Sciences Domain Company: Indegene (Client Location) Experience: 5–10 Years Location: Bangalore (Onsite/Hybrid) Employment Type: Full-Time Industry: Healthcare / Pharma / Life Sciences Job Description We are looking for a highly skilled Data Engineer with strong experience in data engineering technologies and a solid understanding of the Healthcare/Pharma/Life Sciences domain . The ideal candidate will be responsible for designing, building, and optimizing end-to-end data pipelines that support analytics, insights, and data-driven decisions. Roles & Responsibilities Design, develop, and maintain scalable data pipelines, ETL workflows, and data integration ...

Urgent Hiring: Data Engineer Genesys International Corporation Ltd Location: SEEPZ, Andheri (E), Mumbai (Work from Office) Experience: 2 to 8 Years Company: Genesys International Corporation Ltd Position: Data Engineer Job Responsibilities: Assist in designing, executing, and improving complex data integration processes. Support in leading data engineering projects by converting and utilizing external data sources for database integration. Work with data engineering technologies (FME, ArcGIS, Python, SQL, QGIS) to transform and integrate datasets. Assess and manage risks in data integration projects. Provide GIS and spatial data consultancy support for data integration initiatives. Create an...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Data Engineering Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application features, and ensuring that the applications function seamlessly within the existing infrastructure. You will al...

About The Role Project Role : Software Development Lead Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : Amazon Web Services (AWS), Python (Programming Language), DevOps, Data Engineering Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Lead, you will engage in the development and configuration of software systems, either managing the entire process or focusing on...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Python (Programming Language), Generative AI Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing innovative solutions, and ensuring that applications are ...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, addressing any challenges that arise, and providing guidance to team members to foster a pro...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Snowflake Data Warehouse Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will work in a dynamic environment where you will analyze, design, code, and test application and data components for multiple clients. You will collaborate with cross-functional teams to perform maintenance, enhancements, and new imple...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Google BigQuery Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and impl...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Data Engineering Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, addressing any challenges that arise, and providing guidance to your team members to foster a productive work environm...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Data Engineering Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that project goals are met, facilitating discussions to address challenges, and guiding your team through the development process. You will also e...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Analytics Services Good to have skills : Informatica Data Quality Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Roles & Responsibilities:-Develop and Optimize Data Pipelines using PySpark and SQL in Databricks to handle large-scale data transformations and batch/streaming workloads.-Design and Implement ETL Processes by leveraging Databricks notebooks, Delta Lake, and Python-based custom scripts for data ingestion and curation.-Col...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Apache Spark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application development aligns with business objectives, overseeing project timelines, and facilitating communication among stakeholders to drive...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. You should have Data Engineering experience with strong Python programming skills and hands-on experience in building and maintaining data pipelines on AWS...

Location - Chennai, Bengaluru, Hyderabad, Pune Job Description : Python Developer Experience : 12+ Location : Any / Remote Overview: We are looking for a Python Developer with strong experience in Pandas and Object-Oriented Programming (OOP) to build data processing workflows, automation scripts, and backend components. Key Responsibilities Develop and maintain Python applications using OOP principles. Build data pipelines and perform data manipulation using Pandas. Implement ETL logic, data cleansing, and transformation using DataFrames. Integrate Python applications with SQL/NoSQL databases. Write reusable, efficient, and well-structured code. Create unit tests, documentation, and support ...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Engineering Data and Information Management Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day w...

The ideal candidate will have a strong background in data analysis, statistics, and human resources, with a focus on generating actionable insights to drive strategic decision-making within the organisation . This role will involve working closely with cross-functional teams to understand business needs, analyse data, and communicate findings effectively to Leadership audiences. Competitive candidates will be detail-oriented, execution-focused, and accomplished at driving quantifiable results within a global and matrixed organization. Role Conduct in-depth analyses of employee data to identify trends, patterns, and areas for improvement. Applies knowledge in quantitative and qualitative anal...

Overview We are the global technology company behind the worlds fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless. We ensure every employee has the opportunity to be a part of something bigger and to change lives. We believe as our company grows, so should you. We believe in connecting everyone to endless, priceless possibilities. Our team within Mastercard: The Data & Services team is a key differentiator for Mastercard, providing the cutting-edge services that are used by some of the world's largest organizations to make multi-million dollar decisions and ...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Data Engineering Good to have skills : Python (Programming Language) Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your day will involve collaborating with team members to ensure the...

Candidate Specification: Minimum 8 years of experience in Data Engineer Job Description: Databricks: Proficient in building scalable data pipelines and notebooks using pyspark /python and SQL's Azure Data Factory (ADF): Experience in orchestrating data workflows and integrating diverse data sources. Good hands on the Pyspark and python Good hands on for data transformation and data integration using Rest API , kafka etc. Good understanding on writing the unit test code Technical expertise on building ETL data, pipeline, extraction from different source like Azure storage, HDFS, Kafka topics, structured and unstructured files, Hive. Good understanding on Azure components (ADF, ADB, ADLS) Good...

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Data Science Good to have skills : Generative AI Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education SUMMARY:We are seeking a Senior Technical – Gen AI Lead with deep expertise in Python, AI/ML concepts, and data engineering to spearhead the design and development of Data Agents powered by Agentic AI. As a senior t...