14177 Data Engineering Jobs - Page 36

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Microsoft Azure Databricks, Microsoft Azure Analytics Services, PySpark Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your ...

Data Engineer, BI Engineer, or Data Warehousing Engineer role 5+ Years Location : Pune/ Indore/ Kolkata/ Bangalore JD: Strong experience with any ETL tool like Talend or SSIS or Informatica etc. Google Cloud Platform (Google cloud bucket, Google cloud fusion, Google Big Query, Google Analytics) Ability to lead projects individually and deliver them on time Strong experience in performance-tuning techniques Experience with Realtime streaming implementation and architecture is a bonus Experience building reports and data visualization with any BI tools like Tableau, Power BI, etc. Strong foundation in data organization and experience with ETL/ELT processes Strong experience designing resilient...

Role Summary The Lead of Autonomous AI & Analytics Orchestration is responsible for architecting and operationalizing the next generation of intelligent, autonomous agents across the organization. This role integrates multi-modal data, real-time market signals, and advanced modeling outputs to deliver continuous, self-updating insights that scale decision quality and operational efficiency. The Director provides both strategic and technical leadership, ensuring autonomous workflows become a core capability embedded across commercial, analytical, and operational functions. Responsibilities Strategic Leadership & Organizational Adoption Champion the enterprise-wide adoption of AI-driven analyt...

Job Requirements Technical Architect (12+ Years of Experience) Position Overview: We are seeking a Technical Architect with 12+ years of experience in designing and delivering scalable, enterprise-grade solutions. The ideal candidate will bring deep expertise in cloud-native architecture, microservices, and modernization strategies, while also demonstrating strong leadership and management skills. This role requires strong experience in cloud-native platforms, microservices, modernization strategies, and enterprise migrations , while also leading & mentoring cross-functional teams in delivering high-quality, scalable, and future-ready solutions. The architect will lead the transformation of ...

Role & responsibilities Solution Design & Architecture : Design end-to-end data pipelines and architectures on IICS & Databricks. Data Engineering & Development : Develop ETL/ELT processes to ingest, transform, and load data from various sources. Platform Management: Configure and manage Databricks clusters. Ensure compliance with data governance, security, and privacy regulations. Best Practices & Innovation : Stay updated with the latest IICS & Databricks features and industry trends. Required Skills & Qualifications: Technical Skills: Proficiency in IICS & Databricks and associated tools. Strong hands-on exposure with Unity Catalog Strong coding skills in Python, Scala, or SQL. Experience...

Job Title: Data Engineer PySpark Experience: 6+ Years Location: Chennai Notice: only Immediate joiners Job Summary We are looking for an experienced Data Engineer (PySpark) to design, build, and optimize large-scale data platforms for enterprise-grade analytics solutions. The ideal candidate will have strong expertise in data architecture, big data engineering, cloud-native solutions , and end-to-end data management for complex systems. Key Responsibilities Design and implement enterprise-scale data architecture , data strategy, and roadmap for large and complex organizations Build and deliver end-to-end Data Management & Analytics solutions using Big Data technologies Transform traditional ...

Technical Skills Must Have Skills: Proficient with Python, PySpark and Airflow Strong understanding of Object-Oriented Programming and Functional Programming paradigm Must have experience working with Spark and its architecture Knowledge of Software Engineering best practices Advanced SQL knowledge (preferably Oracle) Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources. Good to Have Skills: Knowledge of Data related AWS Services Knowledge of GitHub and Jenkins Automated testing

NOTE : Looking for the candidate, you started their career as a Data Engineer and currently working as a Delivery Manager Interested candidate please share your updated CVS to: pavanrai@mytechglobal.in Role & responsibilities Must Have Skills : Client Management, Leadership, Data Engineering, Project management, Presales, Strategic Planning, Telecom / Banking, Stakeholder Management, Delivery Management About the Role We are looking for an experienced Delivery Manager from an IT services background who can lead end-to-end delivery for large-scale data engineering programs. The ideal candidate should have strong exposure to the Telecom domain, with additional experience in Banking being an ad...

Project Role : Data Modeler Project Role Description : Work with key business representatives, data owners, end users, application designers and data architects to model current and new data. Must have skills : Data Modeling Techniques and Methodologies Good to have skills : Data Engineering, Snowflake Data Warehouse Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Modeler, you will engage with key business representatives, data owners, end users, application designers, and data architects to model both current and new data. Your typical day will involve collaborating with various stakeholders to understand their data n...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your typical day will involve collaborating with team members to ensure the successful implementation o...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Building Tool Good to have skills : Snowflake Data Warehouse Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuri...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data qualit...

About The Role Project Role : Cloud Platform Engineer Project Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof of architecture to test architecture viability, security and performance. Must have skills : Splunk Good to have skills : Data Visualization, Data Analytics Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Role:Cloudera SME Development & Integration, Level 10Role Description:We are seeking a skilled Cloudera resource with experience in Cloudera Data Platform (CDP) and hands-on exp...

Key Responsibilities: Spark Engineering & Performance Optimization (Core) Architect, build, and optimize large-scale Spark pipelines using PySpark or Scala Lead Spark performance tuning initiatives , including: Executor and memory tuning Partitioning and shuffle optimization Broadcast joins, caching, and skew mitigation Analyze and resolve Spark job failures, bottlenecks, and cost inefficiencies Establish Spark coding standards and optimization best practices across teams Data Architecture & Engineering Design and build end-to-end data pipelines (batch and streaming) ingesting data into Snowflake and AWS-based Data Lakes Architect and optimize cloud-native data lake and data warehouse soluti...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

About The Role Project Role : AI / ML Engineer Project Role Description : Develops applications and systems that utilize AI tools, Cloud AI services, with proper cloud or on-prem application pipeline with production ready quality. Be able to apply GenAI models as part of the solution. Could also include but not limited to deep learning, neural networks, chatbots, image processing. Must have skills : Data Engineering Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an AI / ML Engineer, you will engage in the development of applications and systems that leverage artificial intelligence tools and cloud AI se...

Your role and responsibilities Build, test, and deploy AI agents using IBM Watsonx Orchestrate. Develop and maintain data pipelines for AI and S2P data needs. Collaborate with cross-functional teams globally. Support enhancements to existing tools and processes. Participate in technical discussions and contribute ideas. Create and maintain clear, comprehensive documentation for solutions and processes. Required education Bachelor's Degree Required technical and professional expertise Bachelors degree in Computer Science or related field. 1"“2 years of experience in Python development. Experience with SQL and database management. Exposure to data pipeline development (ETL, DataStage, or simil...

About the Role: Grade Level (for internal use): 11 S&P Global Mobility The RoleLead Data Engineer( AWS Cloud, Python) We are seeking a Senior Data Engineer with deep expertise in AWS Cloud Development to join our fast-paced data engineering organization. This role is critical to both the development of new data products and the modernization of existing platforms. The ideal candidate is a seasoned data engineer with hands-on experience designing, building, and optimizing large-scale data pipelines and architectures in both on-premises (e.g., Oracle) and cloud environments (especially AWS). This individual will also serve as a Cloud Development expert , mentoring and guiding other data engine...

Associate Director, Data Engineering (J2EE/Angular/React Full Stack Individual Contributor) Responsibilities: Architect, design, and implement innovative software solutions to enhance S&P Ratings' cloud-based analytics platform. Mentor a team of engineers (as required), fostering a culture of trust, continuous growth, and collaborative problem-solving. Collaborate with business partners to understand requirements, ensuring technical solutions align with business goals. Manage and improve existing software solutions, ensuring high performance and scalability. Participate actively in all Agile scrum ceremonies, contributing to the continuous improvement of team processes. Produce comprehensive...

Project Role : Full Stack Engineer Project Role Description : Responsible for developing and/or engineering the end-to-end features of a system, from user experience to backend code. Use development skills to deliver innovative solutions that help our clients improve the services they provide. Leverage new technologies that can be applied to solve challenging business problems with a cloud first and agile mindset. Must have skills : Python (Programming Language) Good to have skills : MySQL, Snowflake Data Warehouse Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Skills Must Haves:Python(Data Engineering)AirflowTerraform (pipeline setup, da...

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Python (Programming Language) Good to have skills : PostgreSQL Minimum 3 year(s) of experience is required Educational Qualification : 10 years full time education Summary :We are seeking skilled Python Developers with strong SQL database experience, preferably in PostgreSQL, to join our data engineering and application development teams. This role involves building scalable back...

Project Role : Custom Software Engineer Project Role Description : Utilize modular architectures, next-generation integration techniques and a cloud-first, mobile-first mindset to provide vision to Application Development Teams. Work with an Agile mindset to create value across projects of multiple scopes and scale. Must have skills : Data Engineering Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will utilize modular architectures and next-generation integration techniques to provide vision to Application Development Teams. Your typical day will involve collaborating wi...

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Python (Programming Language) Good to have skills : PostgreSQL Minimum 7.5 year(s) of experience is required Educational Qualification : 12 years full time education Summary :We are seeking skilled Python Developers with strong SQL database experience, preferably in PostgreSQL, to join our data engineering and application development teams. This role involves building scalable ba...

Skill required: Tech for Operations - Artificial Intelligence (AI) Designation: I&F Decision Sci Practitioner Manager Qualifications: Any Graduation Years of Experience: 13 to 18 years What would you do An Artificial Intelligence Data Scientist Manager leads the design and deployment of advanced AI methodologies such as NLP, Machine Learning, and Deep Learning to solve complex business challenges, overseeing the entire project lifecycle from data acquisition to post-production monitoring What are we looking for This role involves setting strategic direction for data science initiatives, collaborating with cross-functional teams to implement scalable AI models, ensuring responsible AI practic...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quali...