924 Elt Jobs

Job Title: Data Engineer Location: Puttaparthi, Andhra Pradesh (On-site) Experience Level: 4-8 years About the Role: We are seeking a highly skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure across AWS and Azure platforms. The role requires hands-on expertise in Python, SQL, and cloud-native services to ensure data integrity, security, and performance across our data ecosystem. Key Responsibilities: Design, develop, and maintain robust ETL/ELT pipelines using Python and SQL . Build and manage data infrastructure on AWS and Azure cloud platforms. Optimize data storage and retrieval using cloud-native tools and services. Collaborate with cross-func...

Job Summary: We are seeking a skilled and detail-oriented Big Data Engineer with over 5 years of IT experience, including at least 3 years specializing in Big Data application development using the Hadoop ecosystem and Cloud platforms (AWS/Azure) . The ideal candidate will have strong expertise in PySpark , ETL pipeline development , data integration , and workflow orchestration to build scalable and efficient data solutions. Key Responsibilities: Design, develop, and optimize Big Data pipelines using PySpark , Hive , Sqoop , and Spark SQL . Implement ETL processes for ingesting, transforming, and loading large-scale structured and unstructured data from diverse sources (JSON, Parquet, Avro,...

About the team: AIML is usedto create chatbots, virtual assistants, and other forms of artificial intelligence software. AIML is also used in research and development of natural language processing systems. What you can look forward to as a AI/ML expert Lead Development : Own endtoend design, implementation, deployment and maintenance of both traditional ML and Generative AI solutions (e.g., finetuning LLMs, RAG pipelines) Project Execution & Delivery : Translate business requirements into datadriven and GenAIdriven use cases; scope features, estimates, and timelines Technical Leadership & Mentorship : Mentor, review and coach junior/midlevel engineers on best practices in ML, MLOps and GenA...

Role: Tech Lead Description The Data Engineering Lead is a senior-level position within our Data Engineering team, responsible for spearheading the design, implementation, and optimization of advanced data architectures using Databricks. This role involves leading a team of data engineers, collaborating with business and data analysts, and business stakeholders, and delivering scalable, secure data solutions tailored to the needs of commercial analytics in the pharmaceutical industry. Responsibilities 1. Architecture Design o Develop and maintain scalable data architectures using Databricks, including data lakes, data warehouses, and real-time processing systems. o Create detailed blueprints...

Your role and responsibilities As a Quality Engineer/tester work with client and IBM stakeholders to identify various business controls for client and work with respective IBM and client to ensure successful implementation of controls identified. Your primary responsibilities include: Software Tester at AT&T for BGW IOT - Microservices and Databricks; Production Support Analyze test specifications and convert them into Manual/Auto Test Cases. Identify the initial setup, input data, appropriate steps, and the expected response in the manual test cases. Conduct sanity testing of the application based on user requirements. Required education Bachelor's Degree Required technical and professional...

Your role and responsibilities As a Quality Engineer/tester work with client and IBM stakeholders to identify various business controls for client and work with respective IBM and client to ensure successful implementation of controls identified. Your primary responsibilities include: Software Tester at AT&T for BGW IOT - Microservices and Databricks; Production Support Analyze test specifications and convert them into Manual/Auto Test Cases. Identify the initial setup, input data, appropriate steps, and the expected response in the manual test cases. Conduct sanity testing of the application based on user requirements. Involve in writing test cases based on the user stories. Wrote positive,...

About The Role Project Role : AI / ML Engineer Project Role Description : Develops applications and systems that utilize AI tools, Cloud AI services, with proper cloud or on-prem application pipeline with production ready quality. Be able to apply GenAI models as part of the solution. Could also include but not limited to deep learning, neural networks, chatbots, image processing. Must have skills : Large Language Models Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education SUMMARY:We are looking for a technical enthusiast with strong expertise in Python and a solid understanding of AI/ML concepts to contribute to the de...

About The Role Project Role : AI / ML Engineer Project Role Description : Develops applications and systems that utilize AI tools, Cloud AI services, with proper cloud or on-prem application pipeline with production ready quality. Be able to apply GenAI models as part of the solution. Could also include but not limited to deep learning, neural networks, chatbots, image processing. Must have skills : Large Language Models Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education SUMMARY:We are looking for a technical enthusiast with strong expertise in Python and a solid understanding of AI/ML concepts to contribute to the de...

About The Role Project Role : Data Architect Project Role Description : Define the data requirements and structure for the application. Model and design the application data structure, storage and integration. Must have skills : Data Architecture Principles Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :We are looking for a highly experienced and technically proficient Generative AI Data Architect (AWS) with deep expertise in data architecture principles, data modeling techniques and methodologies, and enterprise-scale AI/ML systems. The ideal candidate should have 10-13 years of experience in designing...

About The Role Project Role : Software Development Lead Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : Microsoft Fabric Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Lead, you will develop and configure software systems, either end-to-end or for specific stages of the product lifecycle. Your typical day will involve collaborating with various teams to ensure ...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Palantir Foundry Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Project Role :Lead Data Engineer Project Role Description :Design, build and enhance applications to meet business process and requirements in Palantir foundry.Work experience :Minimum 6 years Must have Skills :Palantir Foundry , PySparkGood to Have Skills : Experience in Pyspark, python and SQL Knowledge on Big Data tools & Technologies Organizational and proj...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Data Engineering Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application features, and ensuring that the applications function seamlessly within the business environment. You will also ...

Job Summary We are seeking an experienced Technical Architect Data Engineering with deep expertise in Snowflake, SQL Server, and modern data architecture principles such as Medallion Architecture and Data Mesh. The ideal candidate will lead the design and implementation of scalable, secure, and high-performance data solutions across multiple sources, enabling enterprise-wide data-driven decision-making. Insurance domain experience is highly preferred. Key Responsibilities Architect and oversee the end-to-end design, development, and deployment of data pipelines using Snowflake and SQL Server. Implement and optimize Medallion Architecture (Bronze, Silver, Gold layers) for structured and semi-...

Role Overview: Join our Data Analytics team at Mercedes-Benz Research and Development India Private Limited in Bangalore and play a key role in developing innovative, data-driven solutions for Aftersales. We are seeking team-oriented, responsible, and passionate professionals who thrive on innovation and can contribute to shaping our Aftersales data strategy. Your primary focus will involve applying intelligent data analysis to generate valuable business insights that directly impact strategic decisions and enhance operational efficiency. If you are enthusiastic about data engineering, decentralized architectures, and building high-impact data products, we are excited to consider you for thi...

Job Description: Data Engineer with deep experience in Microsoft Fabric, including OneLake, Data Warehouse, Dataflows, and Data Factory capabilities. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, integrating diverse data sources, and enabling analytics and reporting using the Microsoft Fabric ecosystem. Key Responsibilities: Design and implement end-to-end data solutions using Microsoft Fabric's unified analytics platform. Develop and maintain data pipelines leveraging OneLake, Dataflows Gen2, and Data Factory pipelines. Build and manage enterprise-grade data warehouse models within Microsoft Fabric. Optimize performance and stora...

About The Role Project Role : Quality Engineer (Tester) Project Role Description : Enables full stack solutions through multi-disciplinary team planning and ecosystem integration to accelerate delivery and drive quality across the application lifecycle. Performs continuous testing for security, API, and regression suite. Creates automation strategy, automated scripts and supports data and environment configuration. Participates in code reviews, monitors, and reports defects to support continuous improvement activities for the end-to-end testing process. Must have skills : Data Warehouse ETL Testing Good to have skills : NA Educational Qualification : 15 years full time education Key responsi...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Snowflake Data Warehouse, Data Engineering Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Snowflake Sr. Data Engineer, you will build scalable, secure, and high-performance Snowflake pipelines across multiple projects and teams. Your typical day will involve collaborating with T...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Snowflake Data Warehouse Good to have skills : Data Engineering, Data Building Tool, Fivetran Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Snowflake Lead, you will build scalable, secure, and high-performance Snowflake pipelines across multiple projects and teams. Your typical day will involve collabo...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Snowflake Data Warehouse Good to have skills : Data Engineering, Data Building Tool, Fivetran Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Snowflake Lead, you will build scalable, secure, and high-performance Snowflake pipelines across multiple projects and teams. Your typical day will involve collabo...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Snowflake Data Warehouse Good to have skills : Data Engineering, Data Building Tool, Fivetran, Gen AI Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Snowflake Lead, you will build scalable, secure, and high-performance Snowflake pipelines across multiple projects and teams. Your typical day will involve...

Data Architect Job Description: We are looking for a highly skilled Data Architect with over 10 years of experience in designing, implementing, and managing large-scale data architecture solutions. The ideal candidate will have deep expertise in data modeling, cloud data platforms (Azure/AWS), and data governance, with a proven ability to architect secure, scalable, and high-performance data ecosystems. Experience: 10+ Years Location: Hyderabad / Remote Key Responsibilities: Design and develop enterprise-grade data architectures to support analytics, AI, and business intelligence initiatives. Create and maintain data models (conceptual, logical, and physical) to align with organizational dat...

Will be responsible for the design development and administration of data management solutions that align with the business needs of the organization. Will also respond to support Operations specially on production tickets and business requests for access and reporting. Overall 5+ years of experience and has at least 2-3 years of experience in Data Engineering especially ADF Python PySpark SparkSql Sql and Databricks programming and cloud data ingestion data pipelines handling structured and semi-structured data formats like JSON XML. Collaborate with internal and external personnel including senior management system architects software developers database administrators design analysts and ...

Responsibilities: * Design, implement & optimize data solutions using BigQuery, Data Build Tool & Python. * Collaborate with cross-functional teams on ETL projects with focus on robustness & data governance. Provident fund

Lumen is seeking a skilled Data Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and maintaining data pipelines and architectures that enable effective data collection and analysis. You will work closely with data analysts and data scientists to ensure that our data infrastructure supports the needs of the business. Your expertise will help enhance our data quality and provide actionable insights that drive strategic decisions. Key Responsibilities: 6-8 years of hands-on experience predominantly in data engineering , ETL/ELT , and modern data platforms such as ( Synapse, Databricks , Big Query). Proven experience in data warehouse migration ...

Experienced Data Engineer with 5+ years of hands-on development using Python (preferred), along with strong proficiency in Scala, Java, or C#. Skilled in designing and building high-performance, scalable data pipelines and architectures. Specialized in working with PySpark on Databricks, and experienced across a range of data engineering tools including Snowflake, BigQuery, Apache Spark, Hive, Hadoop, Cloudera, and Redshift. Key Competencies: Programming & Development: 5+ years of experience developing data-centric applications using Python (preferred), with additional expertise in Scala, Java, or C#. Big Data & Cloud Platforms: Deep experience with cloud-based and on-premise data platforms ...