658 Data Engineer Jobs

Experience as a Data Engineer Experience in Databricks Experience in Unity Catalog (Data Governance) Experience in ETL/ELT pipelines using Databricks & PySpark Experience in Python Experience in Apache Spark / Spark Experience in SQL Experience in Azure & AWS Certification in Databricks (Good to have)

As a Techno-functional professional with over 5 years of experience in Data warehousing and BI, you have a strong grasp of Data warehousing and BI concepts. Your expertise lies in designing BI solutions from scratch and implementing Agile Scrum practices such as story slicing, grooming, daily scrum, iteration planning, retrospective, test-driven, and model storming. Additionally, you have hands-on experience in Data Governance and Management and have successfully pitched and implemented BI proposals. **Key Responsibilities:** - Elicit business needs and requirements by understanding user expectations, developing functional requirements, and collaborating with stakeholders to raise clarificat...

Role Overview: If you want to become the Captain of your own Ship, then StratLytics is the place to work at. Everyone here is free to opine and contribute to the intellectual property that we are trying to build. Passion is believed to drive excellence, not just talent. The work environment encourages continuous learning, introspecting, debating, and growing. Office work and business decisions are transparent for everyone to make meaningful contributions. You will experience the pleasure of handling your own Ship and the pressure of delivering on missions simultaneously. If you feel up for this challenge, StratLytics is the place for you. Key Responsibilities: - Architect, develop, and refin...

7+ years of hands-on experience in analytics, BI, or data engineering roles with proven business value delivery. Mastery of Power BI (DAX, data modeling, storytelling) and strong SQL skills. Deep understanding of data pipelines, ETL frameworks, and cloud platforms (Azure preferred). Strong predictive analytics mindset comfort with trend analysis, forecasting, or even basic machine learning techniques. Ability to distill complexity into insights excellent storytelling and data visualization skills. Demonstrated self-leadership, strong work ethic, and ownership mentality. Excellent communication and interpersonal skills able to translate data into business action. Experience with Microsoft Fab...

Qualifications - External To be successful in this role, you should meet the following requirements: 8+ years of hands-on exposure to GCP, Bigquery, Cloud SQL, Dataflow, Cloud Functions, & Pub-sub and DBT Hands-on exposure to SQL. Excellent understanding of Python programming Thorough knowledge of Data Engineering/Transformations, GCP DevOps & CI/CD Pipelines. Should have strong application development experience, coding complex Business Logic. Having Experience of working in a Data Warehouse and Regulatory Reporting project is preferred. Working experience in Banking and Financial Domain. Understanding of Finance technologies with exposure to Basel III is an added advantage.

Job Description: Primary Skills Data engineer + AI/ML +LLM + Azure devops +Blob Minimum experience: • Minimum of 4 years of experience in data management, analysis, and AI data preparation. Must have hands-on: • Build scalable data pipelines and feature stores for AI/ML use cases • Develop CI/CD pipelines for training, deployment, and monitoring of data and ML models • Manage real-time inference pipelines for GenAI / LLM-based applications • Automate retraining, versioning, and drift monitoring processes • Collaborate with data scientists and AI engineers to productionize models • Ensure data quality, lineage, and model governance across all systems • Maintain infrastructure-as-code using Az...

Skill: Data Engineer Experience: 6+ Years Location: Bangalore & Pune Shift Timings: 4:00 PM to 1:00 AM IST Mode: Hybrid Notice Period: Immediate - 15 Days Must-Have Skills: Minimum of 6 years of Data Engineering Experience Must be an expert in SQL, Data lake, Azure, ETL Must be an expert in data modeling Incorta experience is a plus Excellent oral and written communication skills Self-starter with analytical, organizational, and problem-solving skills Must be highly flexible and adaptable to change Power BI Strong programming skills in languages such as SQL, Python Experience with data modelling, data warehousing, and dimensional modelling concept Familiarity with data governance, data secur...

Job Description: 5+ years of overall IT experience, which includes hands on experience in Big Data technologies. Mandatory - Hands on experience in Python and PySpark. Build pySpark applications using Spark Dataframes in Python . Worked on optimizing spark jobs that processes huge volumes of data. Hands on experience in version control tools like Git . Worked on Amazons Analytics services like Amazon EMR, Amazon Athena, AWS Glue. Worked on Amazons Compute services like Amazon Lambda, Amazon EC2 and Amazon Storage service like S3 and few other services like SNS. Good to have knowledge of data warehousing concepts dimensions, facts, schemas-snowflake, star etc. Have worked with columnar storag...

Skill: Data Engineer / Python+SQL Experience: 4+ Years Location: Pan India Notice Period: Immediate - 15 Days JOB SUMMARY: Responsibilities: Python: min 4-5 years of experience. SQL : Min 2-3 Years of experience. Packages: Proficient with Pandas, Numpy, SQLAlchemy, and other database-related packages. Analytical Skills: Strong analytical and problem-solving abilities for troubleshooting and optimizing ETL processes. Data Structures & OOP: Good understanding of data structures and object-oriented programming. SQL & Databases: Proficiency in SQL and experience with databases like Oracle DB and MongoDB. SFTP: Experience working with SFTP using Python. APIs: Familiarity with Restful APIs, Python...

Role : AWS Data Engineer Exp : 5 to 10 Years Location : Hyderabad Mode : Hybrid Job Overview: We are seeking a highly skilled Data Engineer with strong expertise in AWS cloud services and Python programming . The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines, ensuring data availability, quality, and performance across enterprise systems. You will collaborate closely with data analysts, data scientists, and business stakeholders to deliver reliable, high-quality data solutions. Key Responsibilities Design, develop, and maintain ETL/ELT data pipelines using Python and AWS native services (Glue, Lambda, EMR, Step Functions, etc.) Build and ...

We are looking for a highly skilled Data Engineer to join our team, responsible for designing and implementing data pipelines and architectures. The ideal candidate will have a strong background in data engineering and excellent problem-solving skills. Roles and Responsibility Design and implement data pipelines and architectures to support business intelligence and analytics. Develop and maintain large-scale data systems, ensuring scalability, reliability, and performance. Collaborate with cross-functional teams to identify and prioritize project requirements. Ensure data quality and integrity by implementing data validation and testing procedures. Optimize data storage and retrieval proces...

Work closely with clients to understand business needs, design data solutions, and deliver insights through end-to-end data management. Lead project execution, handle communication, documentation, and guide team members throughout. Required Candidate profile Must have hands-on experience with Python, ETL tools (Fivetran, StitchData), databases, and cloud platforms (AWS, GCP, Azure, Snowflake, Databricks). Familiarity with REST/SOAP APIs is essential.

Role 1: Snowflake_ETL_DataEngineer Role 2: SQL, ETL, Snowflake Role 3: snowflake with dbt

Role & responsibilities 4+ years of experience in data engineering, data architecture, data platforms & analytics At least 3+ years of experience with Databricks, PySpark, Python, and SQL. Consulting / customer-facing experience, working with external clients across a variety of industry markets Comfortable writing code in both Python and SQL Proficiency in SQL and experience with data warehousing solutions Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Strong understanding of data modeling, ETL processes, and data architecture principles. Deep experience with distributed computing with Apache Spark and knowledge of Spark runtime int...

As a passionate data analyst at EY, your role will involve transforming data into actionable insights to support decision-making in the global organization focused on pricing and commercial strategy. You will be responsible for business analysis, requirements gathering, data modeling, solution design, and visualization using modern tools. Your ability to maintain and enhance existing analytics solutions, interpret complex datasets, and communicate findings clearly to both technical and non-technical audiences will be crucial. **Key Responsibilities:** - Analyze and interpret structured and unstructured data using statistical and quantitative methods to generate actionable insights and ongoin...

Employment Type: Full Time Location: Bangalore (Work from office 3 days/week) Role: Senior Data Engineer Experience: 8+ Years (Preferred) Key Skills: Snowflake | Databricks | SQL | Spark / PySpark About the Role We are looking for an experienced Senior Data Engineer to join our client, Ness Technologies, in Bangalore. This role involves designing and building modern, scalable data solutions using Snowflake, Databricks, and PySpark, with a strong focus on end-to-end data architecture, performance optimization, and governance. Key Responsibilities 1. Design and implement end-to-end ETL/ELT pipelines using Databricks and Snowflake for structured, semi-structured, and unstructured data. 2. Build...

Job Description :- Python Developer (Airflow & ETL Specialist) Experience: 5+ Years Location: Gurgaon / Remote (as applicable) About the Role We are looking for an experienced Python Developer with strong hands-on experience in Apache Airflow and ETL pipeline development. The ideal candidate will be responsible for designing, building, and maintaining data workflows, ensuring scalability, performance, and reliability of data processing systems. This role requires a deep understanding of data integration, orchestration, and automation within modern cloud or on-prem data ecosystems. Key Responsibilities Design, develop, and maintain ETL workflows and data pipelines using Python and Apache Airf...

Job Title: Senior Data Engineer (AWS Glue / PySpark) Experience: 8+ Years Location: Hyderabad / Chennai Mode of Work: Hybrid (Minimum 2 days from office) Job Description: We are looking for a highly skilled Senior Data Engineer with strong experience in designing and implementing scalable data pipelines using AWS Glue , PySpark , and related AWS services. The ideal candidate will have deep expertise in building real-time and batch ETL solutions, optimizing Spark jobs, and managing data infrastructure on AWS. Key Responsibilities: Design, develop, and maintain ETL pipelines using AWS Glue , PySpark , and Lambda functions. Troubleshoot and resolve Out of Memory (OOM) and performance issues in ...

We are hiring a Data Engineer with strong experience in AWS cloud services, Python, and data pipeline development. The ideal candidate will work on designing scalable data solutions, building ETL pipelines, and collaborating with cross-functional teams to deliver high-quality data products. Key Responsibilities: Design and develop data pipelines using AWS Glue, Lambda, Airflow, and S3. Build dimensional data models and dashboards using Power BI. Implement CI/CD pipelines for automated deployments. Work with APIs, JSON/XML data formats, and data governance practices. Collaborate with data scientists and business teams to deliver insights.

Job Requirements Someone with 3-6 years of experience running medium to large scale production environments Proven programming/scripting skills in at least one of the language (i.e Python, Java, Scala, Javascript ) Experience with any one of the cloud-based services and infrastructure (AWS, GCP, Azure) Proficiency in writing analytical SQL queries. Experience in building analytical tools that utilize data pipelines to provide key actionable insights. Knowledge of big-data tools like Hadoop, Kafka, Spark etc would be a plus. A proactive approach to spotting problems, areas for improvement, and performance bottlenecks

Role & responsibilities Understand underlying business requirements, formulate, design, and execute analytical solutions to support the same. Access and extract data from a variety of sources. Work on ETL pipelines. Manipulate raw data into analysis-ready datasets. Provide proficient problem solving and data analysis, derived from modeling and statistical experience. Develop codes using Big data tech stack. Communicate complex analytical approaches and solutions across various teams. Preferred candidate profile Bachelor's or Master's degree in Computer Science 3-6 years of experience in data architecture and data engineering roles Strong proficiency in Pyspark, Python, SQL , Databricks Exper...

As a Data Engineer at Emerson, you will be supporting the Global BI team for Isolation Valves in migrating to Microsoft Fabric. Your primary role will involve data gathering, modeling, integration, and database design to facilitate efficient data management. You will be responsible for developing and optimizing scalable data models to meet the analytics and reporting needs while leveraging Microsoft Fabric and Azure technologies for high-performance data processing. **Key Responsibilities:** - Collaborate with multi-functional teams, including data analysts, data scientists, and business collaborators, to understand their data requirements and provide effective solutions. - Utilize Fabric La...

Required Skills: Data Engineer, AWS, Spark, Apache Airflow, Kafka, Snowflake, DBT, Flink, CI / CD Pipelines, Apache Iceberg, Glue

Required Skills: Data Engineer, AWS, Snowflake, Airflow, Python, Redshift, Kafka

Position- Data Engineer Experience- 7+ years Location- Navi Mumbai (Hybrid Working) Notice Period- Immediate/15 days/Max 1 Month Relevant Experience Required: 7+ years of experience in Data Engineering. Experience programming skills in both Python and SQL. Experience with infrastructure as code, ideally Terraform and Terragrunt. Experience into Git, GitLab and Docker for building and deploying Responsibilities. INBOX- recruitment@springhr.com