1326 Senior Data Engineer Jobs - Page 11

Greetings from Inferyx Analytics Pvt Ltd. About the Company: We are a global analytics company, with a mission to empower enterprises to build scalable and robust artificial intelligence & machine learning based applications and solutions. We are a team of data engineers and data scientists helping businesses with actionable intelligence and data-driven decisions. The Inferyx platform is an end to end data and analytics platform that lets you disrupt and accelerate with data. Job Title: Senior Data Engineer Experience: 8+ Years Location : Pune Employment Type: Full-time Job Description: We are looking for a Senior Data Engineer who is responsible for the design and development of scalable da...

Job Overview We are looking for a Sr. Data Engineer to design, build, and optimize scalable data systems for public health analytics. You will define data workflows, layer architecture, and pipelines, ensuring data quality, security, and efficiency while leading a team of engineers. Key Responsibilities Data Architecture & Infrastructure Plan, define, and implement scalable, efficient data architectures, modeling strategies, and workflows to support experimentation, analytics, and product development. Develop and manage real-time and batch processing systems (e.g., Kafka, Flink, RisingWave) to support agile experimentation (A/B testing) and analytics at scale. Strategically anticipate and pl...

As a Senior Data Engineer at our company, you will play a crucial role in designing and implementing scalable data pipelines, productionizing ML workflows, and ensuring system observability. This hands-on role requires strong expertise in Databricks, Spark, AWS, and MLOps. You will work on high-impact projects in a hybrid work environment across multiple locations in India. **Key Responsibilities:** - Build and optimize data pipelines using Databricks and Spark. - Implement MLOps best practices including CI/CD, MLflow/SageMaker, monitoring, and retraining. - Develop and manage cloud-native solutions on AWS. - Design and monitor KPIs for data systems. - Apply data observability practices to e...

Job Description EMPLOYMENT TYPE: Full-Time, Permanent LOCATION: Remote (Pan India) SHIFT TIMINGS: 2.00 pm-11:00 pm IST Budget- As per company standards REPORTING: This position will report to our CEO or any other Lead as assigned by Management. The Senior Data Engineer will be responsible for building and extending our data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys working with big data and building systems from the ground up. You will collaborate with our software engineers, database architects, data analysts, and data scientists to ensure our data...

We are looking for a highly skilled Data Engineer with 4+ years of experience in building scalable data pipelines, transforming large datasets, and working with modern data platforms. The ideal candidate is proficient in Python, SQL, Apache Spark, and Google Cloud Platform (GCP), and demonstrates strong communication and collaboration skills. You will play a key role in designing and developing data engineering solutions that enable data-driven decision-making across the organization. Responsibilities Design, build, and optimize scalable and reliable data pipelines using Python, SQL, and Apache Spark. Develop and maintain data models, ETL/ELT workflows, and data integration solutions on GCP....

Who We Are Zinnia is the leading technology platform for accelerating life and annuities growth. With innovative enterprise solutions and data insights, Zinnia simplifies the experience of buying, selling, and administering insurance products. All of which enables more people to protect their financial futures. Our success is driven by a commitment to three core values: be bold, team up, deliver value – and that we do. Zinnia has over $180 billion in assets under administration, serves 100+ carrier clients, 2500 distributors and partners, and over 2 million policyholders. Who You Are Our data team serves Zinnia through data engineering, data analysis, and data science. Our goal is to help un...

We are seeking an experienced Databricks Full Stack Data Engineer with 5–6 years of industry experience. The ideal candidate will have a proven track record of working on live projects, preferably within the manufacturing or energy sectors. He/she will play a key role in developing and maintaining scalable data solutions using Databricks and related technologies. Key Responsibilities: Develop, and deploy end-to-end data pipelines and solutions on Databricks, integrating with various data sources and systems. Collaborate with cross-functional teams to understand data, and deliver effective BI solutions. Implement data ingestion, transformation, and processing workflows using Spark (PySpark/Sc...

Job Title: Senior Data Engineer – Azure & Databricks Location : Noida (WFO) Skills Required: Digital : Microsoft Azure Experience Range Required: 8 to 10 Years(Rel 7+ yrs) Job Description: Must-Have Lead Back-end development maintenance of Data Quality Product Design and develop Data Pipeline using ADF, Databricks and integrate with other Azure Services Experience in setting up DevOps pipeline Databricks notebooks Python Programming skills. Knowledge of RDMS databases like SQL, Azure SQL Good To have Able to take the lead in debugging and resolving infrastructure and engineering issues Experience in Azure Cloud Build and Automation using ARM template Good Communication Skills

Greetings from Infobeans!! We are hiring Sr BI Engineer (Data Engineer) Exp: 7+ Yrs NP: Immediate Location: Pune Education : Bachelor's or Master Degree in Computer science only PFB the JD Key Responsibilities Architect and maintain scalable, reliable data pipelines for batch and real-time processing. Write high-quality Python code to manipulate and transform large datasets. Implement data modeling, ETL processes, and orchestration frameworks (e.g., Airflow, Prefect). Ensure data quality, consistency, and documentation across systems and stakeholders. Collaborate closely with data analysts, data scientists, and engineering teams to support business needs. Optimize performance of databases an...

Job Title: Lead/Senior Data Engineer Location: Pune Job Type: Full-Time Job Description: We are looking for a Senior Data Engineer with strong expertise in Azure Databricks, PySpark, and distributed computing to develop and optimize scalable ETL pipelines for manufacturing analytics. The role involves working with high-frequency industrial data to enable real-time and batch data processing. Key Responsibilities · Build scalable real-time and batch processing workflows using Azure Databricks, PySpark, and Apache Spark. · Perform data pre-processing, including cleaning, transformation, deduplication, normalization, encoding, and scaling to ensure high-quality input for downstream analytics. · ...

Job Title: Big Data Engineer Location: Pune (Hybrid) Experience - 5-7 YOE Salary Range: ₹35–40 LPA About the Role We are looking for a Big Data Engineer to design, build, and scale high-performance data pipelines that power our products and insights. You’ll be working closely with product managers, architects, and engineering leads to define technical strategies and ensure the availability, reliability, and quality of data across the organization. This is a high-impact individual contributor role with ownership of critical data components and the opportunity to shape our evolving data platform. Key Responsibilities Design, build, and maintain robust data pipelines (batch and streaming) from ...

Years of Exp: 5 to 8 years Notice Period: Immediate Location: Pune Skills:- Data Engineer Python - Must have hands-on in Coding Pyspark/Spark-Must have Data modelling Must have AWS- Must have SQL- Must have experience in writing queries. Must have experience in Data Lake/Lakehouse and open formats such as Iceberg, Hudi, Delta Lake" (remove Parquet) Must have experience in data manipulation libraries in python like Pandas, Polars, DuckDB

Company:A Large Global Organization Key Skills: Pyspark, Azure Synapse, Data Engineering, SAP BW, SQL Roles and Responsibilities: Design, develop, and maintain data pipelines using Azure Synapse Analytics and Azure Data Factory Collaborate with cross-functional teams to gather requirements and implement data solutions Utilize PySpark for data processing and orchestration tasks Ensure data quality and integrity through effective data modeling and ETL/ELT practices Optimize performance and tuning of data processes Document processes and communicate effectively with team members and stakeholders Apply agile methodologies (SCRUM) in project execution Stay updated with the latest trends in data e...

Role Overview: As a Data Engineer at JSW One Platform systems, your role involves designing and building data-centric solutions to generate actionable business insights and enhance analytic capabilities. You will work on ETL/ELT coding, database & architecture design in a cloud environment, and collaborate closely with Data Scientists and Data Visualization developers on solution design. Key Responsibilities: - Co-create detailed application architecture strategy with the teams, aligning it with deliverables - Collaborate to develop strategic direction, systems roadmap, and operational processes by providing technical guidance - Understand business data and processes by working with stakehol...

About us At ExxonMobil, our vision is to lead in energy innovations that advance modern living and a net-zero future. As one of the world’s largest publicly traded energy and chemical companies, we are powered by a unique and diverse workforce fueled by the pride in what we do and what we stand for. The success of our Upstream, Product Solutions and Low Carbon Solutions businesses is the result of the talent, curiosity and drive of our people. They bring solutions every day to optimize our strategy in energy, chemicals, lubricants and lower-emissions technologies. We invite you to bring your ideas to ExxonMobil to help create sustainable solutions that improve quality of life and meet societ...

Senior Data Engineer About Net Zero Insights Net Zero Insights is a leading provider of market intelligence for the Net-Zero Economy, offering comprehensive insights, data, and research to climate innovation professionals worldwide. Our cutting-edge Net0 Platform provides access to thousands of startups/SMEs, deals, investors, market reports, and more, enabling users to discover new innovations, trends, and opportunities in the rapidly evolving world of climate technology. Learn more at: https://netzeroinsights.com/ At Net Zero Insights, our data infrastructure undergoes rapid daily growth due to the substantial volume of valuable information we gather. To sustain the seamless operation of t...

As a Senior Data Engineer at Milestone Technologies, you will play a crucial role in leading data ingestion, transformation, and optimization initiatives using the modern Apache and Azure data stack. Your responsibilities will include: - Building and managing high-volume data pipelines using Spark/Databricks. - Implementing ELT frameworks using Azure Data Factory/Synapse Pipelines. - Optimizing large-scale datasets in Delta/Iceberg formats. - Implementing robust data quality, monitoring, and governance layers. - Collaborating with Data Scientists, Analysts, and Business stakeholders. Your technical stack will involve: - Big Data: Apache Spark, Kafka, Hive, Airflow, Hudi/Iceberg. - Cloud: Azu...

🚀 Urgently Hiring 👨‍💻 Position: Senior Data Engineer 🕒 Experience: Total – 7+ years Relevant – 5+ years 📍 Work Location: Kochi / Trivandrum 📝 Job Type: Full-time, Permanent ✅ Mandatory Skills: ⚡ Spark Optimization 📅 Airflow ☁️ AWS (S3, Glue, Lambda, Step Function) ❄️ Snowflake 📧 Interested Candidates please send your Resume to: 📩 gigin.raj@greenbayit.com 📱 Contact: 8943011666

Required Qualifications 3+ Years professional experience in a data Engineer/analyst role or similar. At least 5+ year of Development experience in ADF V2 . At least 1 years of Experience with Spark (PySpark and other python data libraries), Spark Scala is also fine. At least 1 years of experience in T-SQL, creating complex store procedures, triggers etc. Should have used Azure DevOps extensively as part of projects Should have worked on at least 1 project involving hybrid cloud implementation. Should have worked on Azure Data Bricks, SQL Database, Azure SQL Database, Azure Datawarehouse and should be comfortable with data warehousing concepts. Should have worked on Azure Logic Apps , Azure F...

Job Description Alimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with over 17,000 stores in 31 countries, serving more than 6 million customers each day It is an exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a well-supported cloud-first strategy to unlock the power of data across the company and help teams to discover, value and act on insights from data across the globe. With our strong data pipeline, this position will play a key role partnering with our Technical Development stakeholders to enable analytics for long term success. About The Role We are looking for a Senior Da...

About The Role Grade Level (for internal use): 10 Position Summary Our proprietary software-as-a-service helps automotive dealerships and sales teams better understand and predict exactly which customers are ready to buy, the reasons why, and the key offers and incentives most likely to close the sale. Its micro-marketing engine then delivers the right message at the right time to those customers, ensuring higher conversion rates and a stronger ROI. What You'll Do You will be part of our Data Platform & Product Insights data engineering team. As part of this agile team, you will work in our cloud native environment to Build & support data ingestion and processing pipelines in cloud. This wil...

Job Description: As a Senior Data Engineer at Inferenz, you will play a crucial role in designing, implementing, and optimizing data pipelines and workflows using Apache Airflow. Your responsibilities will include developing incremental and full-load strategies with monitoring, retries, and logging, building scalable data models and transformations in dbt, and developing and maintaining data warehouses in Snowflake. You will ensure data quality, integrity, and reliability through validation frameworks and automated testing, and tune performance through clustering keys, warehouse scaling, materialized views, and query optimization. Additionally, you will monitor job performance, resolve data ...

As a Senior Data Engineer at Beyond Key, you will play a vital role in designing, developing, and optimizing data solutions that facilitate strategic decision-making. You will leverage your expertise in Power BI, Azure Data Factory (ADF), and SSIS to create scalable data architectures and drive interactive analytics solutions. Your contributions will directly impact the company's ability to deliver cutting-edge services to a diverse range of global clients. **Key Responsibilities:** - Design, develop, and maintain interactive Power BI dashboards & reports with advanced DAX, Power Query, and custom visuals. - Develop and automate ETL/ELT pipelines using Azure Data Factory (ADF) and SSIS. - Ar...

Role - Senior Data Engineer Location: Pune, Hyderabad(Hybrid) Experience - 6+ Years Responsibilities · Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation. · Collaborate with product and technology teams to design and validate the capabilities of the data platform · Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability · Provide technical support and usage guidance to the users of our platform’s services. · Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibili...

Responsibilities Indicative years of experience: 3+years Role Description We are seeking a senior data engineer who will develop / maintain new functionalities in Acturial application, mentor junior team members, and ensure high code quality standards across the team. Reporting Relationship This role will report to Delivery Manager / Senior Delivery Manager Key Responsibilities Experience with AWS cloud platform - e.g. AWS CDK, DynamoDB, Amazon Aurora, Lambda, Glue Version control tooling (Git/GitHub actions) Ability to write SQL queries and interpret data models Traditional and NOSQL data stores such as S3 Familiarity with DevOps practices such as CI/CD pipelines, test-driven development, e...