1335 Senior Data Engineer Jobs - Page 30

Job Description : Key Responsibilities: Own the end-to-end development of scalable, secure, and high-performance data pipelines using Azure Data Factory. This includes sourcing data from various systems (on-premises and cloud), transforming it efficiently, handling large volumes, and ensuring data integrity across pipelines. Write highly optimized, production-grade SQL queries for complex data transformations, analysis, and reporting. You will work with relational databases (e.g., Azure SQL, SQL Server ) to design schemas, write stored procedures, subqueries, and develop solutions that scale and perform reliably. Build business-focused applications, workflows, and dashboards using #PowerBI, ...

Looking for Immediate Joiners Experience-5+ Years Location-Pune/Kalyani Nagar All About You • 7-10 years of experience in Business Intelligence & Data Warehouse related projects in product or service-based organization • • Experience of working with Databases like Oracle, SQL Server and have strong SQL knowledge and data modeling. • Experience of working on data pipeline tools like NiFi for real time data flow system like Kafka • Experience of working on automation in data flow process in a Big Data environment • Experience of working in Agile teams • Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan • Strong communicatio...

Entity: Technology Job Family Group: IT&S Group Job Description: Job Title - Data Engineer Work location - Pune Let me tell you about the role A data engineer designs, constructs, installs, tests, and maintains highly scalable data management systems. They are responsible for building the infrastructure that allows for the generation, collection, and analysis of large datasets. Key responsibilities include developing, constructing, testing, and maintaining architectures such as databases and large-scale processing systems, ensuring that architectures support data analytics, and preparing data for prescriptive and predictive modeling. Data engineers also develop data set processes for data mo...

Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work® and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS, IoT & Machine Learning space. Our team of 450+ elite software engineers solves hard technical problems while transforming customer ideas into successful products. Requirements Design, develop, and maintain robust and scalable data pipelines that ingest, transform, and load data from various sources into data warehouse Collaborate with bus...

Job Title: Senior AWS Data Engineer Location: Gurgaon / Hyderabad Experience: 1.6 – 6 years About the Role :We are seeking a skilled AWS Data Engineer with strong expertise in data engineering tools and cloud technologies. The ideal candidate should have hands-on experience in Snowflake, Python, and SQL, with exposure to AWS Glue . Candidates with experience in DBT, Redshift, and Lambda will have an added advantage . Key Responsibilitie s:Design, develop, and maintain scalable data pipelines and ETL workflows on AW S.Work extensively wit h Snowfla ke , Pyth on, an d S QL to process, transform, and analyze dat a.Optimize and maintain existing data architectures to ensure high performance and ...

Company Overview Milestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over 25 years, we have a demonstrated history of supporting category-defining enterprise clients that are growing ahead of the market. The company specializes in providing solutions across Application Services and Consulting, Digital Product Engineering, Digital Workplace Services, Private Cloud Services, AI/Automation, and ServiceNow. Milest...

We have a new requisition for the below mentioned role We are seeking a Senior Data Engineer . This role requires a blend of design and implementation expertise. Experience - 12-14 years Key Responsibilities: Design and bootstrap data solutions, including setting up Snowflake for a large, complex conglomerate. Utilize a combination of Pentaho and dbt for for ETL processes Design and implement Role-Based Access Control (RBAC) within the data platform, aligned with the organizational structure. Collaborate with stakeholders to define and execute the overall data strategy. Required Experience & Skills: Proven expertise in Snowflake is essential. Proven expertise in Pentaho and dbt for building ...

Company Description Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create digital marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realise their financial goals and help them to save time and money. We operate across a range of markets, from financial services to healthcare, automotive, Agri finance, insurance, and many more industry segments. We invest in experienced people and new advanced technologies to unlo...

Job Title: Senior Data Engineer (AWS, Python, SQL, Big Data) Experience: 8 – 13 Years Location: Gurgaon Interview Mode: Face-to-Face Drive — 30th August Domain Preference: Financial services industry experience preferred Notice Period: 60 to 90 Days Joining: Immediate joiners will also be considered if available Position Overview We are seeking an experienced Senior Data Engineer with strong expertise in AWS, Python, SQL, and Big Data technologies , along with modern data pipeline development experience. The successful candidate will design, develop, and maintain scalable data engineering solutions, contribute to CI/CD delivery pipelines, and play a key role in analytics and data-driven deve...

As a Senior Data Engineer with 7-12 years of experience, you will be based in Bangalore at Eco world with a hybrid work from office setup. Immediate joiners are preferred for this role. Your primary responsibility will be to work on processing large-scale process data for real-time analytics and ML model consumption. You should possess strong analytical skills to assess, engineer, and optimize data pipelines effectively. In terms of technical skills, you should be proficient in Advanced Python and PySpark. Experience working with cloud platforms such as AWS and Azure is required. Familiarity with frameworks like Lambda, Django, and Express will be beneficial. Knowledge of databases including...

As a Senior Associate in data and analytics engineering at PwC, you will be instrumental in leveraging advanced technologies and techniques to design and develop robust data solutions for our clients. Your role will involve transforming raw data into actionable insights, facilitating informed decision-making, and contributing to business growth. Your primary focus will be on designing and constructing data infrastructure and systems to support efficient data processing and analysis. This includes the development and implementation of data pipelines, data integration, and data transformation solutions to meet the specific needs of our clients. Working at PwC means being part of a dynamic comm...

Location Name: Pune Corporate Office - Mantri Job Purpose The Senior Data Engineer will be responsible for designing, building, and maintaining scalable and efficient data pipelines and architectures for the Enterprise Data Platform. This role will focus on enabling high-quality, reliable, and timely data access for analytics, reporting, and business decision-making. Working closely with business analysts, data scientists, and architects, the Senior Data Engineer will ensure data solutions meet business needs and adhere to best practices and governance standards Duties And Responsibilities Design and implement robust, scalable, and high-performance data pipelines and ETL/ELT processes. Devel...

Job Requirements Job Requirements Role/ Job Title: Senior Data Engineer Business: New Age Function/ Department: Data & Analytics Place of Work: Mumbai/Bangalore Roles & Responsibilities 'Minimum 6 years of Data Engineering experience and 3 years in large scale Data Lake ecosystem Proven expertise in SQL, Spark Python, Scala, Hadoop ecosystem, Have worked on multiple TBs/PBs of data volume from ingestion to consumption Work with business stakeholders to identify and document high impact business problems and potential solutions First-hand experience with the complete software development life cycle including requirement analysis, design, development, deployment, and support Advanced understan...

Company Description OUR STORY Let’s be honest: there are lots of people out there doing what we do. We’re just not convinced they’re doing it right. Businesses are hungry for innovation and opportunity, but not at the cost of their independence. At Ollion, we’ve connected companies and capabilities around the world to help ambitious organizations make the most of their transformation and leave the status quo in the dust. WORKING AT OLLION Innovation is risky. It demands bold steps and big questions, but that’s the price of making change. We’ve got our head in the cloud and two feet on the ground, channeling tech’s endless potential towards a single goal: making a world of difference. And we’...

OUR STORY Let’s be honest: there are lots of people out there doing what we do. We’re just not convinced they’re doing it right. Businesses are hungry for innovation and opportunity, but not at the cost of their independence. At Ollion, we’ve connected companies and capabilities around the world to help ambitious organizations make the most of their transformation and leave the status quo in the dust. WORKING AT OLLION Innovation is risky. It demands bold steps and big questions, but that’s the price of making change. We’ve got our head in the cloud and two feet on the ground, channeling tech’s endless potential towards a single goal: making a world of difference. And we’re building a global...

You should have 6 to 9 years of experience in Data Engineering with a focus on Azure Databricks, Azure Data Factory, Pyspark, and SQL. The work location for this role can be Bengaluru, Pune, Mumbai, Noida, or Gurugram with a notice period of 0 to 15 days. This job is in a Hybrid mode. As a Data Engineer in this role, your key responsibilities will include developing scalable data pipelines using Azure Data Factory (ADF), Databricks, PySpark, and Delta Lake to support ML and AI workloads. You will be optimizing and transforming large datasets for feature engineering, model training, and real-time AI inference. Building and maintaining lakehouse architecture using Azure Data Lake Storage (ADLS...

Our client is a cutting-edge IT services organization dedicated to accelerating digital transformation outcomes for customers. They specialize in advising, integrating, and deploying innovative technologies to enable business agility in today’s fast-paced, hybrid IT environment. Their teams collaborate to transform insights into innovation, overcoming complexity with speed and precision. Job Description: Senior Data Engineer (NoSQL & Distributed Systems) What you will do: Utilize your 7+ years of software development and data engineering experience with a strong focus on NoSQL databases and distributed data systems. Design, deploy, troubleshoot, and optimize technologies such as Apache Cassa...

Company Description NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights—delivered with advanced analytics through state-of-the-art platforms—NIQ delivers the Full View™. NIQ is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world’s population. Job Description Write complex algorithms to get an optimal solution for real time problems Qualitative ...

Job Summary If you are looking for an opportunity in Technology Solutions and Development, Emerson has this exciting role for you! The candidate will be working on MSBI data warehouse & database projects under Data Management & Insights group. He/ She will provide optimum solutions using Microsoft BI tool stack specially SSIS, SSAS, SSRS, Azure Synapse Analytics, ETL, SQL Server programming & Data Marts. He/ She will be responsible for developing solutions in Power BI. Provide prompt support, maintenance, and development to assigned projects and other responsibilities. In this role one needs to interact with customers to understand requirements and provide an optimal solution. This team deli...

Company Description NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights—delivered with advanced analytics through state-of-the-art platforms—NIQ delivers the Full View™. NIQ is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world’s population. Job Description Write complex algorithms to get an optimal solution for real time problems Qualitative ...

About the Company : Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and 1900+ employees, we provide the intimacy of a boutique consultancy with the capabilities of a large IT services firm. Role: Senior Data Engineer Experience: 6 Yrs - 12 Yrs Work Location: Gurugram/Hyderabad Skills: ADF, Azure Databricks, Microsoft Fabric (OneLake, PySpark & SparkSQL, Delta Tables, JSON Processing, API Integration, Medallion Ar...

Job Summary JOB DESCRIPTION If you are looking for an opportunity in Technology Solutions and Development, Emerson has this exciting role for you! The candidate will be working on MSBI data warehouse & database projects under Data Management & Insights group. He/ She will provide optimum solutions using Microsoft BI tool stack specially SSIS, SSAS, SSRS, Azure Synapse Analytics, ETL, SQL Server programming & Data Marts. He/ She will be responsible for developing solutions in Power BI. Provide prompt support, maintenance, and development to assigned projects and other responsibilities. In this role one needs to interact with customers to understand requirements and provide an optimal solution...

Job Summary JOB DESCRIPTION If you are looking for an opportunity in Technology Solutions and Development, Emerson has this exciting role for you! The candidate will be working on MSBI data warehouse & database projects under Data Management & Insights group. He/ She will provide optimum solutions using Microsoft BI tool stack specially SSIS, SSAS, SSRS, Azure Synapse Analytics, ETL, SQL Server programming & Data Marts. He/ She will be responsible for developing solutions in Power BI. Provide prompt support, maintenance, and development to assigned projects and other responsibilities. In this role one needs to interact with customers to understand requirements and provide an optimal solution...

Key Responsibilities: • Architect & Build Scalable Systems: Design and implement petabyte-scale lakehousearchitectures (Apache Iceberg, Delta Lake) to unify data lakes and warehouses. • Real-Time Data Engineering: Develop and optimize streaming pipelines using Kafka, Pulsar,and Flink to process structured/unstructured data with low latency. • High-Performance Applications: Leverage Java to build scalable, high-throughput dataapplications and services. • Modern Data Infrastructure: Leverage modern data warehouses and query engines (Trino, Spark)for sub-second operation and analytics on real-time data. • Database Expertise: Work with RDBMS (PostgreSQL, MySQL, SQL Server) and NoSQL(Cassandra, M...

Job Description As our Senior Data Engineer, you will be a key driver of our data engineering strategy, focusing on the design, implementation, and maintenance of our data infrastructure on Google Cloud Platform (GCP). You will leverage your expertise in GCP services (BigQuery, DataFlow, Pub/Sub, etc.) and related technologies to build and enhance our data pipelines and platforms, ensuring they are scalable, reliable, and adaptable to our evolving needs. Responsibilities Your responsibilities will include : Platform Migration and Modernization: Lead setting up of data in GCP, ensuring data integrity and designing for scalability and performance. Pipeline Development and Enhancement: Design, ...