1349 Senior Data Engineer Jobs - Page 49

Job Title: Senior Data Engineer Required Experience: 5+ years We are looking for an experienced Senior Data Engineer to join our team. You will be responsible for large-scale data ingestion, cleaning, and standardization from diverse data sources into Microsoft SQL Server. The ideal candidate will have expertise in creating efficient data pipelines, writing complex stored procedures, and managing ETL processes using SSIS, Azure Data Factory, and Python. Experience with .NET C# is a plus. If you have a passion for working with large volumes of data, optimizing data performance, and working in cloud environments, this role is for you! Key Responsibilities Design, implement, and manage mass dat...

Required Skills and Experience: 3+ years of experience building enterprise-scale, cloud-native applications in AWS . Strong hands-on experience with AWS Glue , PySpark , Lambda , S3 , Athena , and RDS (Aurora/Postgres) . Proven experience in building secure REST APIs , including token-based security, API Gateway configuration, and monitoring. Experience working in event-driven and domain-driven architectures . Deep knowledge of SQL Server and experience translating complex stored procedures to AWS Glue. Expertise in designing modular, fault-tolerant Glue workflows using Step Functions . Proficient in Python and developing reusable code libraries for data processing tasks. Strong understandin...

Brief Description The Cloud Data Engineer will play a critical implementation role on the Data Engineering and Data Products team and be responsible for data pipeline solutions design and development, troubleshooting, and optimization tuning on the next generation data and analytics platform being developed with leading edge big data technologies in a highly secure cloud infrastructure. The Cloud Data Engineer will serve as a liaison to platform user groups ensuring successful implementation of capabilities on the new platform. Data Engineer Responsibilities : Deliver end-to-end data and analytics capabilities, including data ingest, data transformation, data science, and data visualization ...

Google BigQuery, Apache Airflow Must Have 3 Cloud Platforms GCP (primary), AWS (optional), GCS/S3 Must Have 4 ETL & Pipelines ETL/ELT concepts, scalable pipeline design, automation, DAG scheduling using Airflow Must Have 5 Programming & Querying Python, Web API Development Must Have 6 Data Integration & Migration Salesforce, MySQL, SQL Server, SFTP, SharePoint, Email integrations Must Have 7 Data Security & Encryption End-to-end encryption, secure data exports/imports Must Have 8 Version Control & CI/CD GitLab, Bitbucket, CI/CD pipelines Good to Have 9 Business Intelligence Tools DOMO, Looker, Tableau Good to Have 10 Object-Oriented & Java Basics Basic OOP concepts, Java familiarity Good to ...

Job Family Data Science & Analysis (India) Travel Required None Clearance Required None What You Will Do Design, develop, and maintain robust, scalable, and efficient data pipelines and ETL/ELT processes. Lead and execute data engineering projects from inception to completion, ensuring timely delivery and high quality. Build and optimize data architectures for operational and analytical purposes. Collaborate with cross-functional teams to gather and define data requirements. Implement data quality, data governance, and data security practices. Manage and optimize cloud-based data platforms ( Azure\AWS). Develop and maintain Python/PySpark libraries for data ingestion, Processing and integrat...

About Gameskraft - Established in 2017, Gameskraft has become one of India’s fastest-growing companies. We are building the world's most-loved online gaming ecosystem - one game at a time. Started by a group of passionate gamers, we have grown from a small team of five members to a large family of 600+ Krafters, working out of our office in Prestige Tech Park, Bangalore. Our short-term success lies in the fact that we strive to focus on building a safe, secure,and responsible gaming environment for everyone. Our vision is to create unmatched experiences every day, everywhere. We set the highest benchmarks in the industry in terms of design, technology, and intuitiveness. We are also the indu...

We are on a mission to rid the world of bad customer service by “mobilizing” the way help is delivered. Today’s consumers want an always-available customer service experience that leaves them feeling valued and respected. Helpshift helps B2B brands deliver this modern customer service experience through a mobile-first approach. We have changed how conversations take place, moving the conversation away from a slow, outdated email and desktop experience to an in-app chat experience that allows users to interact with brands in their own time. Through our market-leading AI-powered chatbots and automation, we help brands deliver instant and rapid resolutions. Because agents play a key role in del...

Looking for Immediate Joiners. We are primarily looking for a candidate as soon as possible with strong proficiency in the following areas: SQL, PL/SQL, and Oracle Query Development – Solid hands-on experience in writing efficient and optimized queries for both Oracle and SQL Server databases. DAX and MDX – Good proficiency in writing DAX (Data Analysis Expressions) for Power BI and MDX (Multidimensional Expressions) for SSAS. ETL & Reporting using MSBI Stack – Experience in developing, deploying, and maintaining solutions using: SSIS (SQL Server Integration Services) SSAS (SQL Server Analysis Services) SSRS (SQL Server Reporting Services) Power BI The candidate should be capable of integrat...

For over 30 years, Beghou Consulting has been a trusted adviser to life science firms. We combine our strategic consulting services with proprietary technology to develop custom, data-driven solutions that allow life sciences companies to take their commercial operations to new heights. We are dedicated to client service and offer a full suite of consulting and technology services, all rooted in advanced analytics, to enhance commercial operations and boost sales performance. Purpose of Job You will be responsible and accountable for development and maintenance of data pipelines. You will work with the business team in US for gathering requirements and provide efficient solutions to business...

Greetings from TCS!! TCS is Hiring for Data Insights Engineer - Qlik Sense Interview Mode: Virtual Required Experience: 6-15 years Work location: PAN INDIA Must have: Experience in Business Intelligence and Data Analytics. 3+ years of hands-on development experience with Qlik Sense (QlikView experience is a plus). Expertise in Qlik scripting, data modelling, section access, and performance tuning. Proficient in SQL and working with large datasets across various databases. Experience with NPrinting, Qlik Sense Extensions, or mashups is a plus. Key Responsibilities: Design and develop advanced dashboards and visualizations using Qlik Sense to support business decision-making. Build scalable an...

Key Responsibilities • Design and implement streaming data pipelines integrating Kafka with Databricks using Structured Streaming. • Architect and maintain Medallion Architecture with well-defined Bronze, Silver, and Gold layers. • Implement efficient ingestion using Databricks Autoloader for high-throughput data loads. • Work with large volumes of structured and unstructured data, ensuring high availability and performance. • Apply performance tuning techniques such as partitioning, caching, and cluster resource optimization. • Collaborate with cross-functional teams (data scientists, analysts, business users) to build robust data solutions. • Establish best practices for code versioning, d...

Experience Required: 4+ Years Key Responsibility: Design, build, and maintain scalable and reliable data pipelines on Databricks, Snowflake, or equivalent cloud platforms. Ingest and process structured, semi-structured, and unstructured data from a variety of sources including APIs, RDBMS, and file systems. Perform data wrangling, cleansing, transformation, and enrichment using PySpark, Pandas, NumPy, or similar libraries. Optimize and manage large-scale data workflows for performance, scalability, and cost-efficiency. Write and optimize complex SQL queries for transformation, extraction, and reporting. Design and implement efficient data models and database schemas with appropriate partitio...

Job Title: Senior Data Engineer Experience Required: 6 - 10 Years Location: Gurugram/Pune/Bangalore Notice Period: Immediate to 30 Days Job Description As a key member of the Digital and Technology Solutions (DTS) team, the Senior Data Engineer will work closely with a leading global hedge fund on data-related projects. The role involves collaboration with the data strategy and sourcing team to gather requirements, design data pipelines, and ensure efficient data delivery. The position requires strong coding skills in Python and SQL, including core programming and data manipulation; hands-on experience with cloud native platforms; and solid expertise in core data engineering concepts. Respon...

UWorld is a worldwide leader in online test prep for college entrance, undergraduate, graduate, and professional licensing exams throughout the United States. Since 2003, over 2 million students have trusted us to help them prepare for high-stakes examinations. We are seeking a Senior Data Engineer who is passionate about creating an excellent user experience and enjoys taking on new challenges. The Data Engineer will be responsible for the design, development, testing, deployment, and support of our Data Analytics and the Data warehouse platform . Requirement Minimum Experience: Master's/bachelor’s degree in computer science or a related field. 6+ years of experience as a Data Engineer with...

We are looking for a strong Data Engineer with DATA ANALYSIS/PROFILING SKILLS for our Enterprise Data Organization to develop and manage data pipelines (data ingestion, transformation, storage etc.) for an Azure/Snowflake cloud-based data analytics platform. The candidate will possess strong technical, analytical, programming, and critical thinking skills. The ideal candidate will have good experience with data transformation, data modeling, master data management, and metadata management. The candidate must also have excellent communication skills; leadership skills will be a plus. This is key to this role as the candidate will be will working closely with senior leadership, product team an...

Organization: At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things. Job Title: Sr Data Engineering Location: Bangalore Business & Team: Technology Team is responsible for the world leading application of technology and operations across every aspect of CommBank, from innovative product platforms for our cu...

Overview Working at Atlassian Atlassians can choose where they work – whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity. Interviews and onboarding are conducted virtually, a part of being a distributed-first company. Responsibilities Team: Core Engineering Reliability Team Collaborate with engineering and TPM leaders, developers, and process engineers to create data solutions that extract actionable insights from incident and post-incident management data, supporting objectives of incident prevention and reducing...

Role: Senior Data Engineer Location: Indore Job Description: Build and maintain data pipelines for ingesting and processing structured and unstructured data. Ensure data accuracy and quality through validation checks and sanity reports. Improve data infrastructure by automating manual processes and scaling systems. Support internal teams (Product, Delivery, Onboarding) with data issues and solutions. Analyze data trends and provide insights to inform key business decisions. Collaborate with program managers to resolve data issues and maintain clear documentation. Must-Have Skills: Proficiency in SQL, Python (Pandas, NumPy), and R Experience with ETL tools (e.g., Apache NiFi, Talend, AWS Glue...

Job Title: Senior Data Engineer (Remote) Location: Remote Employment Type: Full-Time Experience Level: Senior (5+ years) About the Role We are seeking a highly skilled Senior Data Engineer to join our growing data team. As a key contributor, you will design and build robust, scalable data pipelines and systems that power analytics and decision-making across the organization. You will work closely with data scientists, analysts, and product teams to ensure data accuracy, availability, and performance. Key Responsibilities Design, build, and maintain scalable and reliable ETL/ELT data pipelines using Python and SQL. Develop and manage data infrastructure and workflows on AWS (e.g., S3, Lambda,...

Ninja Van is a late-stage logtech startup that is disrupting a massive industry with innovation and cutting edge technology. Launched 2014 in Singapore, we have grown rapidly to become one of Southeast Asia's largest and fastest-growing express logistics companies. Since our inception, we’ve delivered to 100 million different customers across the region with added predictability, flexibility and convenience. Join us in our mission to connect shippers and shoppers across Southeast Asia to a world of new possibilities. More About Us We process 250 million API requests and 3TB of data every day. We deliver more than 2 million parcels every day. 100% network coverage with 2600+ hubs and stations...

About Us Yubi stands for ubiquitous. But Yubi will also stand for transparency, collaboration, and the power of possibility. From being a disruptor in India’s debt market to marching towards global corporate markets from one product to one holistic product suite with seven products Yubi is the place to unleash potential. Freedom, not fear. Avenues, not roadblocks. Opportunity, not obstacles. About YUBI Yubi, formerly known as CredAvenue, is re-defining global debt markets by freeing the flow of finance between borrowers, lenders, and investors. We are the world's possibility platform for the discovery, investment, fulfilment, and collection of any debt solution. At Yubi, opportunities are pl...

About the Role In this opportunity, as Senior Data Engineer, you will: Develop and maintain data solutions using resources such as dbt, Alteryx, and Python. Design and optimize data pipelines, ensuring efficient data flow and processing. Work extensively with databases, SQL, and various data formats including JSON, XML, and CSV. Tune and optimize queries to enhance performance and reliability. Develop high-quality code in SQL, dbt, and Python, adhering to best practices. Understand and implement data automation and API integrations. Leverage AI capabilities to enhance data engineering practices. Understand integration points related to upstream and downstream requirements. Proactively manage...

Job Category: Product & Solutions Denodo is a leader in data management. The award-winning Denodo Platform is the leading data integration, management, and delivery platform using a logical approach to enable self- service BI, data science, hybrid/multi-cloud data integration, and enterprise data services. Realizing more than 400% ROI and millions of dollars in benefits, Denodo’s large enterprise and mid-market customers across 30+ industries have received payback in less than 6 months. For more information, visit www.denodo.com. We are a fast-growing, international organization with teams across four continents and we work with a cutting-edge technology, but that's not all we have to offer....

Position Summary The Senior Data Engineer leads complex data engineering projects working on designing data architectures that align with business requirements This role focuses on optimizing data workflows managing data pipelines and ensuring the smooth operation of data systems Minimum Qualifications 8 Years overall IT experience with minimum 5 years of work experience in below tech skills Tech Skill Strong experience in Python Scripting and PySpark for data processing Proficiency in SQL dealing with big data over Informatica ETL Proven experience in Data quality and data optimization of data lake in Iceberg format with strong understanding of architecture Experience in AWS Glue jobs Exper...

We are looking for a Data Engineer SDE-3 who can take ownership of designing, developing, and maintaining scalable and reliable data pipelines. You will play a critical role in shaping the data infrastructure that powers business insights, product intelligence, and scalable learning platforms at PW. Roles Open: Data Engineer SDE-2 and Data Engineer SDE-3 Location: Noida & Bangalore Key Responsibilities: Design and implement scalable, efficient ETL/ELT pipelines to ingest, transform, and process data from multiple sources. Architect and maintain robust data lake and warehouse solutions, aligning with business and analytical needs. Own the development and optimization of distributed data proce...