1617 Data Pipelines Jobs - Page 46

As a Data Engineer/Analyst, you will be responsible for designing, developing, and maintaining ETL pipelines and data processing workflows. Your role will involve migrating and optimizing legacy data warehouses to the Enterprise Data Platform (EDP). You will work with SQL (Advanced), Databricks, Python, and PowerBI to develop data models, reports, and dashboards. Additionally, performing data analysis to derive actionable insights and support business decision-making will be a key aspect of your responsibilities. You will be required to implement cloud-based data solutions using Azure and AWS. Developing data models and warehouse structures to support scalable analytics will also be part of ...

As a Data Engineer with 3-5 years of experience, you will be responsible for creating data ingestion flows for consumption in Gen AI solutions. Your role will involve designing, developing, and optimizing ETL processes and data pipelines using Azure Data Factory and Azure Databricks. Additionally, you will implement AI-driven data solutions leveraging Azure OpenAI, Prompt Engineering, and Retrieval-Augmented Generation (RAG). You will be expected to develop and maintain Azure Functions for seamless integration and automation, as well as utilize Python and C# for data transformation, integration, and AI model deployment. Managing CI/CD pipelines using Azure DevOps for efficient deployment and...

Role: Lead Data Engineer Location: Hyderabad/Chennai, Remote Experience:8+Years Overview We are looking for a highly skilled Lead Data Engineer with deep hands-on expertise in Azure and Databricks . This is a senior technical role with high expectations. The consultant must be extremely hands-on, technically strong in Azure and Databricks, and capable of delivering high-quality solutions with speed and precision. The ideal candidate is a hands-on problem solver who ensures efficiency in his own work while also helping the wider team become more productive and technically stronger. Key Responsibilities Design, develop, and optimize data pipelines using Azure and Databricks . Hands-on work wit...

As a Senior Technology Manager at our company based in Hyderabad, you will be responsible for overseeing simulation-based projects utilizing cutting-edge technologies such as Unreal Engine, NVIDIA Omniverse, and other 3D simulation tools. Your role will involve leading SaaS product development, deployment, and continuous improvement while effectively managing multiple cross-functional teams and bridging the gap between R&D, engineering, and business requirements. Your key responsibilities will include managing the development and deployment of simulation solutions for enterprise applications, leading teams in building high-fidelity real-time simulations using various 3D platforms, ensuring s...

As a Data Engineer with 7-10 years of experience, you will be responsible for architecting, creating, and maintaining data pipelines and ETL processes in AWS. Your role will involve supporting and optimizing the current desktop data tool set and Excel analysis pipeline to a transformative Cloud-based highly scalable architecture. You will work in an agile environment within a collaborative agile cross-functional product team using Scrum and Kanban methodologies. Collaboration is key in this role, as you will work closely with data science teams and business analysts to refine data requirements for various initiatives and data consumption needs. Additionally, you will be required to educate a...

You will be responsible for designing and implementing Enterprise Data Management systems, with at least 5 years of experience in this field. Your role will involve building integrated systems throughout the entire life-cycle, including analysis, design, testing, implementation, and support. Preferred qualifications for this position include having 12 years of experience in architecting full-scale enterprise solutions with globally distributed teams. Experience with Graph Mining models and Machine Learning applications is highly desired. You should also have expertise in evaluating, standardizing, and promoting data governance tools related to Data Catalog, Reference and Master Data Manageme...

Genpact is a global professional services and solutions firm dedicated to shaping the future through the delivery of outcomes. With over 125,000 employees in more than 30 countries, we are motivated by curiosity, agility, and a commitment to creating lasting value for our clients. Our purpose is driven by the relentless pursuit of a world that works better for people, enabling us to serve and transform leading enterprises, including the Fortune Global 500. We leverage our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. We are currently seeking applications for the position of Manager - Data Science. This role is crucial in support...

You will be responsible for developing and maintaining BI reports and dashboards, writing SQL queries for data extraction, manipulation, and analysis, troubleshooting BI tools, and resolving data-related issues. Additionally, you will support data cleansing and validation efforts. As a Full-Time employee, you are required to hold a Bachelor of Engineering in IT, while a Master's in Computer Science or a related field would be considered an added advantage. To excel in this role, you should possess advanced proficiency in SQL, data warehousing, and ETL processes. Extensive experience with BI tools like Power BI, Tableau, QlikView, or similar is essential. You must have a strong understanding ...

Location: Mumbai (Andheri East) Designation: Data Engineering/Analytics Job Summary: We are looking for a Data Engineer with up to 5 years of experience in ETL processes to lead the migration of MongoDB data to MSSQL. The ideal candidate will design, develop, and optimize data pipelines, ensuring seamless data transformation, integrity, and performance. Key Responsibilities: Design and implement ETL workflows for migrating data from MongoDB to MSSQL. Develop data transformation and cleansing processes to ensure data integrity. Optimize data pipelines for performance, scalability, and reliability. Collaborate with database administrators and business teams to define migration strategies. Work...

Role & responsibilities We are seeking a skilled Data Engineer to join our dynamic team. The Data Engineer will be responsible for designing, developing, and maintaining our data pipelines, integrations, and data warehouse infrastructure. The successful candidate will work closely with data scientists, analysts, and business stakeholders to ensure that our data is accurate, secure, and accessible for all users. Responsibilities Design and build scalable data pipeline architecture that can handle large volumes of data Develop ELT/ETL pipelines to extract, load and transform data from various sources into our data warehouse Optimize and maintain the data infrastructure to ensure high availabil...

About FYNXT FYNXT is transforming the global broking industry with innovative SaaS solutions. We empower brokers worldwide with multi-asset trading platforms, seamless payments, and scalable engagement tools. Our culture blends startup agility with structured execution to shape the future of fintech. The Role Were hiring an Engineering Manager – Data & Platform to lead a high-performing team building our real-time streaming platform and trading infrastructure. You’ll drive architecture decisions, mentor engineers, and build mission-critical systems like PAMM/MAMM, Copy Trading, and Introducing Broker platforms. Key Responsibilities Lead & scale a specialized data/platform engineering team Ar...

Looking for a Database Administrator cum Designer (2–3 yrs) in Ghaziabad. Responsible for designing, implementing, and maintaining SQL/NoSQL databases, optimizing performance, ensuring security, backups, and collaborating with development teams. Required Candidate profile Database design, SQL/NoSQL, performance tuning, query optimization, backup & recovery, high availability, disaster recovery, cloud DBs (Azure), security, ETL, data pipelines, monitoring, automation

The Precision Medicine technology team at Amgen is dedicated to developing Data Searching, Cohort Building, and Knowledge Management tools to provide visibility to Amgen's extensive human datasets, projects, study histories, and scientific findings. The team focuses on managing multiomics data, clinical study subject measurements, images, and specimen inventory data. The PMED capabilities play a crucial role in Amgen's mission to accelerate discovery and speed to market of advanced precision medications. As a Solution and Data Architect, you will be responsible for designing an enterprise analytics and data mastering solution using Databricks and Power BI. This role demands expertise in data...

Building off Oracle's Cloud momentum, a new organization - Oracle Health & AI has been created. The team is dedicated to product development and strategy for Oracle Health, focusing on modernized, automated healthcare. This innovative venture embodies an entrepreneurial spirit, fostering an energetic and creative environment. Your contribution is vital in establishing this organization as a world-class engineering center with a strong emphasis on excellence. Within the overarching Oracle Health & AI organization, the Oracle Digital Assistant (ODA) serves as an Assistant platform enabling developers to craft skills and digital assistants using Conversational AI and Generative AI capabilities ...

You will be responsible for building, optimizing, and maintaining scalable data pipelines and integrations between Python applications and Snowflake's cloud data platform. Your main tasks will include developing and maintaining data pipelines using Python for ETL/ELT processes, writing efficient SQL queries and scripts to process and analyze data in Snowflake, designing, creating, and maintaining Snowflake schemas, tables, views, and stored procedures, implementing and scheduling data jobs using Snowflake Tasks, Streams, and Snowpipe, optimizing Python code and SQL logic for performance and cost-efficiency, as well as participating in code reviews, testing, and documentation of data workflow...

Flexing It is a freelance consulting marketplace that connects freelancers and independent consultants with organizations seeking independent talent. Our client, a global leader in energy management and automation, is currently seeking a Data Engineer to prepare data and make it available in an efficient and optimized format for various data consumers, including BI, analytics, and data science applications. As a Data Engineer, you will work with current technologies such as Apache Spark, Lambda & Step Functions, Glue Data Catalog, and RedShift on the AWS environment. Key Responsibilities: - Design and develop new data ingestion patterns into IntelDS Raw and/or Unified data layers based on th...

As a Staff Engineer at our company, you will play a crucial role in leading the technical direction and hands-on development of our next-generation, agentic AI-first marketing platforms. Your responsibilities will include architecting, building, and shipping products that revolutionize how marketers interact with data, plan campaigns, and make decisions. Your day-to-day tasks will involve building Gen-AI native products, utilizing LLMs, agents, and predictive AI to power platforms. You will also stay hands-on by designing systems, writing code, debugging, and ensuring product excellence. In addition, you will lead a talented team of full stack engineers and mentor them to success. Speed to m...

The world's top banks use Zafin's integrated platform to drive transformative customer value. Powered by an innovative AI-powered architecture, Zafin's platform seamlessly unifies data from across the enterprise to accelerate product and pricing innovation, automate deal management and billing, and create personalized customer offerings that drive expansion and loyalty. Zafin empowers banks to drive sustainable growth, strengthen their market position, and define the future of banking centered around customer value. We are seeking a talented Senior Go Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and maintaining scalable applications usin...

You are applying for the position of Assistant Team Lead at ArcelorMittal's Global Business and Technologies hub in India. As a Reporting Application Maintenance Specialist, your primary responsibility will be to support and maintain enterprise reporting solutions for FIPM business functions. You will play a crucial role in ensuring data availability, report accuracy, and system performance across various platforms like Azure Data Lake, Databricks, Synapse Analytics, and SAP BW. Your efforts will directly contribute to operational visibility, manufacturing efficiency, and supply chain decision-making. Your key responsibilities will include monitoring and maintaining reporting applications an...

As a Data Architect with over 10 years of experience, you will be responsible for leading data-related projects focused on Reporting and Analytics. Your tasks will include designing, building, and maintaining scalable data lakes and data warehouses in the cloud, specifically in GCP (Google Cloud Platform). Your expertise will be crucial in gathering business requirements, analyzing business needs, and defining the BI/DW architecture to support and deliver technical solutions to complex business and technical requirements. You will also play a key role in creating solution prototypes, participating in technology selection, performing Proof of Concepts (POCs), and delivering technical presenta...

Accenture is a global professional services company with leading capabilities in digital, cloud, and security across more than 40 industries. The company offers Strategy and Consulting, Technology and Operations Services, and Accenture Song powered by the world's largest network of Advanced Technology and Intelligent Operations centers. With 699,000 employees serving clients in over 120 countries, Accenture embraces the power of change to create value and shared success for clients, people, shareholders, partners, and communities. As a Data Science Consultant in the Financial Services - Banking practice of Accenture Strategy & Consulting Global Network, based in Mumbai, you will work at the ...

You will be responsible for ensuring data validation and integrity throughout migration and data pipeline workflows. This includes ETL automation testing to validate end-to-end data pipelines. You will be automating workflows in AWS to enhance scalability and improve performance. Additionally, leveraging CICD for continuous testing and deployment of data pipelines will be a key part of your role. A crucial aspect of this position will involve writing complex SQL queries for debugging and data retrieval purposes. You will also need to develop a framework that supports data testing for regression testing. To qualify for this role, you should have experience with ETL testing and data pipelines....

As a Senior Software Data Engineer at Addepar, you will be joining the Data Integrations Team, a crucial part of the Addepar Platform team. The Addepar Platform serves as a comprehensive data fabric, offering a singular source of truth for our product suite. This includes a centralized repository, API-driven data services, integration pipeline, analytics infrastructure, warehousing solutions, and operating tools. Your primary responsibilities will involve collaborating closely with cross-functional teams in an agile environment to develop and deploy scalable data solutions that align with business requirements. You will be building pipelines to support the ingestion, analysis, and enrichment...

As a Data Engineer within YouTube Analytics and Data Science, you will play a key role in designing data pipelines and dimensional data modeling for system integration and implementation using both internal (e.g., Flume) and external stacks (e.g., DataFlow, Spark, etc.). With a Bachelor's degree or equivalent practical experience, along with 5 years of experience in this field, you will be responsible for working with data infrastructure, data models, and coding in various programming languages. In this role, you will have the opportunity to work on a variety of projects within YouTube Analytics and Data Science. You will be part of a community of analytics professionals dedicated to develop...

As a Power BI Analyst, you will be responsible for designing and facilitating Data Analytics, Data Interpretation, and Data Visualization for the relevant Division. Your role will involve integrating key MI data points into SAS/PowerBI to ensure accurate and timely MI for business performance monitoring and customer reporting. This is an exciting opportunity to join a team that is currently designing and implementing its MI Suite. Your key responsibilities will include collaborating with IT and the wider business to evangelize effective data management practices and promote a better understanding of data and analytics. You will work closely with the Senior Data Steward, key business stakehol...