1578 Data Pipeline Jobs - Page 23

(Contractual Role) We are seeking a highly skilled Sr. Associate/ Manager - IICS Developer to join our team in Kochi. The ideal candidate will have experience in Informatica IICS, ETL/ELT, Data Pipelines, Data Integration, SQL, AWS, and Azure. Responsibilities Design, develop, and implement data integration solutions using Informatica IICS. Develop and maintain ETL/ELT processes to extract, transform, and load data from various sources. Create and manage data pipelines to integrate data from multiple sources and systems. Collaborate with cross-functional teams to design and implement data integration solutions. Troubleshoot and resolve issues related to data integration and ETL/ELT processes...

Skilled Data Engineer with 0-1 years of relevant experience in SQL, PySpark, ETL, Data Lakes and Azure Tech Stack. Responsibilities 0-1 years of experience in building data Pipelines with Python/PySpark. 0-1 years of experience in Azure ETL stack ( eg. Blog Storage, Data Lake, Data Factory, Synapse). 0-1 years of experience with SQL. Qualifications Excellent verbal and written communication skills. UG: B.Sc in Any Specialization, BCA in Any Specialization, B.Tech/B.E. in Any Specialization. A good internet connection is a must. Azure certifications will be a bonus

SUMMARY Wissen Technology is Hiring for Senior Data Engineer About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia. Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge...

Were Hiring: Data Engineer | Dataiku + SQL Expert Location: Hyderabad | Full-Time | Hybrid Experience: 5+ years We’re looking for a skilled Data Engineer with strong expertise in Dataiku and SQL to design, build, and optimize data pipelines that power analytics and business insights. Key Responsibilities: Develop and maintain robust data pipelines and workflows using Dataiku . Write and optimize complex SQL queries for data extraction, transformation, and analysis. Collaborate with data scientists and business teams to operationalize models and reporting solutions. Ensure data quality, integrity, and performance across systems. Support integration of multiple data sources and automation of E...

Hiring Senior Data Engineer Required Experience: 5-8 years Job Summary: The Senior Data Engineer will lead the design and development of our data pipelines and architecture. This role is central to building and maintaining a robust data infrastructure that enables analytics and business intelligence within the financial domain. Key Responsibilities: Lead the design, construction, and maintenance of scalable and reliable data pipelines. Build and optimize ETL/ELT processes to move and transform large datasets. Architect and manage data warehouses and data lakes. Ensure data quality and integrity across all data systems. Collaborate with data scientists and analysts to understand their data ne...

Role Overview: We are looking for a skilled Data Engineer with hands-on experience in Dataiku and SQL , preferably within the Pharma or Life Sciences domain . The ideal candidate will design, build, and optimize data pipelines to support analytics, reporting, and advanced data science initiatives that drive business insights and regulatory compliance. Key Responsibilities: Design, develop, and maintain ETL/ELT pipelines using Dataiku for large-scale data processing. Integrate data from various sources (clinical, commercial, manufacturing, R&D systems) into unified data models. Write and optimize complex SQL queries for data transformation, validation, and analytics use cases. Collaborate wit...

We are hiring for one of our client company based in bangalore - Position : Senior Apache Spark Expert Experience : 6+ Years Client location: Bangalore Mode of work : Work from Office Mode of Interview : Virtual Qualification: Bachelors degree in computer science, Engineering, or a related field (preferred) Immediate joiners only Job Description Strong knowledge of Spark architecture, able to set up, manage and admin Spark cluster with Kubernetes, Strong on Scala, build efficient ETL and data pipelines. Experience in building end-to-end flows, orchestrate and optimize. Strong experience database RDBMS, SQL, Snowflake.

Job Summary We are seeking a highly skilled Sr. Developer with 8 to 10 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in Azure Data Factory SQL Microsoft Business Intelligence and a background in the Payer domain is advantageous. This role involves developing and optimizing data solutions to enhance business processes and drive efficiency. The position operates during day shifts with no travel required. Responsibilities Develop and implement data solutions using Azure Data Factory SQL Microsoft Business Intelligence to streamline business operations and improve data management. Collaborate with cross-functional teams to gather requirement...

Skill: Pyspark Experience: 6 to 9 years Location: AIA Kochi Responsibilities Develop and maintain scalable data pipelines using Python and PySpark. Collaborate with data engineers and data scientists to understand and fulfill data processing needs. Optimize and troubleshoot existing PySpark applications for performance improvements. Write clean, efficient, and well-documented code following best practices. Participate in design and code reviews. Develop and implement ETL processes to extract, transform, and load data. Ensure data integrity and quality throughout the data lifecycle. Stay current with the latest industry trends and technologies in big data and cloud computing.

Nielsen Sports is looking for Machine Learning Engr (MTS 4) to join our dynamic team and embark on a rewarding career journey. A Machine Learning Engineer is responsible for designing, building, and maintaining systems that use artificial intelligence (AI) and machine learning (ML) algorithms to solve complex problems. 1. Developing and implementing ML algorithms : The Machine Learning Engineer develops and implements machine learning algorithms to solve specific problems, such as natural language processing, computer vision, or predictive modeling. 2. Building data pipelines : The Machine Learning Engineer is responsible for building data pipelines that collect, store, and preprocess data u...

Whats On India Media Pvt. Ltd is looking for Machine Learning Engr (MTS 4) to join our dynamic team and embark on a rewarding career journey. A Machine Learning Engineer is responsible for designing, building, and maintaining systems that use artificial intelligence (AI) and machine learning (ML) algorithms to solve complex problems. 1. Developing and implementing ML algorithms : The Machine Learning Engineer develops and implements machine learning algorithms to solve specific problems, such as natural language processing, computer vision, or predictive modeling. 2. Building data pipelines : The Machine Learning Engineer is responsible for building data pipelines that collect, store, and pr...

Send resumes to manju@nam-it.com Role : Data Engineer with AWS and Snowflake are must Location : Banashankari, Bengaluru ( All 5 Days Onsite) Duration : FTE Need Immediate Joiners or 2 weeks notice candidates. Skills : Strong hands-on UNIX/Shell scripting experience not just basic commands but comfort working directly on servers, SSHing into clusters, handling file operations, and executing CLI-based workflows. Deep expertise in AWS data services (S3, Glue, Lambda, EC2) integrated with Snowflake or Databricks for data lake development. Solid ETL/ELT design background with Python, PySpark, and SQL for transformation and pipeline orchestration. Familiarity with version control (GitHub) and aut...

Overview Azure Data Architect Bangalore Aptean is changing Our ERP solutions are transforming a huge range of global businesses, from food producers to manufacturers In a world of generic enterprise software, we provide targeted solutions that bring together the very best technology and drive greater results With over 4500 employees, 90 different products and a global client base, theres no better time to advance your career at Aptean, Are you ready for whats next, nowWe are! If being part of a dynamic, high growth organization excites you and you are a Senior Data Architect, and eager to learn and grow, then this opportunity is for you! Our fast-paced environment and dynamic global R&D depa...

Position: Snowflake Data Engineer Work Location: Hyderabad/ Bangalore(WFO) Experience : 3+ About the opportunity : We are seeking a highly skilled and experienced Snowflake Developer with a strong background in SQL, Python, and a minimum of 3 years of hands-on experience with Snowflake. The ideal candidate will be a Snowflake Certified with a proven track record in data warehousing, data modelling, and implementing ETL/ELT pipelines using industry-standard tools. Primary Roles & Responsibilities : • Design, develop, and optimize data pipelines and ETL/ELT processes in Snowflake. • Develop and optimize complex SQL queries for data extraction, transformation, and reporting. • Write robust Pyth...

Project Duration 3 months and can get extended. Data Engineer (Databricks experience is mandatory) Exp: 3-8 Years Qualification: B. Tech/B.Sc. (IT) Expertise in Python, PySpark , and Apache Spark for data engineering Strong experience in building and optimizing ETL/data transformation pipelines Proficient in Databricks and Delta Lake storage format (Databricks experience is mandatory) Cloud platforms like AWS (Glue, EMR), Snowflake, Dataiku, Alteryx Skilled in managing large-scale, multi-dimensional datasets and designing scalable data architectures Solid understanding of data modeling and data warehouse concepts (On-Prem & Cloud) Familiar with modern data tools and continually updated on em...

Hi, Hope you are doing well. Please find the below Job description. Kindly share resume along with your LWD or Notice time join and your Current CTC and Expected CTC. Exact area in Bangalore and share it to manju@nam-it.com for immediate Response. Send resumes with details for immediate response to manju@nam-it.com Job Title: Data Lake Delivery Lead (Snowflake/Databricks on AWS) Company: NAM India Pvt. Ltd. Location: Bangalore, India Experience: 1214 Years Employment Type: Full-time Mode: All 5 Days Onsite ( Banashankari 2nd Stage location of work) Need Immediate Joiners only locals to Bangalore only. Required Skills & Experience 1214 years of overall experience in data engineering, analytic...

Responsibilities: * Design, develop & maintain cloud data pipelines using AWS/Azure & Python. * Optimize ETL processes with PySpark, SQL & DataBricks. * Collaborate on data warehouse architecture & implementation.

Job Summary: We are seeking a skilled Data Analyst with 3 to 5 years of experience to join our dynamic team. The successful candidate will be responsible for managing data pipelines, writing Spark-SQL code, and resolving stakeholder inquiries about data. This role requires a strong analytical mindset, excellent problem-solving skills, and the ability to communicate effectively with various stakeholders. Key Responsibilities: Data Pipeline Management: Design, build, and maintain efficient and reliable data pipelines to support business needs. Ensure data quality and integrity throughout the data lifecycle. Spark-SQL Development: Write and optimize Spark-SQL code to process large datasets effi...

We are seeking a talented Python Developer to join our dynamic team. The ideal candidate will have a strong background in data manipulation using Pandas and experience in building high-performance APIs with FastAPI . If you're passionate about technology and eager to contribute to impactful projects, we want to hear from you! Key Responsibilities: Design, develop, and maintain robust APIs using FastAPI . Utilize Pandas for data manipulation, analysis, and transformation. Collaborate with cross-functional teams to gather requirements and deliver solutions. Write clean, maintainable, and efficient code. Conduct code reviews and provide constructive feedback to peers. Troubleshoot and debug app...

Role Overview: You will be a highly motivated Product Manager with a strong interest in investment technologies, quantitative research, and project management to support the Quant research and development functions. As an Associate Product Manager on the Quantitative Product team, your main responsibility will be to partner with quants, technology, and portfolio managers to deliver advanced portfolio optimization and trade-validation tools. You will own project plans, user stories, and release tracks end-to-end to ensure the investment-tech roadmap advances on time and with high quality. The ideal candidate will have a strong project management mindset, experience working with different stak...

Tool required: ETL, Data Warehouse, Data Modeling, SQL, BI, Cloud Services, Python, Scalable Cloud Pipelines Experience - 4.5 Yrs and Above (Hiring Across Levels) What youll do Design/implement complex and scalable enterprise data processing and BI reporting solutions. Design, build, and optimize ETL pipelines or underlying code to enhance data warehouse systems. Work towards optimizing the overall costs incurred due to system infrastructure, operations, change management, etc. Deliver end-to-end data solutions across multiple infrastructures and applications. Coach, mentor, and manage a team of junior associates to help them plan tasks effectively. Demonstrate overall client stakeholder and...

Job Description: As a Data Engineer, you will develop and maintain scalable data transformation and analytics infrastructure using Snowflake, DBT (Data Build Tool) , and modern development practices. You will work closely with data analysts, data scientists, and business stakeholders to deliver high-quality, tested, and documented data models that drive business decision-making. You will also contribute to data model optimization, performance tuning, and data quality improvements. JOB REQUIREMENTS Education and Certifications Bachelor's or master's degree in computer science engineering or a related field Certification in Snowflake is preferred Required Experience 3-5 years of total experien...

SUMMARY Wissen Technology is Hirin g for Data Engineer About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia . Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge tech...

The Data Architect Lead utilizes extensive technical expertise to spearhead the design and implementation of data architecture solutions focused on orchestrating data pipelines, ingestion, transformation, and accessibility within a hybrid-cloud environment. Acting as a liaison between business stakeholders and leadership in our dealer network, this role validates requirements for data process changes and recommends scalable, governance-aligned solutions. The position leads the design, development, maintenance, and testing of cloud solution components and data pipelines to ensure alignment with business strategy and compliance requirements. Key Accountabilities Data Architecture Design Lead a...

2+ Yrs of relevant experience Strong Python programming skills Experience with Generative AI / LLMs Hands-on with LangChain / Hugging Face / OpenAI APIs Knowledge of ML workflows & data pipelines Opportunity to work on cutting-edge AI solutions