774 Etl Pipelines Jobs - Page 6

Senior Python Developer( Contract to Hire) Experience with l og ingestion, parsing, and processing frameworks (e.g., Logstash alternatives, custom ETL pipelines Hands-on with cloud SDKs (AWS, GCP, Azure) for log retrieval and monitoring automation Experience with streaming data frameworks (Kafka, RabbitMQ, or AWS Kinesis) familiarity with REST APIs, WebSockets, gRPC for integrating ManageEngine alerts/logs Experience in N8N, Quadrant Vector, llama LLM, llamaIndex, Azure AI search & Azure OpenAI) Integration experience (ITSM & Automation) Automate RCA-driven remediation via Ansible playbooks or n8n workflows .

Job description Note: Only candidates who meet the eligibility criteria should apply. Others are kindly requested not to apply. Location: Onsite / Hybrid Experience: 4+ Years Employment Type: Contract/Full-Time Company Description thinQ24 is a Software Development Company based in Chennai, TN, India, founded in 2019. We focus on going beyond limits to turn customers ideas into reality and provide tailored solutions for business growth. Our services include IT Outsourcing, IT Staffing, and Software Development, catering to clients in the USA, UK, and India. About the Role We are looking for talented Data Engineers with 46 years of hands-on experience to join our growing team. The ideal candid...

Job Purpose This position is open with Bajaj Finance Ltd. Duties and Responsibilities Looking for a Senior SQL Developer with 78 years of deep experience in advanced database architecture, SQL and PL/SQL programming, complex query optimization, and hands-on Azure cloud data solutions. This position will involve leadership in Azure-based data pipelines, integration services, and modern data warehousing Required Qualifications and Experience Looking for a Senior SQL Developer with 78 years of deep experience in advanced database architecture, SQL and PL/SQL programming, complex query optimization, and hands-on Azure cloud data solutions. This position will involve leadership in Azure-based dat...

Position: Snowflake Data Engineer Company: Kasmo Technology Location: Bangalore (WFO) Exp: 3+ years About the opportunity We are seeking a highly skilled and experienced Snowflake Developer with a strong background in SQL, Python,and a minimum of 3 years of hands-on experience with Snowflake. The ideal candidate will be a SnowflakeCertified with a proven track record in data warehousing, data modelling, and implementing ETL/ELT pipelinesusing industry-standard tools. Primary Roles & Responsibilities • Design, develop, and optimize data pipelines and ETL/ELT processes in Snowflake.• Develop and optimize complex SQL queries for data extraction, transformation, and reporting.• Write robust Pyth...

Coforge Ltd. is hiring for the position of AWS Data Governance Architect in Pune and Greater Noida. Experience required: 10 to 15 years. This is a full-time role focused on leading the design and implementation of enterprise-grade data governance frameworks on AWS. Ideal candidates are passionate about data integrity, security, and compliance, and thrive in a collaborative, fast-paced environment. Key Responsibilities include:- - Architecting scalable, secure, and auditable data governance solutions on AWS. - Establishing policies for data quality, security, privacy, and compliance across the organization. - Leveraging AWS services such as Glue, Lake Formation, IAM, S3, and Redshift. - Colla...

Role Overview: As a Software Engineer at Meltwater, you will be part of the Platform Engineering team dedicated to combating misinformation at scale. Your role will involve designing, building, and maintaining robust backend systems and data pipelines to support misinformation detection, reporting, and mitigation efforts. Key Responsibilities: - Build and maintain scalable and resilient backend systems using Python and/or JVM-based languages. - Collaborate with cross-functional teams, including data scientists, ML engineers, and product managers. - Design and implement data processing pipelines using tools like Apache Spark and Kafka. - Develop APIs and services for real-time misinformation ...

Job Title: Specialist - Data Engineering Location:? Hybrid-Hyderabad/Mumbai/Pune/Bengaluru/Chennai About The Job We are seeking a seasoned Data Engineer with 4 t o 6 years of experience to work on?and handle enterprise-level projects. The ideal candidate will have strong expertise in SQL, ETL pipelines, Python and experience with AWS cloud-based platform services and other cutting-edge technologies. This role requires experience in CI/CD pipelines and automation tools for data engineering. What You Will Do Design and build data pipelines: Automate the flow of data from various sources to storage systems like data lakes or warehouses Develop ETL/ELT processes: Extract, transform, and load dat...

INTERESTED CANDIDATES SHARE CVS TO VAIJAYANTHI.M@PARAMINFO.COM Exp: 10+ Years Notice: Max 15 Days Location: Pan India (Hybrid - Need to visit nearby Office 2 days per week) Must Required: Programming Proficiency: Strong in Python , with hands-on experience in Pandas, NumPy, SciPy , and data modeling . Machine Learning: Experience with Scikit-learn, TensorFlow, PyTorch , LSTM models , and regression analysis . Optimization: Exposure to PuLP , OR-Tools , SciPy.optimize , and strong understanding of linear/integer programming and constraint modeling . Data Engineering: Experience with SQL & NoSQL , ETL pipelines , and cloud data services on AWS / Azure / GCP . Domain Expertise: Knowledge of sup...

Walk-In Drive Data Engineer (2-5 Years, Azure & AWS) Date & Time: 10th October | 11:00 AM 3:00 PM Venue: The Hive, 24/7, 10th Floor, Prestige Tech Platina 2, Kadubeesanahalli, Marathahalli Outer Ring Road, Bangalore 560087 Location Map: [Insert Link] About the Role We are hiring skilled Data Engineers with 24 years of experience in designing, building, and maintaining scalable data pipelines and architectures using Azure and AWS cloud platforms. Key Responsibilities Design, develop, and optimize scalable ETL/ELT workflows using Azure Data Factory, AWS Glue , or similar tools. Build and maintain data integration solutions between on-premises and cloud systems. Work with data storage and wareh...

Job Role: Senior Data Engineer Location: Hyderabad Experience Required: 5 - 7 years Job Type: Full-Time No of Positions: 01 We are looking for a skilled Data Engineer with a strong background in Oracle Cloud Infrastructure (OCI) and Oracle Data Integration tools . The ideal candidate will have hands-on experience in building, automating, and managing robust Data Warehousing and ETL solutions. Key Responsibilities Design and implement scalable Data Warehouse and Data Lake architectures using Oracle ADW, OCI Object Storage, and Data Catalog. Build and maintain ETL pipelines using Oracle Data Integrator (ODI), OCI Data Integration and Informatica services. Understanding Data Warehousing and Dim...

As a Lead Engineer (ML + Data Engineering) in Gurgaon/Jaipur with 6-8 years of experience, your role involves preparing data for model development, testing, and deployment. You will be responsible for designing machine learning systems and AI software to automate predictive models, ensuring accurate user recommendations, and converting unstructured data into useful information. Your tasks will include solving complex problems with multi-layered data sets, optimizing machine learning libraries, and developing ML algorithms for predictive analysis. - Prepare Data followed by Model development, Model Testing, and Deployment. - Design machine learning systems and self-running AI software for aut...

New feature development Solving the bugs/defects in E1,E2,E3 Deployment and modifying the existing pipeline Adding new methods like filter for specific documents chat, find data strategies, explain schema, document summarization, chunk overlap, anonymization(guardrail), prompt engineering, multi chat at a time, retrieval strategies, Citation display with relevant chunk, storing and deleting the chat history, Cache Implementation Comparison of different embedding model, comparisons of different Azure LLM models Create and test multiple backend FastAPIs Query optimization, Create multiple ETL pipelines, etc.

Role Overview: As a Data Platform Specialist at Siemens Energy, your role involves setting up and monitoring data acquisition systems to ensure seamless and reliable data flow. You will be responsible for communicating professionally with customers regarding data export and transmission, maintaining solid relationships. Additionally, you will manage and enhance the entire data platform, develop dashboards and digital services like Condition Monitoring and Hotline Support, and provide technical support to colleagues. Your contribution to the company-wide development of Siemens Energy's data analysis platform will involve migrating components into a centralized solution to boost efficiency and...

Skills: AWS, Python, ETL Pipelines, Azure, Cloud Data Platforms, SQL, CI/CD, Job Title: Data Engineer (6+ Years Experience) Location: Chennai / Bangalore Notice Period: Immediate to 30 Days Job Description We are seeking an experienced Data Engineer with 6+ years of expertise in designing, building, and optimizing large-scale data pipelines and architectures. The ideal candidate will have strong experience in modern data engineering tools and cloud platforms, with the ability to collaborate closely with data scientists, analysts, and business teams to enable data-driven decision-making. Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines. Build and optimize data sto...

As a Senior AI Engineer, your role involves designing, building, and maintaining scalable AI/ML systems and pipelines. Your responsibilities will include: - Designing, building, and maintaining scalable AI/ML systems and pipelines. - Deploying and serving models efficiently using frameworks like TensorFlow Serving, TorchServe, or custom APIs. - Collaborating with data scientists, MLOps, and product teams to bring models into production. - Optimizing inference latency, memory usage, and model throughput for real-time and batch applications. - Building evaluation frameworks and monitoring tools to ensure model accuracy and stability post-deployment. - Researching and implementing state-of-the-...

What's The Role We're looking for an experienced Customer Success Manager to drive adoption, engagement, and growth across a portfolio of high-value customer accounts. You'll build trusted relationships, act as a strategic advisor, and guide customers throughout their journey from onboarding to long-term success. If you're a proactive, customer-first thinker who enjoys solving problems, connecting technical value to business outcomes, and becoming a true partner to your clients, we'd love to hear from you. What You'll Do Partner with Account teams to manage multiple strategic accounts, helping drive annual recurring revenue and long-term retention. Cultivate strong customer relationships thr...

About the Role We are seeking a Senior Python Developer to lead the development of scalable, high-performance backend systems and data-driven applications. You will work on building robust services, APIs, and data workflows that power real-time and batch applications. This role is ideal for a seasoned developer who thrives on solving complex problems, building reliable software, and working across data and engineering teams. Youll play a key role in designing and developing Python-based systems that interface with big data frameworks, cloud platforms, and analytics tools. Key Responsibilities Design and develop robust Python-based backend services and microservices. Build RESTful APIs and in...

About Trademo Trademo is a Global Supply Chain Intelligence SaaS Company, headquartered in Palo-Alto, US. Trademo collects public and private data on global trade transactions, sanctioned parties, trade tariffs, ESG and other events using its proprietary algorithms.Trademo analyzes and performs advanced data processing on billions of data points (50Tb+) using technologies like Graph Databases, Vector Databases, ElasticSearch, MongoDB, NLP and Machine Learning (LLMs) to build end-to-end visibility on Global Supply Chains. Trademo's vision is to build a single truth on global supply chains to different stakeholders in global supply chains - discover new commerce opportunities, ensure complianc...

Role: Tech Lead Description The Data Engineering Lead is a senior-level position within our Data Engineering team, responsible for spearheading the design, implementation, and optimization of advanced data architectures using Databricks. This role involves leading a team of data engineers, collaborating with business and data analysts, and business stakeholders, and delivering scalable, secure data solutions tailored to the needs of commercial analytics in the pharmaceutical industry. Responsibilities 1. Architecture Design o Develop and maintain scalable data architectures using Databricks, including data lakes, data warehouses, and real-time processing systems. o Create detailed blueprints...

Job description: Expert knowledge in AWS Data Lake implementation and support (S3, Glue,DMS Athena, Lambda, API Gateway, Redshift) Handling of data related activities such as data parsing, cleansing quality definition data pipelines, storage and ETL scripts Experiences in programming language Python/Pyspark/SQL Experience with data migration with hands-on experience Experiences in consuming rest API using various authentication options with in AWS Lambda architecture orchestrate triggers, debug and schedule batch job using a AWS Glue, Lambda and step functions understanding of AWS security features such as IAM roles and policies Exposure to Devops tools AWS certification in AWS is highly pre...

Tezo is a new generation Digital & AI solutions provider, with a history of creating remarkable outcomes for our customers. We bring exceptional experiences using cutting-edge analytics, data proficiency, technology, and digital excellence Role : Data Engineer Location: Hyderabad Experience Level: =4-8 Years 4+ years of experience in Data Engineering / ETL development . Strong SQL skills (advanced joins, window functions, query optimization). Hands-on experience with Azure Data Factory, Azure Synapse, and Azure Data Lake . Strong experience in Python for data manipulation, transformation, and automation (Pandas / PySpark preferred). Experience integrating and processing data from multiple so...

About the opportunity: We are seeking a highly skilled and experienced Snowflake Developer with a strong background in SQL, Python, and a minimum of 3 years of hands-on experience with Snowflake. The ideal candidate will be a Snowflake Certified with a proven track record in data warehousing, data modelling, and implementing ETL/ELT pipelines using industry-standard tools. Primary Roles & Responsibilities • Design, develop, and optimize data pipelines and ETL/ELT processes in Snowflake. • Develop and optimize complex SQL queries for data extraction, transformation, and reporting. • Write robust Python scripts for automation, orchestration, and data transformations. • Migrate data from legacy...

As a Looker developer/Data Analyst with over 5 years of experience, you will play a crucial role in enhancing the user experience of products and dashboards. Your main responsibility will involve collecting, analyzing, and visualizing data to identify trends and patterns for improving the overall user interface. Your primary tasks will include: - Analyzing data to discover insights that enhance the user experience of products and dashboards. - Creating clear and concise data visualizations for easy comprehension by the 3PDC Leadership team and other stakeholders. - Collaborating with the 3PDC analytics manager to implement changes based on data analysis findings. - Staying updated on the lat...

As a Python Developer specializing in AI and Machine Learning, you will be responsible for utilizing a variety of programming languages, tools, and frameworks to develop cutting-edge solutions. Your role will involve working with cloud services, database technologies, data engineering, and workflow automation. Additionally, you will apply AI techniques for advanced data processing and visualization. Key Responsibilities: - Utilize Python, PyTorch, TensorFlow, and other tools to develop AI solutions. - Implement Generative AI & LLM Frameworks such as LangChain, LangSmith, and LlamaIndex. - Work with Cloud Services like MS Azure AI Services and Database & Search Technologies including Chroma D...

Job Title: Software Engineer- Python Role Overview: We are seeking a motivated Python Developer to join our dynamic team. The ideal candidate will have 5-8 years of experience in developing scalable applications and be proficient in Python. You will work on creating, enhancing, and maintaining innovative software solutions while collaborating with cross-functional teams to deliver exceptional results Requirements Key Responsibilities: Design and develop scalable backend services and RESTful APIs using Flask, FastAPI, or Django (DRF). Collaborate with product managers and other developers to define software requirements and mentor Jr developers. Develop robust integration with SQL (PostgreSQL...