1617 Data Pipelines Jobs - Page 41

As a Data Engineer Intern at our company, you will have the opportunity to kickstart your career in Artificial Intelligence by gaining hands-on experience in building and managing data pipelines that drive AI-driven solutions. You will be located in Gota and expected to work from the office from 10:00 AM to 7:00 PM, Monday to Friday. **Role Overview:** - Collaborate with our AI team to design, build, and optimize data pipelines. - Work on real-world data challenges to ensure smooth data flow and reliability. - Assist in preparing and structuring datasets for machine learning models. - Gain exposure to modern tools, frameworks, and best practices in data engineering. **Key Responsibilities:**...

Role Overview: You are a forward-thinking Product Manager with expertise in AI-native product development, automation, agentic workflows, and self-improving systems. Your main focus will be on owning the vision for AI-powered, autonomous decision-making features across HVAC, energy optimization, and IoT platforms. You will work at the intersection of GenAI, IoT, and intelligent automation, driving end-to-end product ownership from ideation to AI-first experience design, deployment, and delivery. Your responsibilities will include focusing on customer benefits through customer-first product innovation, feature adoption, activation rates, and time to value. Key Responsibilities: - Define the p...

As an Artificial Intelligence Specialist at Gen AI, your role involves driving customer conversations to explore Gen AI opportunities. You will need to understand specific customer requirements and design acceptable Gen AI solution architectures tailored to their needs. Additionally, you will be responsible for creating customer proposals and responding to RFPs. Guiding solution engineers in developing Gen AI POCs and solutions for various industry verticals is also a key aspect of your role. Your proactive approach to problem-solving is vital as you drive topics to resolution with a focus on quality, speed, reliability, and efficiency. Staying updated on the latest technology advancements a...

Role Overview: As a Full Stack Developer at U.S. Pharmacopeial Convention (USP), you will be an integral part of the Digital & Innovation group, contributing to the creation of innovative digital products using cutting-edge cloud technologies. Your role will involve building scalable applications and platforms, ensuring adherence to governance principles and security policies, and actively participating in code reviews, architecture discussions, and agile development processes to maintain high-quality, maintainable, and scalable code. Additionally, you will provide technical guidance and mentorship to junior developers and effectively communicate technical designs and solutions to both techn...

Role Overview: You are a Senior Machine Learning Engineer responsible for designing, developing, and deploying Computer Vision solutions in production environments. Your role involves leading the design, development, and deployment of advanced computer vision systems that automate AI across various operational workflows. You will be accountable for the entire solution lifecycle, from problem scoping to deployment and monitoring, working alongside a team of ML engineers. Key Responsibilities: - Lead the design and deployment of computer vision models for applications such as object detection, tracking, human activity analysis, and visual quality control. - Build and optimize image and video d...

**Job Description:** As a Python Azure Data Factory (ADF) professional, your role involves working with technologies such as Azure Databricks, PySpark, Delta Lake, ETL/ELT, data pipelines, and data lakehouse architecture. **Key Responsibilities:** - **Technical Delivery:** - Develop robust ETL/ELT workflows using Informatica to ingest, transform, and load data into our data warehouse, Azure Synapse Analytics. - Conduct exploratory data analysis (EDA) to validate pipeline outputs and ensure data accuracy. - Ensure data quality by implementing proactive checks and monitoring mechanisms. - Write and optimize complex SQL queries to support analytical and reporting team requirements. - Collaborat...

As an MLOps Engineer, your role will involve designing, implementing, and maintaining scalable machine learning pipelines and infrastructure. You should have a strong understanding of ML lifecycle management, CI/CD for ML models, and cloud platforms to ensure seamless integration between data science and production environments. Key Responsibilities: - Build, deploy, and manage end-to-end ML pipelines from experimentation to production. - Develop and maintain CI/CD workflows for ML models. - Automate training, testing, monitoring, and retraining processes. - Manage model versioning, deployment, and scaling in production environments. - Ensure observability, logging, and monitoring for ML mod...

Role Overview: You should have a Bachelor's degree in computer science or data analytics and a minimum of 2 years of professional software development experience. Your expertise in Python for solving data analytics-related challenges is crucial, along with hands-on experience in data visualization tools like Matplotlib, Tableau, PowerBI, or similar. A solid understanding of data pipelines, analysis workflows, and process automation is necessary. Strong problem-solving skills and the ability to thrive in fast-paced environments are key qualities for this role. Key Responsibilities: - Design, develop, and maintain data analytics tooling to monitor, analyze, and enhance system performance and s...

As a qualified candidate for the role, you should possess the following attributes: Role Overview: You will be proficient in JavaScript and Python, showcasing strong skills in both front-end and back-end development. Your experience with React and Angular, combined with Redux for state management, will enable you to create efficient and dynamic web applications. Additionally, your expertise in Node.js will allow you to build scalable server-side applications, while your knowledge of Serverless architectures will help in the creation of optimized and cost-effective solutions. You should also be familiar with data pipelines and have experience in managing RDBMS for structured data storage and ...

As a Python Developer at Exela, you will be part of a team responsible for designing, developing, testing, and maintaining Python applications and services. Your role will involve working on various aspects such as REST APIs, data pipelines, automation scripts, LLM integration, LangGraph, LangChain, preprocessing, and reporting. Key Responsibilities: - Design, develop, test, and maintain Python applications and services - Work with REST APIs, data pipelines, and automation scripts - Work on LLM integration, LangGraph, LangChain, preprocessing, and reporting - Write clean, maintainable, and efficient code - Conduct unit testing and code reviews - Optimize performance and troubleshoot producti...

As a Solution Architect at Dbiz.AI, you will play a crucial role in designing and implementing scalable, secure, and efficient data architectures for enterprise solutions using AWS. Your expertise in microservices architecture and cloud technologies will be essential in leading the development of AWS-based data ecosystems. You will collaborate with cross-functional teams to align data architecture with business goals, drive the adoption of new tools and methodologies, and provide technical guidance to data engineers and developers. **Key Responsibilities:** - **Data Architecture Design:** - Design and implement scalable, secure, and efficient data architectures for enterprise solutions using...

About the Role: We are seeking a skilled Python Backend Engineer with 3+ years of professional experience to design, build, and optimize backend services powering our AI-driven applications. The ideal candidate will have a solid foundation in backend engineering and exposure to AI/ML workflows. Key Responsibilities: Design, develop, and maintain scalable backend services using Python (FastAPI/Flask/Django) Build and optimize APIs, microservices, and data pipelines Collaborate with AI/ML/UI engineers to integrate models into production Implement best practices in testing, CI/CD, observability, and security Optimize performance, reliability, and cost in cloud environments (AWS/Azure/GCP) Requi...

We are hiring a Senior Data Engineer for a 6-month remote contract position. The ideal candidate is highly skilled in building scalable data pipelines and working within the Azure cloud ecosystem, especially Databricks, ADF, and PySpark. You'll work closely with cross-functional teams to deliver enterprise-level data engineering solutions. #KeyResponsibilities Build scalable ETL pipelines and implement robust data solutions in Azure. Manage and orchestrate workflows using ADF, Databricks, ADLS Gen2, and Key Vaults. Design and maintain secure and efficient data lake architecture. Work with stakeholders to gather data requirements and translate them into technical specs. Implement CI/CD pipeli...

Job Opening: Software Tester (Manual + Automation) Contract Role Position: Software Tester (Manual + Automation) Engagement: Contract (69 Months) Location: Remote Experience Required: 4+ Years Key Responsibilities: Develop and execute test plans, test cases, and regression test suites for ReactJS front-end, Python FastAPI backend, and data pipelines. Perform API testing using Postman, Swagger, and validate backend components (PostgreSQL, MongoDB, Kafka). Conduct UI functional testing for internal dashboards and web platforms. Validate data workflows, including Azure Data Factory and Databricks jobs. Identify, log, and track bugs using JIRA or Azure Boards; coordinate with dev teams for fixes...

We are looking for an experienced Software Developer with 5+ years of expertise in Java or Python for data processing and automation. The ideal candidate should have strong proficiency in Java, Spring, Microservices, and REST API development. Experience with cloud platforms, specifically Google Cloud Platform (GCP), is required. The candidate must have hands-on experience in creating IDE plugins for PyCharm, VS Code, IntelliJ, and web consoles. Additionally, proficiency in Python and data pipeline development is mandatory. The role demands a deep understanding of software development principles, automation, and scalable system design.

Notice Period: Immediate About the role: We are hiring a Senior Snowflake Data Engineer with 10+ years of experience in cloud data warehousing and deep expertise on the Snowflake platform. The ideal candidate should have strong skills in SQL, ETL/ELT, data modeling, and performance tuning, along with a solid understanding of Snowflake architecture, security, and cost optimization. Roles & Responsibilities: Collaborate with data engineers, product owners, and QA teams to translate business needs into efficient Snowflake-based data models and pipelines. Design, build, and optimize data solutions leveraging Snowflake features such as virtual warehouses, data sharing, cloning, and time travel. D...

We are looking for a Senior Data Engineer who will design, build, and maintain scalable data pipelines and ingestion frameworks. The ideal candidate must have experience with DBT, orchestration tools like Airflow or Prefect, and cloud platforms such as AWS. Responsibilities include developing ELT pipelines, optimizing queries, implementing CI/CD, and integrating with AWS services. Strong SQL, Python, and data modeling skills are essential. The role also involves working with real-time and batch processing, ensuring high performance and data integrity.

We are seeking a skilled Big Data Developer with 3+ years of experience to develop, maintain, and optimize large-scale data pipelines using frameworks like Spark, PySpark, and Airflow. The role involves working with SQL, Impala, Hive, and PL/SQL for advanced data transformations and analytics, designing scalable data storage systems, and integrating structured and unstructured data using tools like Sqoop. The ideal candidate will collaborate with cross-functional teams to implement data warehousing strategies and leverage BI tools for insights. Proficiency in Python programming, workflow orchestration with Airflow, and Unix/Linux environments is essential. Location: Remote- Delhi / NCR,Banga...

We are seeking an experienced Azure Data Engineer with 36 years of experience for a 6-month remote contract. The candidate will be responsible for developing and supporting IT solutions using technologies like Azure Data Factory, Azure Databricks, Azure Synapse, Python, PySpark, Teradata, and Snowflake. The role involves designing ETL pipelines, developing Databricks notebooks, handling CI/CD pipelines via Azure DevOps, and working on data warehouse modeling and integration. Strong skills in SQL, data lake storage, and deployment/monitoring are required. Prior experience in Power BI and DP-203 certification is a plus. Location: Delhi NCR,Bangalore,Chennai,Pune,Kolkata,Ahmedabad,Mumbai,Hydera...

Role Overview: As a Research Assistant/Associate/Senior Research Scientist/Post-Doctoral Fellow (Data-Driven Sciences) at our location in Kollam, Kerala, you will be expected to utilize your Bachelor's/Master's/Ph.D. degree in Computer Science, Artificial Intelligence, or Electrical and Computer Engineering. Your strong programming skills in Python and R, proficiency in machine learning and deep learning techniques, and excellent analytical and problem-solving abilities will be crucial for success in this role. Effective communication and teamwork skills are also essential as you collaborate with researchers and contribute to various projects. Key Responsibilities: - Data Analysis and Proces...

As a Senior Data Engineer (Azure MS Fabric) at Srijan Technologies PVT LTD, located in Gurugram, Haryana, India, you will be responsible for designing and developing scalable data pipelines using Microsoft Fabric. Your primary focus will be on developing and optimizing data pipelines, including Fabric Notebooks, Dataflows Gen2, and Lakehouse architecture for both batch and real-time ingestion and transformation. You will collaborate with data architects and engineers to implement governed Lakehouse models in Microsoft Fabric, ensuring data solutions are performant, reusable, and aligned with business needs and compliance standards. Key Responsibilities: - Designing and developing scalable da...

Role Overview: As a Data Scientist at our company, you will play a crucial role in supporting the development and deployment of machine learning models and analytics solutions that enhance decision-making processes throughout the mortgage lifecycle, from acquisition to servicing. Your responsibilities will involve building predictive models, customer segmentation tools, and automation workflows to drive operational efficiency and improve customer outcomes. Collaborating closely with senior data scientists and cross-functional teams, you will be tasked with translating business requirements into well-defined modeling tasks, with opportunities to leverage natural language processing (NLP), sta...

As a highly motivated CDP Analyst with over 3 years of experience in Customer Data Platforms (CDP) and Marketing Automation tools, your expertise lies in Treasure Data CDP, where you have hands-on experience in data integration, audience segmentation, and activation across various marketing channels. Your role will involve managing data pipelines, constructing customer profiles, and assisting marketing teams in delivering personalized customer experiences. Your primary responsibilities will include: - Implementing, configuring, and managing Treasure Data CDP for collecting, unifying, and activating customer data. - Developing and maintaining data pipelines to ingest data from multiple source...

Role Overview: As a Senior Data Engineer with 5 to 8 years of experience and expertise in Azure Synapse and deep Azure data engineering, you will be responsible for designing and implementing data technology and modern data platform solutions within the Azure environment. Your key responsibilities will include collaborating with Data Architects, Presales Architects, and Cloud Engineers to deliver high-quality solutions, mentoring junior team members, and conducting research to stay updated with the latest industry trends. You will also be expected to develop and enforce best practices in data engineering and platform development. Key Responsibilities: - Designing and implementing data techno...

Role Overview: As a Machine Learning Engineer at our growing team, you will be responsible for developing and implementing machine learning models to address real-world challenges and drive business value. You will collaborate closely with data scientists, software engineers, and product managers to create and deploy innovative solutions. Key Responsibilities: - Design, develop, and implement machine learning models for various applications such as predictions, customer churn analysis, and fraud detection. - Collect, clean, and preprocess large datasets for training and evaluation. - Conduct exploratory data analysis and feature engineering to enhance model performance. - Evaluate and select...