867 Data Pipeline Jobs - Page 2

Job description 12+ years' of relevant experience, with 3+ years with Snowflake. Snowflake Solution Architect: You are an expert with hands-on solution design and development experience You will be an influencer and thought leader with in-depth technical expertise, credibility, and field experience to establish yourself as a subject-matter expert in a company that is leading innovation within the integration services industry You have a passion for continuous learning You enjoy mentoring and developing the skills of those around you. Job Responsibilities: Lead and Architect migration of data analytics environment to Snowflake with performance and reliability. Assess and understand the ETL jo...

Job Title: Founding Backend Engineer Location: Remote Type: Full-time | Founding Team | Schedule: Evening Shift Regular Shift Why Join Now? This is a rare opportunity to: Join as a founding engineer and shape the architecture, product, and engineering culture from day one. Work on meaningful, high-impact problems that affect millions of people. Help build a modern backend from scratch with clarity, scale, and resilience in mind. Be part of a mission-driven team operating at the intersection of technology, finance, and public policy. What You'll Do As the Founding Backend Engineer, you will: Own and build core backend services and APIs design, implement, and maintain secure, scalable endpoint...

We are looking for a motivated and enthusiastic Trainee Data Engineer to join our Engineering team. This is an excellent opportunity for recent graduates to start their career in data engineering, work with modern technologies, and learn from experienced professionals. The candidate should be eager to learn, curious about data, and willing to contribute to building scalable and reliable data systems. Responsibilities: Understand and align with the values and vision of the organization. Adhere to all company policies and procedures. Support in developing and maintaining data pipelines under supervision. Assist in handling data ingestion, processing, and storage tasks. Learn and contribute to ...

Dear All!!!! Job Title:- Senior Database Developer Mandatory Skills:- 1) Database Develope r , Azure SQL Managed Instance , Stored Procedures, Triggers, Scheduling, Data Migration , Etl Developer, SQL Server, Data Pipeline Must have Microsoft Certified: Azure Data Fundamentals(DP 900) or Azure Database Administrator Associate (DP-300) or equivalent. ****************All Mandatory Skills should be in the projects.******************* Job type:- Contract Work Mode:- Hybrid Interview Mode:- L1 Virtual, --L2 F2F Interview Shift timings:-General N.p:- Immediate to 15 Days Experience:- 6 Years Budget:-19 LPA Location:- Bangalore If Any one are interested Drop me your Cv hemanandana.a@pacific.co.in i...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

Responsibilities: Work closely with product managers to understand customer needs and translate those into technical requirements. • Build and maintain scalable data management and serving infrastructure on cloud, managing terabytes of data and integrating cost. • Design a comprehensive target data architecture vision working closely with product, design and development and NatCo teams to plan transition towards the target vision • Responsible for implementation of architecture concepts in product development and services • Consult and engage with engineering teams to solve problems at their root cause • Create deliverables that provide exceptional clarity and connections to business objecti...

Location - Hyderabad and Gurgaon only. EXP - 6-8 YRS NP - Immediate - 15 Days JD- Job Title: Senior Data Analyst We are looking for a highly skilled and detail-oriented Senior Data Analyst with a strong analytical mindset. This crucial role requires advanced SQL to transform raw data into actionable insights that support strategic decision-making. A deep understanding of business operations is essential. Key Responsibilities: Data Analysis & SQL Proficiency: Collect, clean, and analyze datasets for trends; translate business needs into data solutions; conduct root cause analysis; optimize complex SQL queries; Set up data pipelines and ETL. Cross-functional Collaboration: Collaborate with pro...

About ProcDNA ProcDNA is a global consulting firm. We fuse design thinking with cutting-edge technology to create game-changing Commercial Analytics and Technology solutions for our clients. We're a passionate team of 300+ across 6 offices, all growing and learning together since our launch during the pandemic. Here, you won't be stuck in a cubicle - you'll be out in the open water, shaping the future with brilliant minds. At ProcDNA, innovation isn't just encouraged; it's ingrained in our DNA. Ready to join our epic growth journey? What we are looking for Youll be driving the adoption of the latest technologies in our solutions, bringing in thought leadership to guide clients on complex dat...

World Wide Technology Holding Co, LLC (WWT) is a privately held global technology integrator and supply chain solutions provider. Through our culture of innovation, we inspire, build and deliver business results, from idea to outcome. Based in St. Louis, WWT works closely with industry leaders such as Cisco, VMware, NetApp, Dell EMC, HPE and several others, but also include emerging tech players. WWT employs more than 10,000 people and operates in more than 2 million square feet of state-of-the-art warehousing, distribution and integration space strategically located throughout the world. WWT ranks Glassdoors Best Places to Work and has been on Fortune’s 100 Best Companies to Work For list 1...

Exp required 7+ yrs with data governance informatica tool Key Responsibilities: Data Governance Framework Development : Develop, implement, and maintain data governance frameworks, policies, and standards to ensure high-quality, consistent, and secure data across the organization. Collaborate with business units and stakeholders to define and enforce data governance policies, ensuring alignment with business goals and regulatory requirements. Data Quality Management : Define and enforce data quality standards, monitoring key data quality metrics. Identify, analyze, and resolve data quality issues across various data sources and platforms. Work with cross-functional teams to implement data qu...

Role & responsibilities Required skills and technologies - Extensive Expertise in Azure SQL Managed Instance (SQL MI). - Advanced proficiency in SQL programming and DBMS. - Writing Stored Procedures, Functions,triggers,Indexing. - Experience with database migration tools like Azure Data Factory (ADF). - Strong understanding of ETL processes and data pipelines. - Proven experience in database architecture, design, and ER modeling. - Skilled in performance tuning, query optimization, and batch processing. - Knowledge of data security, backup, recovery, and compliance standards. - Familiarity with database monitoring tools and analysis. - Strong scripting skills (PowerShell, T-SQL, or others). ...

Role : Backend Engineer Location : Hyderabad, India (Hybrid Knowledge City) Experience : 7 - 10 years Employment : Full - Time with Crunchyroll Job Description: We are looking for a highly skilled Backend Engineer with strong expertise in Python and cloud platforms. The role involves building scalable backend services, integrating with distributed systems, and supporting data-driven workflows. Key Responsibilities: Design and develop backend services and APIs using Python. Build and optimize applications for performance, scalability, and reliability. Work with cloud platforms (GCP/AWS) to deploy and manage services. Collaborate with cross-functional teams to deliver high-quality, production-...

Job Title : Senior Data Engineer Job Summary A Sr Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support data collection, transformation, and analysis. They work closely with data scientists, analysts, and business stakeholders to ensure data is accessible, reliable, and optimized for performance. Key responsibilities include developing ETL processes, managing data warehouses and lakes, ensuring data quality, and implementing best practices for data governance and security. Overall having experience between 6 to 10 years of experience in IT and minimum 3+ years experience in cloud. Hands-on in Architecture, Design, Delivery...

7+ Years of expertise required in below skillsets: Data Engineering, Python, SQL, PySpark, Cloud (Any), Airflow, DevOps & Orchestration, Agile, Scrum, Data Pipeline Development, Stakeholder Management, Banking/ Telecom Domain Experience.

Key Responsibilities: Ensure timely delivery of data to stakeholders. Maintain documentation of data sources, processes, and delivery workflows. Extract, transform, and load (ETL) data from various sources. Maintain and optimize data pipelines to ensure smooth data flow. Ensure data integrity by identifying and resolving inconsistencies. Required Skills: Proficiency in SQL (Snowflake), Excel, EmEditor and Python. Proficiency in AWS. Strong analytical and problem-solving skills. Attention to detail and accuracy in data handling. Ability to work with large datasets efficiently. Good communication skills to liaise with technical and non-technical teams. Strong documentation skills for processes...

**Job Description: Principal Data Architect - Principal Architect** **Company:** Happiest Minds **Location:** Bangalore **Experience Required:** 16 - 20 years **About Happiest Minds:** Happiest Minds is a leading digital transformation and technology services company, empowered by the mission of enhancing the happiness of our customers, employees, and society at large. We provide cutting-edge solutions leveraging advanced technologies to drive meaningful outcomes for our clients. **Position Overview:** We are seeking an experienced and highly skilled Principal Data Architect to join our dynamic team. The ideal candidate will possess a solid background in data architecture, data lakes, and ET...

Job role: AWS Data Engineer Location: PAN India Job description Key Responsibilities Design and build data pipelines & Data lakes to automate ingestion of structured and unstructured data that provide fast, optimized, and robust end-to-end solutions Knowledge about the concepts of data lake and dat warehouse Experience working with AWS big data technologies Improve the data quality and reliability of data pipelines through monitoring, validation and failure detection. Deploy and configure components to production environments Technology: Redshift, S3, AWS Glue, Lambda, SQL, PySpark, SQL.

Required Skills and Qualifications 4+ years of professional experience in a data analyst or support-focused role. Expert-level proficiency in Python, with extensive experience in using libraries like Pandas and NumPy for data cleaning, analysis, and troubleshooting. Strong experience with Tableau for dashboard management and updates. Expert-level proficiency in SQL for data extraction and validation. Exceptional communication and problem-solving skills, with a service-oriented mindset. Proven ability to work independently and manage multiple support requests simultaneously

Experience Required : Minimum 7+ Years (Mandatory) Job Type : Full-time | Day Shift (IST) Job Description : We are looking for a skilled and experienced Databricks Engineer to join our team at our Hyderabad (Madhapur) office. The ideal candidate will have a strong background in data engineering, hands-on experience with Databricks, and a solid understanding of cloud platforms (AWS, Azure, or GCP). This is a great opportunity to work on cutting-edge data projects in a collaborative and fast-paced environment. Key Responsibilities : - Design and implement scalable and efficient data pipelines, ETL/ELT processes, and data integration solutions using Databricks. - Work with large-scale structure...

Job Description 4- 5years experience in IT or professional services experience in IT delivery or large-scale IT analytics projects Candidates must have expertise knowledge of Google Cloud Platform; the other cloud platforms are nice to have. Expert knowledge in SQL development. Experience with Apache Beam/Google Dataflow/Apache Spark in creating end to end data pipelines. Experience in some of the following: Python, Hadoop, Spark, SQL, Big Query, Big Table Cloud Storage, Datastore, Spanner, Cloud SQL, Machine Learning. Experience programming in Java, Python, etc. Identify downstream implications of data loads/migration (e.g., data quality, regulatory, etc.) Implement data pipelines to automa...

Own the overall roadmap, and execution for ServiceNow platform, including ITSM, ITOM, CSM, FSM modules Lead the design, implementation, and support of scalable ServiceNow solutions and workflows. Oversee ServiceNow custom development, scripting, debugging, troubleshooting and high-availability deployments. Ensure robust workflow management, business rules, and ServiceNow best practices are adhered to Drive DevOps and automation practices, including Git version control, CI/CD pipelines, and integration of microservices with Kubernetes Lead configuration, customization, and integration of ServiceNow with enterprise applications Optimize performance, scalability, and security of ServiceNow envi...

We are currently seeking an experienced professional to join our team in the role of Senior Software Engineer. In this role, you will: Design and Develop Scalable Data Pipelines: Architect and implement end-to-end data workflows using Apache Airflow for orchestration, integrating multiple data sources and sinks across cloud and on-prem environments. BigQuery Data Modeling and Optimization: Build and optimize data models in Google BigQuery for performance and cost-efficiency, including partitioning, clustering, and materialized views to support analytics and reporting use cases. ETL/ELT Development and Maintenance: Design robust ETL/ELT pipelines to extract, transform, and load structured and...

Job DescriptionKey Responsibilities:- Design, develop, and maintain scalable, efficient, and reliable systems to support GenAI and machine learning-based applications and use cases- Lead the development of data pipelines, architectures, and tools to support data-intensive projects, ensuring high performance, security, and compliance- Collaborate with other stakeholders to integrate AI and ML models into production-ready systems- Work closely with non-backend expert counterparts, such as data scientists and ML engineers, to ensure seamless integration of AI and ML models into backend systems- Ensure high-quality code, following best practices, and adhering to industry standards and company gu...

Design and develop solutions using Bigdata tools and technologies like Bigquery, Hive, Spark etc. Extensive hands-on experience in object-oriented programming using Python, PySpark APIs etc. Experience in building data pipelines for huge volume of data. Experience in designing, implementing, and managing various ETL job execution flows. Experience in implementing and maintaining Data Ingestion process. Hands on experience in writing basic to advance level of optimized queries using HQL, SQL & Spark. Hands on experience in designing, implementing, and maintaining Data Transformation jobs using most efficient tools/technologies. Ensure the performance, quality, and responsiveness of solutions....

Design and develop solutions using Bigdata tools and technologies like Bigquery, Hive, Spark etc. Extensive hands-on experience in object-oriented programming using Python, PySpark APIs etc. Experience in building data pipelines for huge volume of data. Experience in designing, implementing, and managing various ETL job execution flows. Experience in implementing and maintaining Data Ingestion process. Hands on experience in writing basic to advance level of optimized queries using HQL, SQL & Spark. Hands on experience in designing, implementing, and maintaining Data Transformation jobs using most efficient tools/technologies. Ensure the performance, quality, and responsiveness of solutions....