3201 Data Pipelines Jobs - Page 49

Design, develop, and maintain data pipelines and ETL processes using AWS and Snowflake Implement data transformation workflows using DBT (Data Build Tool) Write efficient, reusable, and reliable code in Python Optimize and tune data solutions for performance and scalability Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions Ensure data quality and integrity through rigorous testing and validation Stay updated with the latest industry trends and technologies in data engineering Bachelor's or Master's degree in Computer Science, Engineering, or a related field Proven experience as a Data Engineer or similar role Strong profi...

About the Role We are seeking a highly experienced MarTech Solution Architect to lead the design, implementation, and optimization of marketing technology solutions that enable seamless customer engagement and data-driven marketing strategies. The ideal candidate is both a strategic technology leader and a hands-on architect , capable of translating business objectives into scalable, integrated MarTech ecosystems. Key Responsibilities Architect and Design: Develop scalable, secure, and high-performance MarTech solutions integrating CRM, CDP, Marketing Automation, Analytics, CMS, and Data Platforms. Solution Leadership: Partner with marketing, sales, and IT stakeholders to define end-to-end m...

We are looking for a skilled Senior Data Engineer with 5-8 years of experience to join our team in Bangalore. The ideal candidate will have expertise in SQL, Python, PySpark, and experience with cloud platforms such as Snowflake or AWS. Roles and Responsibility Design and develop large-scale data pipelines using SQL, Python, and PySpark. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain complex data architectures and systems. Ensure data quality and integrity by implementing robust testing and validation procedures. Optimize data processing workflows for improved performance and efficiency. Participate in code reviews and contribute...

We are looking for a skilled Data Engineer with 6-9 years of experience to join our team in Pune and Bangalore. The ideal candidate will have expertise in Snowflake, ETL, and data engineering. Roles and Responsibility Design, develop, and implement data pipelines using Snowflake and ETL tools. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems, ensuring scalability and performance. Troubleshoot and resolve complex technical issues related to data engineering. Implement data quality checks and ensure data integrity. Optimize data processing workflows for improved efficiency. Job Requirements Strong knowledge o...

We are looking for a skilled Big Data Engineer with 6 to 22 years of experience. The ideal candidate will have expertise in Pyspark, Azure Data Bricks, and workflows. This position is available as a contract role across Pan India. Roles and Responsibility Design and develop scalable big data systems using Pyspark and Azure Data Bricks. Implement and manage workflows for efficient data processing. Collaborate with cross-functional teams to integrate data from various sources. Develop and maintain large-scale data pipelines and architectures. Optimize system performance and troubleshoot issues. Ensure data quality and integrity through data validation and testing procedures. Job Requirements S...

General Summary: Minimum Experience: 2+ years in software development Role Overview We are looking for a seasoned Software developer with 2-5 years experience in designing, developing, deploying, and scaling software platforms in the realm of Electronic Design Automation (EDA). You will work in cutting-edge initiatives that fuse Machine Learning with semiconductor design, driving robust systems that transform chip development workflows. Minimum Qualifications: Bachelor's degree in Computer Science, Engineering, Information Systems, or related field. Key Responsibilities Design and develop end-to-end ML-integrated software platforms built for scale, performance, and adaptability. Strong softw...

About Us: At THE AI SCHOOL, we are driven by a singular vision: to create a future where the youth are empowered, startups thrive, and innovation flourishes. Through our comprehensive approach to skill development, startup support, and academic collaboration, we are committed to making a lasting impact on the lives of individuals and the world around us. For more details visit us on: https://theaischool.co/ Job Details Job Title: Market Research Intern (AI Data Handling) Location: Hitech City, Hyderabad, (work from office) Qualification: MBA in Marketing Experience: 02 years About the Role We are looking for a proactive and detail-oriented Market Research Intern to support our research initi...

Job Description: This role, part of the Digital Intelligence team, offers opportunity in the financial services industry by developing impactful Machine Learning solutions As aData Scientist Lead within the team at JPMorgan, you will collaborate with all lines of business and functions to deliver software solutions. You will have opportunity to research, experiment, develop, and productionize high-quality machine learning models, services, and platforms to make a significant business impact. You will also design and implement highly scalable and reliable data processing pipelines and perform analysis and insights to promote and optimize business results. Job responsibilities Design, deploy a...

Job Summary Join our dynamic team as a Data Scientist where you will leverage your extensive experience in Python to drive data-driven decisions and insights. With a hybrid work model and day shifts you will collaborate with cross-functional teams to enhance our data analytics capabilities. Your contributions will play a crucial role in shaping our companys future and making a positive impact on society. Responsibilities Analyze complex datasets to identify patterns and trends that can inform strategic business decisions. Develop predictive models and algorithms to enhance decision-making processes. Collaborate with stakeholders to understand their data needs and provide actionable insights....

Job Title: AI & Data Science Trainer cum Developer Company: Advaitecs Private Limited Location: Vijayawada / Vizag, Andhra Pradesh Experience: 03 Years Compensation: ?1.8 4.8 LPA Employment Type: Full-time, Permanent Role Overview We are seeking for a dedicated and knowledgeable AI & Data Science Trainer cum Developer to design and deliver high-quality training programs in Artificial Intelligence and Data Science. The ideal candidate should possess strong technical expertise, effective communication skills and a passion for mentoring students and professionals. Key Responsibilities Conduct structured training sessions on AI tools. Facilitate hands-on workshops and project-based learning expe...

P-375 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers and customer obsessed we leap at every opportunity to tackle technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started. As a Staff Software Engineer working on the Data Plat...

Overview Microsoft Advertising is a rapid-growing business powering global advertisers across search, display, and emerging AI-driven channels. Our CRM team builds next-generation customer relationship management solutions that unify advertiser data, enable intelligent workflows, and deliver actionable insights across sales, marketing, and service. We are seeking a Principal Technical Program Manager (TPM) to lead execution for our Advertising CRM initiatives. This role spans the full advertiser lifecyclefrom sales handoff and onboarding through activation and ongoing engagement. You will work closely with Product Managers, Engineering Managers, and Software Engineers to turn product require...

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Power BI Developer to join our team in Bengaluru, Karntaka (IN-KA), India (IN). 5+ to 8 years of experience in power BI with Strong understanding of Power BI architecture, data modeling, and visualization Proficient in DAX, Power Query, and M language Experience with data warehousing and business intelligence concepts Strong analytical and problem-solving skills Design and develop Power BI reports, dashboards, and data models Develop and maintain data pipelines using Po...

Immediate Job Openings on #SAP Data Intelligence_ Pan India_ Contract Experience : 5 +Years Job Description : Skill Mandatory SAP Data Intelligence with data transfer to SAP and Non SAP systems Yes Able to manage data pipelines for Integration, data preparation, processing and orchestration Yes SAP system S/4, SLT, ABAP, CDC Views Good To have

Primary Skills - Snowflake, DBT, AWS; Good to have Skills - Fivetran (HVR), Python Responsibilities: Design, develop, and maintain data pipelines using Snowflake, DBT, and AWS Collaborate with cross-functional teams to understand data requirements and deliver solutions Optimize and troubleshoot existing data workflows to ensure efficiency and reliability Implement best practices for data management and governance Stay updated with the latest industry trends and technologies to continuously improve our data infrastructure Required Skills: Proficiency in Snowflake, DBT, and AWS Experience with data modeling, ETL processes, and data warehousing Strong problem-solving skills and attention to det...

Must have 5+ year of Experience Data Engineer ensuring the smooth functioning of our applications and data systems. Your expertise in Data Ingestion, Release Management, Monitorization, Incident Review, Databricks, Azure Cloud, and Data Analysis will be instrumental in maintaining the reliability, availability, and performance of our applications and data pipelines. You will collaborate closely with cross-functional teams to support application deployments, monitor system health, analyze data, and provide timely resolutions to incidents. The ideal candidate should have a strong background in Azure DevOps, Azure Cloud specially ADF, Databricks, and AWS Cloud. List of Key Responsibilities: Imp...

Primary : Collibra , with experience in dealing with RDBMS data bases like Oracle, Postgres SQL. Secondary : Experience in Azure PaaS services with the ability to integrate Collibra DQ workflows with Azure data pipelines, using APIs and batch jobs.

We are seeking an experienced Senior Data Engineer to design, develop, and optimize robust data ingestion and transformation pipelines using Azure Cloud services and GSK data platform tools. The ideal candidate will have strong technical expertise, a passion for building scalable data solutions, and the ability to lead engineering best practices across teams. Key Responsibilities : - Design, build, and maintain scalable data ingestion, egress, and transformation pipelines using Azure and GSK data platform tools. - Optimize complex data engineering solutions using industry-standard design patterns and best practices. - Deliver high-quality, production-ready data pipelines with automated testi...

We are seeking a seasoned QA Lead to drive the testing strategy, automation framework development, and quality governance across a large-scale modernization program transitioning from monolith to microservices. The QA Lead will oversee end-to-end, integration, regression, contract, performance, and data validation testing across backend services, frontend UI, and enterprise integrations. Key responsibilities Define comprehensive test plans for both interim (coexistence) and target-state architectures. Lead end-to-end validation across microservices, UI, APIs, data pipelines, and integrations. Create regression testing strategy across legacy monolith + new microservices. Drive alignment of QA...

Understanding of Spark core concepts like RDDs, DataFrames, DataSets, SparkSQL and Spark Streaming. Experience with Spark optimization techniques. Deep knowledge of Delta Lake features like time travel, schema evolution, data partitioning. Ability to design and implement data pipelines using Spark and Delta Lake as the data storage layer. Proficiency in Python/Scala/Java for Spark development and integrate with ETL process. Knowledge of data ingestion techniques from various sources (flat files, CSV, API, database) Understanding of data quality best practices and data validation techniques. Other Skills: Understanding of data warehouse concepts, data modelling techniques. Expertise in Git fo...

Spark & Delta Lake Understanding of Spark core concepts like RDDs, DataFrames, DataSets, SparkSQL and Spark Streaming. Experience with Spark optimization techniques. Deep knowledge of Delta Lake features like time travel, schema evolution, data partitioning. Ability to design and implement data pipelines using Spark and Delta Lake as the data storage layer. Proficiency in Python/Scala/Java for Spark development and integrate with ETL process. Knowledge of data ingestion techniques from various sources (flat files, CSV, API, database) Understanding of data quality best practices and data validation techniques. Other Skills: Understanding of data warehouse concepts, data modelling techniques. ...

* As a Software Developer you'll participate in many aspects of the software development lifecycle, such as design, code implementation, testing, and support. You will create software that enables your clients' hybrid-cloud and AI journeys. * You'll have the opportunity to work with the latest technologies, ensuring the applications delivered are high performing, highly available, responsive, and maintainable. Your primary responsibilities include: * Analytical Problem-Solving and Solution Enhancement: Analyze, validate and propose improvements to existing failures, with the support of the architect and technical leader. * Comprehensive Engagement Across Process Phases: Involvement in every ...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

As a Delivery Consultant, you will work closely with IBM clients and partners to design, deliver, and optimize IBM Technology solutions that align with your clients' goals. In this role, you will apply your technical expertise to ensure world-class delivery while leveraging your consultative skills such as problem-solving issue- / hypothesis-based methodologies, communication, and service orientation skills. As a member of IBM Technology Expert Labs, a team that is client focused, courageous, pragmatic, and technical, you'll collaborate with clients to optimize and trailblaze new solutions that address real business challenges. If you are passionate about success with both your career and so...