469 Etl Pipelines Jobs - Page 8

As a Senior Data Engineer (Azure) at Simform based in Ahmedabad, Gujarat, you will play a crucial role in managing large-scale data, designing and developing end-to-end data pipelines on Azure, and optimizing data workflows. With your expertise in Azure data services, ETL pipelines, and database management, you will work on ingesting, processing, and analyzing structured and unstructured data efficiently. Your responsibilities will include collaborating with cross-functional teams to integrate data solutions, ensuring data quality and compliance with security best practices, and participating in client interactions to gather requirements. You will be involved in designing efficient data mode...

We are looking for a highly motivated and skilled Data Engineer to join our dynamic team. In this high-impact role, you will play a key part in constructing and maintaining our data infrastructure to facilitate data-driven decision-making throughout the organization. We welcome remote candidates who are team-oriented, adaptable, and eager to acquire new knowledge. Your responsibilities will include designing, developing, and managing scalable ETL pipelines utilizing Python and DigDag. You will extensively collaborate with Google Cloud services, particularly BigQuery, for data warehousing and analytics. Crafting and optimizing intricate SQL queries for data extraction and transformation will ...

Talent Worx is excited to offer an exceptional opportunity for individuals interested in the roles of Snowflake and Spark Developers! As part of our team, you will be at the forefront of transforming the data analytics landscape while collaborating with one of the Big 4 firms in India. Your role will be instrumental in influencing our clients" success stories through the utilization of cutting-edge technologies and frameworks. Our vibrant culture promotes inclusivity, teamwork, and outstanding performance, providing you with unparalleled prospects for career advancement and goal achievement. Within our Analytics & Cognitive (A&C) practice, you will be part of a dedicated team focused on unlo...

About ProcDNA ProcDNA is a global consulting firm. We fuse design thinking with cutting-edge tech to create game-changing Commercial Analytics and Technology solutions for our clients. We&aposre a passionate team of 275+ across 6 offices, all growing and learning together since our launch during the pandemic. Here, you won&apost be stuck in a cubicle - you&aposll be out in the open water, shaping the future with brilliant minds. At ProcDNA, innovation isn&apost just encouraged, it&aposs ingrained in our DNA. What We Are Looking For You&aposll build and maintain systems for efficient data collection, storage, and processing to ensure data pipelines are robust and scalable for seamless integra...

Design, develop, and maintain data solutions for data generation, collection, and processing Be a key team member that assists in design and development of the data pipeline Create data pipelines and ensure data quality by implementing ETL processes to migrate and deploy data across systems Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions Take ownership of data pipeline projects from inception to deployment, manage scope, timelines, and risks Develop and maintain data models, data dictionaries, and other documentation to ensure data accuracy and consistency Implement data security and privacy measures to protect se...

ABOUT THE ROLE Role Description: As part of the cybersecurity organization, In this vital role you willbe responsible for designing, building, and maintaining data infrastructure to support data-driven decision-making. This role involves working with large datasets, developing reports, executing data governance initiatives, and ensuring data is accessible, reliable, and efficiently managed. The role sits at the intersection of data infrastructure and business insight delivery, requiring the Data Engineer to design and build robust data pipelines while also translating data into meaningful visualizations for stakeholders across the organization. The ideal candidate has strong technical skills...

As a Python Solution Architect with over 10 years of experience, you will play a crucial role in designing and implementing scalable, high-performance software solutions that align with business requirements. Your expertise in Python frameworks (e.g., Django, Flask, FastAPI) will be instrumental in architecting efficient applications and microservices architectures. Your responsibilities will include collaborating with cross-functional teams to define architecture, best practices, and oversee the development process. You will be tasked with ensuring that Python solutions meet business goals, align with enterprise architecture, and adhere to security best practices (e.g., OWASP, cryptography)...

As a Data Platform Specialist at Siemens Energy, your primary responsibility will involve setting up and monitoring data acquisition systems to ensure a smooth and reliable flow of data on a daily basis. Your communication skills will be put to use as you interact with customers regarding data export and transmission, fostering strong and lasting relationships. Additionally, you will play a pivotal role in managing and improving the entire data platform, including the development of dashboards and digital services such as Condition Monitoring and Hotline Support. Providing technical support to your colleagues and contributing to the company-wide enhancement of Siemens Energy's data analysis ...

The Tech Consultant - Data & Cloud role involves supporting a leading international client with expertise in data engineering, cloud platforms, and big data technologies. As a skilled professional, you will contribute to large-scale data initiatives, implement cloud-based solutions, and collaborate with stakeholders to drive data-driven innovation. You will design scalable data architectures, optimize ETL processes, and leverage cloud technologies to deliver impactful business solutions. Key Responsibilities Data Engineering & ETL: Develop and optimize data pipelines using Apache Spark, Airflow, Sqoop, and Databricks for seamless data transformation and integration. Cloud & Infrastructure Ma...

As a Python Machine Learning Engineer at our organization, you will be responsible for designing, developing, and deploying scalable recommender systems using various machine learning algorithms. Your primary focus will be on leveraging machine learning techniques to personalize user experiences, enhance engagement, and drive business outcomes. You will collaborate closely with cross-functional teams to understand business requirements and translate them into actionable machine learning solutions. Conducting thorough exploratory data analysis to identify relevant features and patterns in large-scale datasets will be a crucial part of your role. Additionally, you will implement and optimize m...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Associate Job Description & Summary At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In data analysis at PwC, you will focus on utilising advanced analytical techniques to extract insights from large datasets and drive data-driven decision-making. You will leverage skills in data manipulation, visualisation, and statistical modelling to support clients in solving complex business problems. Why PWC A...

As a Technical Support Analyst (Data-Focused) at our company, you will play a crucial role in our growing Analytics/tech-support team by utilizing your strong analytical mindset, Python and SQL skills, and experience with data analysis tools. Your primary responsibilities will include investigating and resolving data inconsistencies, writing and debugging Python scripts, running SQL queries for data investigations, troubleshooting technical problems, and collaborating with various teams to ensure data quality and integrity. Additionally, you will be responsible for building internal tools, maintaining documentation of findings, and processes. The ideal candidate for this role should possess ...

As a Data Engineer / Business Intelligence Developer at Eurofins IT Solutions India Pvt Ltd (EITSI), you will play a crucial role in developing data engineering solutions and implementing business intelligence strategies. Your responsibilities will involve designing, developing, and maintaining large-scale data warehouses, ETL pipelines, data models, and BI solutions using tools such as SSIS, Power BI, Power Automate, and Pyramid Analytics. You will collaborate with cross-functional teams to identify and refine data requirements, ensuring high data quality, security, and compliance. Additionally, you will be involved in migrating data and reports between servers and BI platforms, as well as ...

As a Data Engineer / Business Intelligence Developer at Eurofins IT Solutions India Pvt Ltd (EITSI), you will have the opportunity to contribute to both data infrastructure and business decision-making. You will play a crucial role in developing data engineering solutions, implementing business intelligence strategies, and collaborating with cross-functional teams to deliver actionable insights and data-driven solutions. Your responsibilities will include designing, developing, and maintaining large-scale data warehouses and ETL pipelines using tools such as SSIS, Power Automate, and other relevant technologies. You will create and implement data models to enhance data accessibility and cons...

Job Title: Data Engineer (AWS QuickSight, Glue, PySpark) Location: Noida Job Summary: We are seeking a skilled Data Engineer with 4-5 years of experience to design, build, and maintain scalable data pipelines and analytics solutions within the AWS cloud environment. The ideal candidate will leverage AWS Glue, PySpark, and QuickSight to deliver robust data integration, transformation, and visualization capabilities. This role is critical in supporting business intelligence, analytics, and reporting needs across the organization. Key Responsibilities: Design, develop, and maintain data pipelines using AWS Glue, PySpark, and related AWS services to extract, transform, and load (ETL) data from d...

As a Consultant - Data Engineer at AstraZeneca, you will have the opportunity to contribute to the discovery, development, and commercialization of life-changing medicines by enhancing data platforms built on AWS services. Located at Chennai GITC, you will collaborate with experienced engineers to design and implement efficient data products, supporting data platform initiatives with a focus on impacting patients and saving lives. Your key accountabilities as a Data Engineer will include: Technical Expertise: - Designing, developing, and implementing scalable processes to extract, transform, and load data from various sources into data warehouses. - Demonstrating expert understanding of Astr...

You will be joining our team as a Technical Support Analyst (Data-Focused), working remotely to support our growing Analytics/tech-support team. In this hybrid role, you will be responsible for bridging data analysis, technical investigation, and hands-on coding to resolve data issues, maintain script-based tools, and provide technical insights to our internal stakeholders. The ideal candidate should possess a strong analytical mindset, excellent Python and SQL skills, experience with Athena or large-scale datasets, and a keen attention to detail. Your primary responsibilities will include investigating and resolving data inconsistencies or anomalies reported by business or engineering teams...

You should have 6-8 years of hands-on experience with Big Data technologies such as pySpark (Data frame and SparkSQL), Hadoop, and Hive. Additionally, you should possess good hands-on experience with python and Bash Scripts, along with a solid understanding of SQL and data warehouse concepts. Strong analytical, problem-solving, data analysis, and research skills are crucial for this role. It is essential to have a demonstrable ability to think creatively and independently, beyond relying solely on readily available tools. Excellent communication, presentation, and interpersonal skills are a must for effective collaboration within the team. Hands-on experience with Cloud Platform provided Big...

As an ML Engineer, you will play a crucial role in developing and implementing various Machine Learning models that contribute to the growth of the company. Your primary focus will be on creating ML workflows tailored for the legal industry to enhance the efficiencies of in-house teams at Draft n Craft. This position offers you the opportunity to enhance your ML/Data Engineering skills while actively participating in the creation of valuable products. Your responsibilities will include developing data ingestion and preprocessing pipelines to extract actionable insights from legal data, ensuring accurate and consistent data cleaning for ML models, and experimenting with different ML models an...

You will be joining Apexon, a digital-first technology services firm that specializes in accelerating business transformation and delivering human-centric digital experiences. At Apexon, we meet customers at every stage of the digital lifecycle and help them outperform their competition through speed and innovation. With a focus on AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering, and UX, we leverage our deep expertise in BFSI, healthcare, and life sciences to help businesses capitalize on the opportunities presented by the digital world. Our reputation is built on a comprehensive suite of engineering services, a commitment to solving our cl...

As an AWS Data Engineer, you should have at least 3 years of experience in AWS Data Engineering. Your main responsibilities will include designing and building ETL pipelines and Data lakes to automate the ingestion of both structured and unstructured data. You will need to be proficient in working with AWS big data technologies such as Redshift, S3, AWS Glue, Kinesis, Athena, DMS, EMR, and Lambda for Serverless ETL processes. Knowledge in SQL and NoSQL programming languages is essential, along with experience in batch and real-time pipelines. Your role will require excellent programming and debugging skills in either Scala or Python, as well as expertise in Spark. You should have a good unde...

You are a Generative AI Software Engineer with over 3 years of experience, possessing strong expertise in Generative AI and Large Language Models (LLMs). Your role involves designing, developing, and implementing GenAI solutions customized to address various business challenges. It is crucial that you excel in Python programming and have hands-on experience in Retrieval-Augmented Generation (RAG) along with familiarity with Vector Databases. Your responsibilities include using Python to design and implement scalable GenAI solutions, leading the design and architecture of AI-driven solutions, working with Large Language Models (LLMs) for building customized solutions, and developing AI models...

As a member of the Providence Cybersecurity (CYBR) team, you will play a crucial role in safeguarding all information pertaining to caregivers, affiliates, and confidential business data. Your responsibilities will include collaborating with Product Management to assess use cases, functional requirements, and technical specifications. You will conduct data discovery and analysis to identify crucial data from source systems for meeting business needs. Additionally, you will be tasked with developing conceptual and logical data models to validate requirements, highlighting essential entities, relationships, and documenting assumptions and risks. Your role will also involve translating logical ...

Golden Eagle IT Technologies Pvt. Ltd. is looking for a skilled Data Engineer with 2 to 4 years of experience to join the team in Indore. The ideal candidate should have a solid background in data engineering, big data technologies, and cloud platforms. As a Data Engineer, you will be responsible for designing, building, and maintaining efficient, scalable, and reliable data pipelines. You will be expected to develop and maintain ETL pipelines using tools like Apache Airflow, Spark, and Hadoop. Additionally, you will design and implement data solutions on AWS, leveraging services such as DynamoDB, Athena, Glue Data Catalog, and SageMaker. Working with messaging systems like Kafka for managin...

About the Role Were building a next-generation Data Analytics Engine that transforms raw market and historical data into actionable intelligence for the electronics supply chain industry. Our platform ingests, processes, and analyzes high-volume data across suppliers, parts, and trends powering real-time insights and ML-driven applications. We are looking for a highly experienced Lead or Staff Data Engineer to help us shape and scale our core data infrastructure. The ideal candidate brings a proven track record of designing and delivering scalable ETL pipelines and real-time data systems in AWS and open-source environments (e.g., Airflow, Spark, Kafka). This role requires deep technical owne...