668 Elt Jobs - Page 7

Snowflake Developer (Python,SQL,Snowpark),data governance, security,data quality, data warehouse architecture, ELT/ETL processes,cloud data platforms,version control systems (Git),CI/CD pipelines,AWS, Azure,GCP orchestration tools such as Airflow,dbt

About the team: AIML is usedto create chatbots, virtual assistants, and other forms of artificial intelligence software. AIML is also used in research and development of natural language processing systems. What you can look forward to as a AI/ML exper t Lead Development : Own endtoend design, implementation, deployment and maintenance of both traditional ML and Generative AI solutions (e.g., finetuning LLMs, RAG pipelines) Project Execution & Delivery : Translate business requirements into datadriven and GenAIdriven use cases; scope features, estimates, and timelines Technical Leadership & Mentorship : Mentor, review and coach junior/midlevel engineers on best practices in ML, MLOps and Gen...

Roles & Responsibilities: Provide technical leadership and mentorship to a team of data engineers. Collaborate with stakeholders to define project requirements and deliverables. Ensure best practices in data security, governance, and compliance. Requirements: 10+ years of experience in working on Azure Databricks or Apache Spark-based platforms. Proven track record of building and optimizing ETL/ELT pipelines for batch and streaming data ingestion. Hands-on experience with Azure services such as Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, or Azure SQL Data Warehouse. Proficiency in programming languages such as Python, Scala, PYpark, Spark-SQL for data processing an...

We are seeking a highly skilled and motivated Big Data NiFi Developer to join our growing data engineering team in Pune. The ideal candidate will have hands-on experience with Apache NiFi, strong understanding of big data technologies, and a background in data warehousing or ETL processes. If you are passionate about working with high-volume data pipelines and building scalable data integration solutions, wed love to hear from you. Key Responsibilities: Design, develop, and maintain data flow pipelines using Apache NiFi. Integrate and process large volumes of data from diverse sources using Spark and NiFi workflows . Collaborate with data engineers and analysts to transform business requirem...

Role Overview We are looking for a highly skilled ETL Tester to join our team. In this role, you will collaborate closely with development teams and product managers to design, develop, and maintain robust software applications. You should be comfortable working on both client-side and server-side architectures, ensuring the delivery of scalable, reliable, and high-performing solutions. Key Responsibilities Collaborate with development teams and product managers to design and develop software applications. Design and work with client-side and server-side architectures. Build reliable, scalable applications and features with responsive design principles. Test, troubleshoot, debug, and upgrade...

Must have: Minimum 5+ years of experience in a QE/ Agile environment with a focus on technical, automated validations leveraging variety of tools/ technologies/ frameworks. Lead the design and development of end-to-end ETL/ELT data pipelines using PySpark to ingest, transform, and process massive datasets from various sources. Optimize and fine-tune complex PySpark jobs to improve performance, reduce execution time, and minimize computational costs. Write clean, modular, and well-documented code following software development best practices. Extensive experience with at least one major cloud platform (AWS, Azure, or GCP) for building data solutions. Work closely with tech leads, data scienti...

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities The ideal candidate will be responsible for the entire SDLC and should have excellent communication skills and experience working directly with the business. They need to be self-sufficient and comfortable with building internal networks, both with the business and other technology teams. The ideal candidate will be expected to own changes all the way from inception to deployment in production. In addition to implementing new functionality, they need to use their experience in TDD and best practices to identify process gaps or areas for improvement with a constant focus on scalability and sta...

As a Director / Associate Director in Cloud Engineering (Azure Stack), you will be responsible for leading multiple client engagements, driving end-to-end project delivery, and managing high-performing engineering teams specializing in Databricks. Your role will involve hands-on technical expertise, project and people management skills, and a proven track record of delivering large-scale data engineering solutions in cloud-native environments. With at least 14 years of experience in data engineering, including 3+ years in leadership or director-level roles, you will be expected to have a strong background in Databricks, Delta Lake, and cloud data architecture. Your responsibilities will incl...

You are a strategic thinker passionate about driving solutions in the Data Domain. You have found the right team. As a Data Domain Modeler in the Transformation & Innovation team, you will lead the design and implementation of end-to-end data models starting from raw data to the semantic layer. This transformation makes our data more accessible and understandable for different personas, including finance users, data analysts, automation, quantitative research, and machine learning teams. Being part of an influential and data-centric team focused on data accessibility, you will work on designing new data models for various domains such as headcount, contractors, financials, forecasting models...

As a GCP Data Engineer-Technical Lead at Birlasoft Office in Bengaluru, India, you will be responsible for designing, building, and maintaining scalable data pipelines and platforms on Google Cloud Platform (GCP) to support business intelligence, analytics, and machine learning initiatives. With a primary focus on Python and GCP technologies such as BigQuery, Dataproc, and Data Flow, you will develop ETL and ELT pipelines while ensuring optimal data manipulation and performance tuning. Your role will involve leveraging data manipulation libraries like Pandas, NumPy, and PySpark, along with SQL expertise for efficient data processing in BigQuery. Additionally, your experience with tools such ...

You are seeking a talented Cloud Architect to join our team and take on a hands-on role in driving the architecture, design, and implementation of Snowflake for our clients. Your responsibilities will include designing and implementing fully operational large-scale data solutions on Snowflake Data Warehouse. It is essential that you have a minimum of 6 years of experience in this domain. Your expertise should encompass Snowflake data modeling, ELT using snow pipe, stored procedures implementation, and standard DWH and ETL concepts. You must also have experience in data security, access controls, and design within the Snowflake environment. Proficiency in setting up Resource monitors, RBAC co...

You are a strategic thinker who is passionate about driving solutions in the Data Domain. Joining the Transformation & Innovation team, you will play a crucial role in leading the design and implementation of end-to-end data models, starting from raw data to the semantic layer. These models aim to enhance data accessibility and understanding for various personas, including finance users, data analysts, automation specialists, quantitative research teams, and machine learning experts. As a Data Domain Modeler, you will collaborate with an influential and data-centric team dedicated to improving data accessibility. Your responsibilities will include designing new data models for domains such a...

You are a strategic thinker passionate about driving solutions in the Data Domain. You have found the right team. As a Data Domain Modeler in the Transformation & Innovation team, you will lead the design and implementation of end-to-end data models starting from raw data to the semantic layer. This makes our data more accessible and understandable for different personas including finance users, data analysts, automation, quantitative research, and machine learning teams. Being part of an influential and data-centric team focused on data accessibility, you will work on designing new data models for various domains such as headcount, contractors, financials, forecasting models, markets, and m...

We are seeking an experienced Lead Data Engineer with a strong proficiency in Google BigQuery and a working knowledge of Looker to provide support for a data modernization project. In this role, you will be responsible for leading efforts to revamp data architecture, optimize data pipelines, and meet reporting requirements. Additionally, you will play a key role in mentoring an internal client developer to ensure a seamless transition post-engagement. As a Lead Data Engineer, your responsibilities will include assessing and enhancing existing data models, pipelines, and architecture within BigQuery. You will focus on optimizing data flows and storage for improved performance, scalability, an...

You will be the Director / Associate Director Data Engineering responsible for leading the architecture, delivery, and team management of various data engineering projects in a client-facing role. Your primary focus will be on designing modern data platforms, creating scalable data pipelines, and overseeing teams working across different technologies and cloud environments such as AWS, Azure, or GCP. Your responsibilities will include defining data architectures, modernization strategies, and transformation roadmaps in collaboration with enterprise clients. You will lead the design and implementation of cloud-native data pipelines, data lakes, and data warehouses while managing project budge...

As a Senior Data Engineer, you will be responsible for designing and building robust, scalable data pipelines with deep expertise in PySpark, SQL, and cloud data platforms such as Azure Databricks, with exposure to AWS or GCP environments. You will collaborate with data architects, analysts, and business stakeholders to deliver high-quality data solutions that drive insights and business value. Your key responsibilities will include designing, building, and optimizing scalable ETL/ELT pipelines using PySpark and SQL, developing data workflows on Azure Databricks, integrating across cloud platforms (AWS or GCP), implementing and maintaining data models using Kimball/star schema or similar dim...

As an Integration Developer at our organization, you will be an integral part of the data engineering and integration team. Your primary responsibility will be to design, develop, and maintain ETL/ELT pipelines using tools such as SSIS and Azure Data Factory (ADF). You will play a crucial role in building reliable data integration pipelines that support various business functions including business intelligence, analytics, and operational workloads. Your key responsibilities will include implementing robust data workflows to ingest, transform, and store structured and unstructured data in Azure Data Lakehouse, integrating cloud and on-premise systems for high performance and data quality, an...

You are a strategic thinker passionate about driving solutions in the Data Domain. You have found the right team. As a Data Domain Modeler in the Transformation & Innovation team, you will lead the design and implementation of end-to-end data models starting from raw data to the semantic layer. This layer makes our data more accessible and understandable for different personas ranging from finance users, data analysts, automation, quantitative research, and machine learning teams. Being part of an influential and data-centric team focused on data accessibility, you will work on designing new data models for domains such as headcount, contractors, financials, forecasting models, markets, and ...

Blenheim Chalcot is a renowned venture builder known for creating disruptive businesses across various sectors such as FinTech, EdTech, GovTech, Media, Sport, and Charity. With over 20 years of experience, we have established ourselves as the leading innovators in the UK and globally. Our ventures are GenAI enabled, setting new standards of innovation and excellence. The Blenheim Chalcot team in India has played a crucial role in the success and growth of our organization. Since its inception in 2009, Blenheim Chalcot India has been a launchpad for individuals passionate about driving innovation and entrepreneurship. Driven by a mission to empower visionaries, Blenheim Chalcot India focuses ...

As a Principal Information Architect at Fractal, you will play a crucial role in serving as the Overall Portfolio Technical Architect. Your responsibilities include leading and defining the architecture to ensure alignment with account standards and best practices. You will assess the current technology landscape, lead project implementations, resolve issues, troubleshoot, and maintain project communication plans. Your role also involves reviewing systems under development, coordinating coding activities, and ensuring adherence to company policies, standards, and technologies. Collaboration with the Scrum Master will be essential to align project plans, ensure compliance with application arc...

You will be joining QTek Digital, a leading data solutions provider known for its expertise in custom data management, data warehouse, and data science solutions. Our team of dedicated data professionals, including data scientists, data analysts, and data engineers, collaborates to address present-day challenges and pave the way for future innovations. At QTek Digital, we value our employees and focus on fostering engagement, empowerment, and continuous growth opportunities. As a BI ETL Engineer at QTek Digital, you will be taking on a full-time remote position. Your primary responsibilities will revolve around tasks such as data modeling, applying analytical skills, implementing data wareho...

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. You will be part of a team of highly skilled professionals working with cutting-edge technologies. Our purpose is to bring real positive changes in an increasingly virtual world, transcending generational gaps and disruptions of the future. We are seeking AWS Glue Professionals with the following qualifications: - 3 or more years of experience in AWS Glue, Redshift, and Python - 3+ years of experience in engineering with expertise in ETL work with cloud databases...

You are a strategic thinker passionate about driving solutions in Data Domain. You have found the right team. As a Data Domain Modeler in Transformation & Innovation team, you will lead the design and implementation of end-to-end data models starting from raw data to the semantic layer that makes our data more accessible and understandable for different personas ranging from finance users, data analysts, automation, quantitative research, and machine learning teams. Being part of an influential and data-centric team focused on data accessibility, you will work on designing new data models for domains such as headcount, contractors, financials, forecasting models, markets, and macro-economic ...

Agivant is seeking a talented and passionate Senior Data Engineer to join our growing data team. In this role, you will play a key part in building and scaling our data infrastructure, enabling data-driven decision-making across the organization. You will be responsible for designing, developing, and maintaining efficient and reliable data pipelines for both ELT (Extract, Load, Transform) and ETL (Extract, Transform, Load) processes. Responsibilities: Design, develop, and maintain robust and scalable data pipelines for ELT and ETL processes, ensuring data accuracy, completeness, and timeliness. Work with stakeholders to understand data requirements and translate them into efficient data mode...

You will be part of a data analytics services company that specializes in creating and managing scalable data platforms for a diverse client base. Leveraging cutting-edge technologies, you will provide actionable insights and value through modern data stack solutions. Your responsibilities will include designing, building, and managing customer data platforms independently using Snowflake, dbt, Fivetran, and SQL. Collaborating with clients and internal teams to gather business requirements and translating them into reliable data solutions will be a key aspect of your role. You will also develop and maintain ELT pipelines with Fivetran and dbt for automating data ingestion, transformation, an...