15348 Airflow Jobs - Page 23

P1 C3 TSTS Strong expertise in SQL and PL/SQL. Hands-on experience with DBT (not just theoretical knowledge). Ability to reverse engineer Oracle code and convert to DBT models. Familiarity with high-volume data processing. Optional Experience with Java (plus, not mandatory) & Knowledge of Airflow (plus, not mandatory). Suggest performance improvements (e.g., clustering, merge optimization). Work independently without hand-holding. Collaborate with existing frameworks and standards. Strong expertise in SQL and PL/SQL. Strong hands-on experience with DBT (not just theoretical knowledge). Ability to reverse engineer Oracle code and convert to DBT models. Familiarity with high-volume data proces...

Generative AI Engineer (Hands-on Development Role) Location: Winfo Solutions Job Type: Full-time Experience: 6-10 years Industry: IT Consulting About The Role We are looking for a Generative AI Engineer with strong software engineering skills and hands-on experience in developing AI-powered applications . This role involves coding AI-driven solutions, developing APIs, integrating models into products, and building scalable AI systems for production use. Key Responsibilities Develop AI-driven applications by integrating LLMs and generative models into real-world software solutions. Design and build APIs for LLMs and GenAI models (FastAPI, Flask, Django). Write production-ready code to integra...

Key Responsibilities: Lead the design and implementation of AI/ML solutions across various business domains. Architect end-to-end GenAI solutions, ensuring scalability, reliability, and security. Collaborate with data scientists, engineers, and product managers to translate business requirements into technical solutions. Evaluate and select appropriate AI frameworks, tools, and build core AI framework. Ensure best practices in software engineering, code quality, and system security. Oversee integration of AI models into existing software products and cloud environments. Mentor and guide development teams on AI/ML best practices and software architecture. Stay updated with the latest advancem...

Key Responsibilities: Lead the design and implementation of AI/ML solutions across various business domains. Architect end-to-end GenAI solutions, ensuring scalability, reliability, and security. Collaborate with data scientists, engineers, and product managers to translate business requirements into technical solutions. Evaluate and select appropriate AI frameworks, tools, and build core AI framework. Ensure best practices in software engineering, code quality, and system security. Oversee integration of AI models into existing software products and cloud environments. Mentor and guide development teams on AI/ML best practices and software architecture. Stay updated with the latest advancem...

Job Summary We are hiring Python + Spark Developer for our projects based out in Chennai & Bangalore location. Skill - Python + Spark Exp - 5- 10 Yrs Location - Chennai/ Bangalore Hybrid Mode - 12 Days a month Strong proficiency in programming with hands-on experience with relevant frameworks/libraries Experience with PySpark and Pandas/Polars for data manipulation. Solid understanding of Test-driven Development and best coding practices. Experience with API architecture, microservices and Kubernetes. Familiarity with CI/CD pipelines and Azure DevOps. Excellent cross-team collaboration and communication skills. Experience with orchestration tools like Airflow and reporting tools such as Supe...

About Position: We are hiring a highly skilled Machine Learning Engineer to lead the development and deployment of scalable ML solutions for enterprise applications. This role requires deep expertise in ML model development, MLOps, and cloud-native AI platforms, along with strong collaboration and solution delivery capabilities. Role: Machine Learning Engineer Location: All Persistent location Experience: 8 to 12 Years Job Type: Full Time Employment What You'll Do: You will design and implement robust ML pipelines, collaborate across teams, and deliver AI/ML solutions that drive business impact. Design, develop, and implement ML models for predictive analytics, NLP, computer vision, and reco...

N-iX is a global software development service company that helps businesses across the world develop successful software products. Founded in 2002, N-iX has come a long way, expanding its presence across Europe, the US, and Latin America. Today, we are a strong community of 2,000+ professionals and a reliable partner for global industry leaders and Fortune 500 companies. Our client is a global commerce leader where you can influence how the world buys, sells, and gives. You'll be part of a work culture that's been genuinely committed to diversity and inclusion since its founding over twenty five years ago. Here, you can be yourself, do your best work along with a team of professionals, and h...

Job Description Role Purpose The purpose of this role is to provide significant technical expertise in architecture planning and design of the concerned tower (platform, database, middleware, backup etc) as well as managing its day-to-day operations Do Provide adequate support in architecture planning, migration & installation for new projects in own tower (platform/dbase/ middleware/ backup) Lead the structural/ architectural design of a platform/ middleware/ database/ back up etc. according to various system requirements to ensure a highly scalable and extensible solution Conduct technology capacity planning by reviewing the current and future requirements Utilize and leverage the new feat...

Job Description Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert re...

Job Description Role Purpose The purpose of this role is to provide significant technical expertise in architecture planning and design of the concerned tower (platform, database, middleware, backup etc) as well as managing its day-to-day operations Do Provide adequate support in architecture planning, migration & installation for new projects in own tower (platform/dbase/ middleware/ backup) Lead the structural/ architectural design of a platform/ middleware/ database/ back up etc. according to various system requirements to ensure a highly scalable and extensible solution Conduct technology capacity planning by reviewing the current and future requirements Utilize and leverage the new feat...

Job Description Skill - Data Science , ELK STack , AIOps Experience: 10+ Years Required Skills & Experience Data Science & Machine Learning experience: Hands-on proficiency in Python, TensorFlow, PyTorch, Scikit-learn, Pandas, NumPy. Extensive knowledge of ETL techniques: Data extraction, transformation, and loading using Apache Airflow, Apache NiFi, Spark or similar tools Observability Stack: Hands-on experience with Prometheus, Grafana, ELK Stack, Loki, OpenTelemetry, Jaeger, or Zipkin. Experience with Time-Series Analysis, Predictive Analytics and AI-driven Observability. Cloud & Infrastructure: Experience with AWS, Azure, or GCP observability services (e.g., CloudWatch, Azure Monitor). D...

You are passionate about quality and how customers experience the products you test. You have the ability to create, maintain and execute test plans in order to verify requirements. As a Quality Engineer at Equifax, you will be a catalyst in both the development and the testing of high priority initiatives. You will develop and test new products to support technology operations while maintaining exemplary standards. As a collaborative member of the team, you will deliver QA services (code quality, testing services, performance engineering, development collaboration and continuous integration). You will conduct quality control tests in order to ensure full compliance with specified standards ...

SUMMARY Working knowledge on big data technologies should be more than 6. Increase the no. of years for Sr profiles Excellent working knowledge on SQL Proficient with spark and any one or both programming language e.g. Scala and/or Python Demonstrated working knowledge with kafka, Airflow, DBT, Flink, Apache Iceberg, Datadog Experience with snowflake will be a big positive Experience with CI/CD framework implementation in conjunction with any popular code repository like Github

Job Description We are looking for a candidate with 5+ years of experience in a Data Engineer role and has attained bachelor's degree in technology and has experienced with Agile/Scrum development process and methodologies. Experience as a Data Engineer with strong track record of designing and implementing data solutions. Experience in programming language as Python, Pyspark with airflows Experience with cloud data warehousing technologies, such as Snowflake and Redshift. Experience with Cloud platforms such as AWS, Azure or Google Cloud Platform. Experience with AWS cloud services, such as S3, EC2, EMR, Glue, CloudWatch, Athena, Lambda. Experience with containerization and orchestration te...

Team :- Strategy & Consulting Global Network Practice :- Marketing Analytics Title :- Consultant/ Manager/Analyst Marketing & Customer Data Platforms (GCP, CDP, Agentic AI) WHAT'S IN IT FOR YOU? As part of our Analytics practice, you will join a worldwide network of over 20k+ smart and driven colleagues experienced in leading AI/ML/Statistical tools/Agentic AI systems, methods and applications. From data to analytics and insights to actions, our forward-thinking consultants provide analytically-informed, issue-based insights at scale to help our clients improve outcomes and achieve high performance. What you would do in this role A Consultant/Manager/Analyst for Customer Data Platforms serve...

Location: Soho, Manhattan, NYC Who We Are DoubleVerify is a leading software platform for digital media measurement, data and analytics. DV’s mission is to be the definitive source of transparency and data-driven insights into the quality and effectiveness of digital advertising for the world’s largest brands, publishers and digital ad platforms. DV’s technology platform provides advertisers with consistent and unbiased data and analytics that can be used to optimize the quality and return on their digital ad investments. Since 2008, DV has helped hundreds of Fortune 500 companies gain the most from their media spend by delivering best in class solutions across the digital advertising ecosys...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

Write clean, high-quality, maintainable, and testable code, primarily using React and C# Develop within an Agile/Scrum framework, leveraging tools such as automated unit testing, CI/CD pipelines, code reviews, and version control (Git) Identify and raise issues proactively that could impact delivery timelines Work in SQL, Backend Services, REST API, Azure stack Work with Project Management and other developers to understand design requirements and provide estimates for development Fix production issues and maintain the code as neede Basic 2+ years of related experience with a Bachelor s degree Experience building/consuming RESTful and gRPC based web-services Experience with CI/CD build pipel...

Write clean, high-quality, maintainable, and testable code, primarily using React and C# Develop within an Agile/Scrum framework, leveraging tools such as automated unit testing, CI/CD pipelines, code reviews, and version control (Git) Identify and raise issues proactively that could impact delivery timelines Work in SQL, Backend Services, REST API, Azure stack Work with Project Management and other developers to understand design requirements and provide estimates for development Fix production issues and maintain the code as neede Basic 4+ years of related experience with a Bachelor s degree; or 2 years related experience with a Master s degree; or equivalent experience Experience building...

Automate deployment and monitoring of Snowflake, Airflow, and S3/Icebergpipelines across multiple environments. Build and maintain CI/CD workflows using GitHub Actions and infrastructure as code with Terraform. Deploy, operate, and scale Python and Java applications on AWS services, including Lambda, ECS, EKS, and Step Functions. Implement Data observability dashboards, alerts, and incident response workflows. Operationalize GenAI and Bedrock-integrated pipelines with strong governance and reliability. Drive root cause analysis, reduce MTTR, and mentor DataOps peers. What You Bring Primary 5+ years in DataOps / DevOps / Platform Engineering supporting large-scale data platforms. Must have St...

Extracting data from various sources, including web scraping, API requests, etc. Building complex data pipelines that automate data sourcing and processing. Develop programs to synchronize technology and human-powered processes. Design and maintain database and data warehousing solutions. Develop automated reports to monitor and track data pipelines (Power BI, Tableau) Work alongside Data Operations teams to augment core technologies. Play a key role in continuing to build out a newly formed data engineering function in the department. Serve as a data and engineering SME on cross-functional Data Operations initiatives. Mentor and assist Associate Data Engineers in building out pipeline archi...

Bachelor s or Master s degree in Computer Science, Software Engineering, or a related field 5+ yrs experience in data engineering roles 3+ years of experience in DWH/ETL Domain using AWS tech stack such as Redshift, S3, Glue, Lambda and IAM Proficiency in PySpark/Python/SQL and designing data models and data standards Deep understanding of ETL/ELT processes, data warehousing concepts, and big data technologies Experience building & managing data pipelines using tools like Glue, Airflow, AWS Step Functions, or similar Experience in RDMS & No-SQL databases: SQL Server databases, PostgreSQL, DynamoDB, or Aurora Experience in dimensional modeling & schema design; Star and Snowflake modelProven a...

Lead the design, architecture, and implementation of GCP-based infrastructure projects Collaborate with IT, development, and operations teams to integrate cloud strategies and architecture Responsible for all technical aspects of software development for assigned applications - performs hands-on coding, technical design and development of systems. Develops code specifications. Involved in unit, integration and user acceptance testing. Assists in resolution of defects/ production support issues as required. Analyze requirements/ user stories to appropriately support basic design activities Perform core technical aspects of software development for assigned applications including, developing p...

Position Summary... What you'll do... About Team You will be part of a Data Engineering team that builds and operates scalable, intelligent data platforms enabling analytics, automation and AI-driven decision-making across the organization. Our work focuses on designing high-performance data systems, ensuring reliability and operational excellence and integrating Generative AI capabilities to enhance how data is processed, understood, and used. We work at the intersection of data engineering and applied AI, developing production-grade agentic systems that handle data at scale, automate complex workflows, and drive measurable business impact. The team culture emphasizes ownership, collaborati...

We are looking for a Full stack UI Developer to join our HIDA Technology team in Bangalore. This is an amazing opportunity to work on HIDA, a platform supporting analytics and insights in the healthcare distribution space. The team consists of 8 members and reports to the Senior Manager. We have a great skill set in Angular, Python-based backend services, data modeling, and Snowflake data pipelines, and we would love to speak with you if you have skills in building modern UI applications, Snowflake integration with Python-based applications, and developing scalable full stack solutions. About You experience, education, skills, and accomplishments Bachelors Degree (or equivalent) in Computer ...