27689 Apache Jobs - Page 3

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Apache Spark Good to have skills : Python (Programming Language), Google BigQuery, PySpark Minimum 12 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipeli...

Job Summary: We are seeking a Senior Data Engineer to join a Global Data Analytics & Insights team focused on transforming enterprise data management and democratizing access to insights. This role will lead a large-scale data migration from external agency-managed environments into an internal Google Cloud Platform (GCP) ecosystem. You will drive discovery, define and execute migration strategy, rebuild ingestion pipelines, and ensure secure, compliant, always-on access for internal teams and approved external partners. The work directly supports global analytics initiatives by delivering scalable, high-quality, governed data products Roles and Responsibility Lead discovery and deep analysi...

Project Role : Custom Software Engineer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Apache Airflow, Python (Programming Language) Minimum 5 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with various stakeholders to gather requirements, developing applic...

AdMedia India is seeking an experienced Linux System Administrator/DevOps who is passionate about infrastructure design to join its Platform Operations team. We leverage our infrastructure with infrastructure design to join its Platform Operations team. We leverage our infrastructure with heavy automation for server deployment and provisioning. This is an ideal opportunity for someone who enjoys experimenting and thoughtfully architecting systems! Work Timing: 4 PM to 1 AM IST Working Days: 6 days a week (Monday to Saturday) Responsibilities: Design and implement infrastructure and automation improvements. Provision and manage servers and environments. Develop and maintain configuration mana...

"Responsibilities Architect and build: Design and implement scalable data architectures and pipelines on Azure, utilizing services like Azure Data Factory and Azure Synapse Analytics. Develop and optimize: Create and maintain data pipelines, including ETL/ELT processes, with a focus on performance and scalability, often using Python/PySpark and Databricks. Ensure data quality: Implement processes and checks to maintain data quality, integrity, and security across all data solutions. Collaborate: Work with data scientists, analysts, and other stakeholders to understand data needs and deliver effective solutions. Troubleshoot and monitor: Monitor data systems, troubleshoot performance issues, ...

🌟 Senior Data Scientist SME & AI Architect (10+ Years Experience) 🧠 We are seeking a highly accomplished and results-oriented Senior Data Scientist Subject Matter Expert (SME) with over 10 years of experience to lead our advanced analytics and AI initiatives. This is a pivotal role requiring deep technical mastery across large-scale Big Data technologies, multi-cloud environments, and cutting-edge specialized AI domains, including Generative AI, Computer Vision, and Natural Language Processing (NLP) . You will be the principal technical leader, driving strategy, setting standards, and delivering high-impact solutions that transform business outcomes. Key Responsibilities AI/ML Strategy & Arc...

Design, develop, and maintain Python-based applications and workflows, with a focus on Apache Airflow DAGs. Monitor, troubleshoot, and resolve technical issues in production environments. Collaborate with cross-functional teams to understand data workflows, dependencies, and SLAs. Support daily operations, monitor job runs, and ensure timely issue resolution. Enhance existing code and automation processes for better reliability and performance. Maintain proper documentation for support and handover purposes. Participate in code reviews, and follow best practices in coding and support procedures. Flexibly work in rotational shifts and be available during festival periods if required. 4 to 7 y...

Company Description LinkedIn is the world’s largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover exciting opportunities, build necessary skills, and gain valuable insights every day. We’re also committed to providing transformational opportunities for our own employees by investing in their growth. We aspire to create a culture that’s built on trust, care, inclusion, and fun – where everyone can succeed. Join us to transform the way the world works. Job Description LinkedIn was built to help professionals achieve more in their careers, and every day millions of people use our ...

Your Tasks: Maintain, monitor, and improve backend IT systems for wind farm deployment and updates. • Automate system administration tasks to optimize performance, security, and uptime. • Proactively mitigate security risks through threat monitoring, vulnerability assessments, and security patching. • Monitor critical infrastructure components such as TLS certificates, storage capacity, and system availability. • Support and enhance CI/CD pipelines for infrastructure automation. • Develop and implement concepts for infrastructure hardening, observability, and scalability. • Provide lab support and ensure smooth operation of development and testing environments. Your Profile: Strong Linux exp...

Job Scope: Systems Engineer responsibilities include deploying product updates, identifying production issues and implementing integrations that meet customer needs. The position works closely with internal teams and responsible for configuration and troubleshooting of Karix products. Candidates should be familiar with Ansible or shell scripting, Ultimately, you will execute and automate operational processes fast, accurately, and securely. Job Responsibilities: Implement integrations requested by Internal teams / customers Provide Level 2 technical support and queries coming from Internal teams Build tools to reduce occurrences of errors and improve customer experience Perform root cause an...

We're Celonis, the global leader in Process Intelligence technology and one of the world's fastest-growing SaaS firms. We believe there is a massive opportunity to unlock productivity by placing AI, data and intelligence at the core of business processes - and for that, we need your help. Care to join us? The Team: As a Backend Engineer, you will bring your general software engineering expertise to our innovative projects and continuously evolving concepts. The Role: You will have the opportunity to work with cutting-edge cloud technology, stay on top of trends, and drive projects with an ever-increasing degree of independence. This is a unique opportunity for talented engineers to push thei...

Our client, a leading global specialist in energy management and automation is seeking an experienced Data Quality (DQ) and ETL Engineer to ensure the integrity, reliability, and governance of our data platform. This role is a hybrid of development, operations, and data governance. Key Responsibilities: Design, develop, and deploy scalable ETL/ELT solutions using AWS Glue (PySpark) and Python, IDQ (Informatica Data Quality) to ingest and transform high-volume data. Write and optimize complex SQL queries and stored procedures. Manage and orchestrate automated data workflows using AWS Step Functions or Apache Airflow. Define, implement, and enforce robust Data Quality (DQ) rules (completeness,...

Role - Angular Developer Experience - 6 TO 10 YRS Location - Kolkata JD - We are looking for an AngularJS Developer for a Java based micro-service application with 6-10 years of experience. As an AngularJS Developer, you will implement a complete user interface in the form of a mobile and desktop web app.Developer requirements, qualifications and responsibilities: • Develop User interfaces for Modern Rich Internet Applications with the latest Front End Technologies like Javascript, Bootstrap, HTML5, CSS3, and writing crossbrowser compatible code • Experience with RESTful services and Java technologies for the Application Development • Experience with complex AngularJS applications, directiv...

About the Role We are looking for a highly skilled Data Engineer to design, build, and maintain robust data pipelines and scalable data infrastructure. You will work closely with analytics, product, and engineering teams to enable high-quality data availability for business insights, machine learning, and operational processes. This role is ideal for an engineer who enjoys solving complex data problems, optimizing systems, and ensuring clean, reliable data flows. Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines using modern data engineering tools. Build and optimize data lakes, data warehouses, and streaming architectures . Work with large and complex datasets to...

Locations: Chennai Experience: 14-22 Years Role: Technical Architect Must-Have: Spring boot, spring cloud, API Gateway, Microservices, Apache ignite, Apache Kafka Knowledge of using SAST and DAST tools and Code Quality scanning tools Responsibilities: Architecting, Design and Development in delivering container-based applications and services to provide Technology leadership Designing and facilitating the build of services that will make up a cloud-native, secure, resilient, and highly scalable and performant solution Collaboration with Product engineering team, DevOps, Quality Assurance teams Deep Knowledge in modern technology stacks with a core focus on security, resiliency, scalability, ...

Locations: Chennai Experience: 14-22 Years Role: Technical Architect Must-Have: Spring boot, spring cloud, API Gateway, Microservices, Apache ignite, Apache Kafka Knowledge of using SAST and DAST tools and Code Quality scanning tools Responsibilities: Architecting, Design and Development in delivering container-based applications and services to provide Technology leadership Designing and facilitating the build of services that will make up a cloud-native, secure, resilient, and highly scalable and performant solution Collaboration with Product engineering team, DevOps, Quality Assurance teams Deep Knowledge in modern technology stacks with a core focus on security, resiliency, scalability, ...

We are looking for a Lead Data Engineer to drive the development of modern data platform. This role will focus on building scalable and reliable data pipelines using tools like DBT , Snowflake , and Apache Airflow , and will play a key part in shaping data architecture and strategy. As a technical leader, you’ll work closely with cross-functional teams including analytics, product, and engineering to deliver clean, accessible, and trustworthy data for business decision-making and machine learning use cases. Key Responsibilities: Lead the design and implementation of ELT pipelines using DBT and orchestrate workflows via Apache Airflow . Design, implement, and maintain robust data models to su...

nformatica IDMC, CDI-PC, PowerCenter and Power Exchange administration Exp ·Databricks ·Python ·SQL ·People Management Exp ·Linux/unix Key asks for the role: ·1.Five (5) years hands on experience in Informatica IDMC, CDI-PC, PowerCenter and PowerExchange administration on Unix/AIX/Linux and Windows server platforms in HA GRID environments, performing software installations, upgrades and code migrations between environments. ·2. Five (5) years expertise in the Databricks platform and Apache Spark for big data processing. ·3. Five (5) years extensive hands-on experience working with core infrastructure technologies such as UNIX, AIX, Linux, Windows, ·network, storage and performance management...

About Senzcraft: Founded by IIM Bangalore and IEST Shibpur Alumni, Senzcraft is a hyper-automation company. Senzcraft vision is to Radically Simplify Today's Work. And Design Business Process For The Future. Using intelligent process automation technologies. We have a suite of SaaS products and services, partnering with automation product companies. Please visit our website - https://www.senzcraft.com for more details Our AI Operations SaaS platform – https://MagicOps.ai Senzcraft on linkedin -> https://www.linkedin.com/company/senzcraft Senzcraft is awarded by Analytics India Magazine in it’s report “State of AI in India” as a “Niche AI startup”. Senzcraft is also recognized by NY based ...

Role Overview We are seeking a skilled Google Cloud Platform (GCP) Data Engineer to design, build, and optimize data pipelines and architectures for large-scale data processing. The ideal candidate will have hands-on experience with GCP services such as BigQuery, Cloud Storage, Pub/Sub, and Dataflow , and a strong understanding of data modeling, ETL processes, and streaming/batch data workflows. Key Responsibilities Design and implement data pipelines using Cloud Dataflow (Apache Beam) for batch and streaming data. Develop and maintain data ingestion frameworks leveraging Pub/Sub for real-time data. Optimize and manage BigQuery datasets for analytics and reporting. Integrate data from variou...

Job Title: Principal Cloud Architect – Multi-Cloud | Kubernetes | Enterprise Architecture (15+ yrs) Experience: 15+ years Location Noida (On-Site) Job Type: Full-Time, Permanent Job Description We are looking for a highly accomplished Principal Cloud Architect (15+ years) with deep expertise in designing and governing enterprise-scale, multi-cloud architectures. The ideal candidate has strong leadership capabilities, mastery over AWS/Azure/GCP platforms, and proven experience driving cloud modernization, Kubernetes platforms, HA/DR, automation, and cloud security at scale. Key Responsibilities Cloud Architecture & Governance Architect secure, scalable, and resilient cloud solutions for enter...

Job Title: Data Architect Experience: 12–15 Years Location: Remote Employment Type: Contract About the Role We are looking for a highly experienced Data Architect to design, build, and lead enterprise-scale data platforms from the ground up. The ideal candidate will have deep expertise across Data Lakes, Data Warehouses, and Lakehouse architectures , with a strong emphasis on Snowflake as the primary platform. This role demands hands-on architectural leadership, the ability to design scalable batch and real-time data ecosystems , and close collaboration with engineering, analytics, and business stakeholders to support BI, analytics, and AI/ML initiatives . Key Responsibilities Define and dri...

About Client :- Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations. The company is committed to unleashing human energy through technology for an inclusive and sustainable future, helping organizations accelerate their transition to a digital and sustainable world. They provide a variety of services, including consulting, technology, professional, and outsourcing services. Job Details:- location : Pune Mode Of Work : Hyb...

Purposeful work and cutting-edge technology, and a supportive culture. Learning & Career Growth About Our Client A leading financial institution offering a wide range of solutions for individuals, small businesses, and corporates - from deposits and loans to wealth management and payment services. Job Description We're looking for a Data Engineer with 4-7 years of experience, strong skills in Python, PySpark, Unix, and Apache Airflow, plus hands‑on expertise with GraphDBs ( Neo4j, Amazon Neptune, TigerGraph, Dgraph). Excellent communication, problem‑solving, and the ability to work independently are essential. The Successful Applicant If you're an expert in Python, PySpark, Unix, and Apache ...

TCS is hiring for Data Engineers ! Role : Data Engineer Exp : 4 - 6 years Location : Navi Mumbai Skills : Python, Hadoop HDFS, PySpark, Apache Airflow ,ETL ,Apache Druid Design, build, maintain scalable data pipelines that extract, transform and load data from various sources Monitor and optimize data infrastructure and processes for performance and scalability Implement security measures and data privacy policies to ensure compliance with regulations Proven Experience in Big Data Technologies like HDFS, PySpark, Apache Airflow, Apache Druid Proficiency in languages like Python, Scala and SQL Design and maintain Spark, Airflow and HDFS Clusters