Airflow Administrator

Job Description

Job Responsibilities :Airflow Administration and Data Analytics : - Administer and manage Airflow for scheduling and monitoring complex data workflows. - Utilize open -source technologies like Docker, Kubernetes, and container -based microservices to develop scalable solutions. - Provide installation and support for Business Intelligence systems such as SAP BODS, Collibra, HVR (Fivetran), Qlik Replicate, SAP SLT, and SAP BOXI (BOBI).Database Administration and Development : - Install, configure, and maintain databases like PostgreSQL, MongoDB, and RabbitMQ across cloud platforms such as Azure and AWS. - Develop ETL processes to extract, transform, and load data from various sources into data warehouse systems or other systems. - Administer and ensure the security and integrity of databases, complying with regulatory standards and validation processes.Data Analysis and Reporting : - Apply statistical analysis and data mining techniques to uncover trends, patterns, and correlations within data sets. - Build dashboards and reports to communicate data insights and findings to business stakeholders.DevOps Integration : - Implement DevOps methodologies and manage CI/CD pipelines using GitLab or GitHub for efficient development and deployment processes. - Integrate PowerShell, SQL, and PL/SQL scripting to automate and enhance data workflows.Technical Installations and Configurations : - Manage technical installations and configurations of enterprise applications on cloud instances, supporting both development and production environments. - Collaborate with cross -functional teams to translate business requirements into technical solutions and ensure seamless data integrations.IT Governance and Data Security : - Ensure data governance principles and best practices are followed for data integrity and compliance with data security and privacy regulations. - Participate in IT regulatory validation processes to ensure all systems comply with industry standards. - Cross -Functional Collaboration and Leadership: - Work closely with business, IT teams, and stakeholders to align data systems and tools with organizational goals. - Provide leadership in development projects and mentor junior team members, driving technical and process improvements.Required Qualifications :Experience : - 8+ years of experience in Information Technology supporting Business Intelligence, Warehouse, and Analytics systems. - Extensive knowledge of Airflow administration, Docker, Kubernetes, and container -based microservices. - Hands -on experience with databases like Postgres, MongoDB, and RabbitMQ. - Proficiency with ETL development, SQL, PL/SQL, and PowerShell scripting.Technical Skills : - Experience with cloud platforms such as Azure and AWS for database management and administration. - Knowledge of DevOps integration with CI/CD pipelines. - Experience with data governance and security best practices. - Familiarity with statistical analysis and data mining techniques.Soft Skills : - Strong problem -solving and analytical skills. - Excellent communication skills for presenting data insights to stakeholders. - Ability to manage multiple tasks in a dynamic environment. - Willingness to learn and adapt to modern technologies and methodologies.Preferred Skills : - Experience with SAP BODS, Collibra, HVR (Fivetran), SAP SLT, and SAP BOXI (BOBI). Locations : Mumbai, Delhi / NCR, Bengaluru , Kolkata, Chennai, Hyderabad, Ahmedabad, Pune