Airflow Data Engineer

Virtusa

7 - 10 years

3 - 7 Lacs

hyderabad

Posted:2 days ago| Platform:

Apply

Skills Required

data engineer hive python data pipelines airflow databricks elt business intelligence data engineering nosql sql star schema data quality spark kafka hadoop ecosystem hadoop kimball big data etl azure nosql databases

Work Mode

Work from Office

Job Type

Full Time

Job Description

Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity
Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increase data accessibility, and fostering data-driven decision making across the organization
Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on itWrites unit/integration tests, contributes to engineering wiki, and documents work
Designs and develops data integrations and data quality frameworkBachelor of Engineering or equivalent degree in Computer Science or a related technical fieldAt least 7+ years of experience in the Data engineering field
6+ years of experience in Big Data, Hadoop Ecosystem, Spark, Python, SQL, Hive, Proficiency in relational SQL and NoSQL databases
In-depth skills in developing and maintaining ETL/ELT data pipelines Experience in data modelling techniques such as Kimball star schema
Hands-on experience with Azure Cloud services such as Azure Data Factory (ADF), Databricks, and Cloud Storage
Proficient In Airflow configuration and creating dependencies
Experience in workflow management tools such as Airflow, Data streaming App such as Kafka, and CI/CD toolsExcellent communication and collaboration skills, with the ability to work effectively in a team environment

More Jobs at Virtusa

Servicenow QA

Bengaluru, Karnataka

3 - 3 yrs

Salary: Not disclosed

React T3

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Java-Pankaj

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

C ++

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Java Architect (ATC)

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Data Engineer Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.