Data Engineer

Data Engineer

Gurugram/Noida

Full-time

2-5 years

Job Summary:

As a Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines and data infrastructure. Your expertise in Python and experience with big dataset and key performance indicators (KPIs) will be crucial in delivering high-quality data solutions.

Key Responsibilities:

• Design and implement scalable data pipelines to collect, process, and store data.
• Collaborate with analysts and business stakeholders to understand data needs and translate them into technical requirements.
• Develop ETL processes to integrate various data sources, ensuring data quality and consistency.
• Monitor and optimize data pipelines for performance and reliability.
• Work with call center KPIs, developing metrics and reporting solutions to drive insights and improve performance.
• Utilize tools such as Azure Synapse, Databricks, or Fabric to manage data workflows and enhance data processing capabilities.
• Implement and maintain data modeling solutions to support analytics and reporting.
• Create and manage data lake solutions, ensuring proper data ingestion, transformation, and storage.
• Ensure compliance with data governance and security standards.
• Document data workflows, pipeline architectures, and technical specifications.
• Troubleshoot data pipeline issues and optimize performance through tuning and maintenance.
• Stay updated on industry trends and emerging technologies related to data engineering and analytics.

Qualifications:

• Bachelors degree in Computer Science, Data Science, Information Technology, or a related field.
• 4-8 years of experience in data engineering or a related role.
• Proficiency in Python for data processing and pipeline development.
• Experience with data pipeline tools and frameworks (e.g., Apache Airflow, Apache Spark).
• Familiarity with SQL and relational databases (e.g., MySQL, PostgreSQL).
• Experience handling call center data and understanding of key performance indicators (KPIs) relevant to the industry.
• Strong analytical and problem-solving skills.
• Excellent communication skills and ability to collaborate with cross-functional teams.

Preferred Qualifications:

• Experience with Azure Synapse, Databricks, data lake or Fabric for data processing and analytics.
• Knowledge of big data technologies.
• Familiarity with data visualization tools (e.g., Tableau, Power BI).
• Experience with data orchestration tools for managing data pipelines.
• Familiarity with data warehousing concepts and architectures.