Data Engineer | GeakMinds

About:

We are looking for a Data Engineer with experience in building and maintaining scalable data pipelines and analytics solutions. The ideal candidate will work with SQL, PySpark, and Azure services to design, develop, and optimize ETL/ELT workflows, enabling reliable data delivery for analytics and business intelligence initiatives.

Roles and Responsibilities

• Design, develop, and maintain ETL/ELT pipelines using PySpark, SQL, and Azure Databricks.
• Work with streaming and batch data using Apache Kafka and other messaging platforms.
• Build and optimize data pipelines in Azure Data Services including Databricks and Fabric.
• Transform, clean, and validate large datasets for analytics and reporting.
• Collaborate with data architects, analysts, and business stakeholders to meet data requirements.
• Monitor, troubleshoot, and optimize data workflows for performance and reliability.
• Implement best practices for data quality, governance, and security.
• Support integration of structured and unstructured data from multiple sources.

Experience:

• 1-2 years of experience as a Data Engineer or similar role.
• Strong SQL skills for querying, data transformation, and optimization.
• Hands-on experience with PySpark for big data processing.
• Experience working with Azure Databricks or Azure Fabric.
• Knowledge of ELT/ETL processes and workflow orchestration.
• Familiarity with streaming platforms such as Kafka is a good to have.
• Understanding data warehousing, data lakes, and cloud data architectures.
• Experience monitoring, logging, and troubleshooting data pipelines.
• Strong problem-solving skills and ability to work collaboratively in a team environment.
• Azure/GCP/AWS Certifications preferred