Senior Data & DevOps Engineer

Techwave

Join us!

Who are we?

Techwave

Founded in 2004, headquartered in Houston, TX, USA, Techwave leverages its expertise in Digital Transformation, Enterprise Applications, and Engineering Services to enable businesses accelerate their growth.

Plus, we're a team of dreamers and doers who are pushing the boundaries of what's possible.

YOU

Senior Data & DevOps Engineer

Experience: 5 to 8 years
Location: HyderabadEmployment Type: Full-Time

Job Summary:

We are seeking a highly motivated and technically skilled Senior Data & DevOps Engineer to join our dynamic data team. The ideal candidate will have 58 years of experience and a strong foundation in Azure DevOps, PowerShell scripting, Power BI deployment, and data engineering with PySpark. You will be responsible for managing CI/CD pipelines, automating deployments, and developing scalable data pipelines using Azure Data Factory (ADF). Knowledge of Microsoft Fabric and broader Azure Data Services is a plus.

Key Responsibilities:

• Design, implement, and manage CI/CD pipelines using Azure DevOps for data and BI solutions.
• Automate deployment workflows using PowerShell across multiple environments.
• Manage and optimize Power BI Deployment Pipelines, including promotion across dev/test/prod stages.
• Develop and maintain PySpark notebooks for data processing and transformation.
• Create and monitor scalable data pipelines using Azure Data Factory (ADF).
• Collaborate with data analysts, engineers, and business stakeholders to ensure smooth data delivery.
• Perform troubleshooting, optimization, and performance tuning for data workflows.
• Ensure adherence to best practices for version control, code review, and deployment.
• Explore and contribute to the adoption of Microsoft Fabric and other emerging data platform capabilities (Good to have).

Required Skills & Experience:

• 58 years of professional experience in DevOps and/or Data Engineering roles.
• Strong hands-on experience with Azure DevOps (Repos, Pipelines, YAML, Artifacts).
• Proficient in PowerShell scripting for task automation and environment configuration.
• Experience managing Power BI Deployment Pipelines and publishing reports/datasets.
• Solid hands-on experience with Azure Data Factory (ADF) creating, scheduling, and monitoring pipelines.
• Practical experience with PySpark notebooks for data wrangling and ETL.
• Familiarity with Git and version control best practices.

Good to Have:

• Exposure to Microsoft Fabric components (Lakehouse, Data Activator, Pipelines, etc.).
• Knowledge of broader Azure services such as Azure Data Lake Storage (ADLS), Azure Synapse, or Azure SQL.
• Experience with DataOps practices and frameworks.
• Familiarity with Agile methodologies and tools like Jira or Azure Boards.

Soft Skills:

• Excellent problem-solving and troubleshooting skills.
• Strong communication and collaboration abilities.
• Self-motivated and eager to learn emerging technologies.

Educational Qualification:

Bachelors or Masters degree in Computer Science, Information Technology, Data Engineering, or related field.