Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in hyderabad
>
Coeo
>
Senior Data Engineer

Senior Data Engineer

Coeo

5 - 8 years

5 - 9 Lacs

hyderabad hyderabad

Posted:11 hours ago| Platform:

Apply

Skills Required

data engineering infrastructure big data data integration scripting languages azure databricks continuous integration python azure synapse microsoft azure pyspark ci/cd datafactory azure data factory sql server sql continuous delivery spark etl

Work Mode

Work from Office

Job Type

Full Time

Job Description

Responsibilities
Developing low to high-complexity, secure, governed, high-quality, and efficient data pipelines from a variety of on and off-premise, internal, and external data sources

Ensuring that data is cleansed, mapped, transformed, and optimized for storage to meet requirements for business and technical use cases

Building data observability and data quality by design into all Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies

Take all requirements into account when creating a proposal

Understanding and evaluating the organizational impact of new technologies and digital services

Troubleshooting and resolving issues

Requirements
Experience in working with large, event based, datasets in an enterprise environment

Minimum 6 years within an Azure or SQL Data Engineering environment

Engineering and database skills in SQL Server and/or Azure (Data Factory, Synapse) and the associated ETL technologies

Experience developing, driving, and maintaining Data Integration Roadmaps and best practices

Overall responsibility for all technical business requirements gathering deliverables and implementation

Ability to deliver high to low-level designs for Data Solutions and have a good understanding of the full data lifecycle

Hands-on experience in designing and developing scripts for custom ETL processes and automation in Azure Data Factory, Azure Databricks, Azure Synapse, Python, Pyspark, etc

Hands-on experience designing and developing stored procedures/functions and leveraging ETL packages/workflows

Expertise in Cloud-related Big Data integration and infrastructure tech stack using Azure Databricks and Apache Spark framework

Well-versed with scripting languages such as Python

Experience of Continuous Integration / Continuous Delivery (CI/CD)

Experience working in an agile environment and self-managing teams

Understanding and practical knowledge of testing techniques and tools

Desired Technologies
Big DataAzureSparkPythonAzure DatabricksAzure SynapseAzure Data FactorySQL ServerThis job was posted by Sonam Singh from Coeo

More Jobs at Coeo

Managed Services Team Lead (Analytics)

Hyderabad

6.0 - 8.0 yrs

INR 8 - 10 Lacs

BI Developer SAP BusinessObjects & Crystal Reports

Hyderabad

1.0 - 5.0 yrs

INR 6 - 10 Lacs

Data Engineer SQL, SSIS & Data Warehousing

Hyderabad

1.0 - 5.0 yrs

INR 6 - 10 Lacs

Talent Sourcer

Hyderabad

1.0 - 5.0 yrs

INR 2 - 5 Lacs

Recruitment Lead

Hyderabad, Telangana, India

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Big Data Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Coeo

Food and Beverage Manufacturing

Rennes

Login to

Please Verify Your Phone or Email

Confirm Action

Senior Data Engineer