Data Engineer

Talent21

5 - 8 years

15 - 20 Lacs

hyderabad

Posted:-1 days ago| Platform:

Apply

Skills Required

pyspark data bricks python sql

Work Mode

Work from Office

Job Type

Full Time

Job Description

Experience: 5-7years
Shift Timings: 1:00 pm to 10:00 pm Main location: Hyderabad Work Type: Work from office Skill: Spark (PySpark), Python and SQL. Employment Type: Full Time

Must have Skills:

5+ yrs. Development experience with Spark (PySpark), Python and SQL.
• Extensive knowledge building data pipelines • Hands on experience with Databricks Devlopment • Strong experience developing on Linux OS. • Experience with scheduling and orchestration (e.g. Databricks Workflows,airflow, prefect, control-m).

Good to have skills:

Solid understanding of distributed systems, data structures, design principles.
• Agile Development Methodologies (e.g. SAFe, Kanban, Scrum). • Comfortable communicating with teams via showcases/demos. • Play key role in establishing and implementing migration patterns for the Data Lake Modernization project. • Actively migrate use cases from our on premises Data Lake to Databricks on GCP. • Collaborate with Product Management and business partners to understand use case requirements and reporting. • Adhere to internal development best practices/lifecycle (e.g. Testing, Code Reviews, CI/CD, Documentation) . • Document and showcase feature designs/workflows. • Participate in team meetings and discussions around product development. • Stay up to date on industry latest industry trends and design patterns. • 3+ years experience with GIT. • 3+ years experience with CI/CD (e.g. Azure Pipelines). • Experience with streaming technologies, such as Kafka, Spark. • Experience building applications on Docker and Kubernetes. • Cloud experience (e.g. Azure, Google).

More Jobs at Talent21

Down Stream Process Executives & Operators

Hyderabad

2 - 6 yrs

INR 2 - 5 Lacs

Dy Manager / Manager (Pharma -Production)

Hyderabad

10 - 15 yrs

INR 6 - 13 Lacs

Dy Manager/Manager

Hyderabad

10 - 15 yrs

INR 8 - 10 Lacs

IBM App Connect Support Engineer

Bengaluru

3.0 - 5.0 yrs

INR 0 - 0 Lacs

Downstream process executives & operators Required

Hyderabad

2.0 - 5.0 yrs

INR 0 - 3 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.