CoffeeBeans logo

Data Engineer

CoffeeBeans

5 - 9 years

Bengaluru

Posted:7 hours ago

Job Description

What you will be doing...


  • Leverage AWS services to ingest data from source systems within their business domain
  • Leverage databricks platform to process, clean and transform data
  • Ensure and measure data quality according to business requirements and tracked KPIs
  • Monitor and maintain existing data product such as data ingestion pipeline and ETLs
  • Alert and act on data quality issues and system incidents within their business domain
  • Ensure that data is available, accurate and fit for purpose following governance guidelines and compliance policies
  • Ensure that knowledge of data mesh framework is shared
  • Write and publish clear documentation of approaches and functionalities
  • Take part in all agile ceremonies (planning, backlog refinement, retrospective, stand ups…) and necessary team meetings
  • Make all artifacts available through version control tool such as git
  • Be part of the review process both as a reviewer as well as a submitter (PRs, architecture decisions, approaches….)


Skill Set :

  • 5 to 9 years of Strong experience developing software in an Agile environment following best practices
  • Experience with AWS cloud platform
  • Ability to write production grade python and Scala code
  • Ability to leverage Spark through Databricks platform (PySpark or Scala)
  • Ability to create and automate data ingestion pipelines for both batch and streaming data
  • Experience with monitoring and alerting tooling such as AWS Cloudwatch, Datadogs…
  • Experience deploying software using orchestration tools such as Jenkins

Skills Required

AWS Data Quality Data Ingestion Agile Version Control GIT AWS Cloud Python Spark Pyspark Jenkins ETL and data warehousing

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
CoffeeBeans logo
CoffeeBeans

RecommendedJobs for You

Hanuma Infotech logo

Data Engineer

Hanuma Infotech

India

Tibil Solutions logo

Data Engineer

Tibil Solutions

Bengaluru

CoffeeBeans logo

Data Engineer

CoffeeBeans

Bengaluru

Flexiple logo

Chennai

C

Data Engineer

Creencia Technologies

Bengaluru

D

Pune