Sr AWS Data Engineer

Job Description

Greetings! I hope this email finds you well. Job Summary: Expertise in AWS,Databricks and Pyspark A set of expectations for Mid/Senior Data Engineer role (in our DSOL department): • min. 3 yrs on role Software Engineering + Backend Eng. (one of languages: Python, Java, Scala, Rust - with focus on Python today) o practice with high quality codes (unit testing, integration testing, others) + code metrics o fast discovery what is in new repository code, asking right technical questions about codebase and code quality, CI/CD as a general rule of work (automatic tasks, instead of manual) • min. 2 yrs on role near "data" subject like Data Engineer or Integrations Engineer o strong understanding data pipelines in Apache Spark, Apache Airflow and similar orchestrators o understanding on mid. level Databricks or other modern platforms BigData solutions inside (i.e. data catalogs, computes engines, SQL engines, observability layers, etc.) o strong focus on delivery data pipelines on high quality from data product delivery perspective o practical exp. with data streams and Petabytes scale • min. 1 yr with exp. near data integrations (data pipelines, connection for diff. types of data sources and sinks) • soft skills for discussion with vendors/partners about possible solutions/limits/properties in technical integrations and different data architectures • strong technical arguments in technologies in data integrations and BigData areas (focused on Open Source tools) • + basic AWS knowledge (Lambda, SQS, CloudWatch, Powertools)