Sr Software Engineer (Data Engineer)

Responsibilities

• Demonstrate a deep knowledge of, and ability to operationalize, leading data technologies and best practice
• Partner end-to-end with Product Managers and Data Scientists to understand customer requirements and design prototypes and bring ideas to production
• We develop real products. You need to be an expert in design, coding, and scripting
• Facilitate problem diagnosis and resolution in technical and functional areas
• Encourage change, especially in support of data engineering best practices and developer satisfaction
• Write high-quality code that is consistent with our standards, creating new standards as necessary
• Demonstrate correctness with pragmatic automated tests
• Review the work of other engineers in a collegial fashion to promote and improve quality and engineering practices
• Develop strong working relationships with others across levels and functions
• Participate in, and potentially coordinate, Communities-of-Practice in those technologies in which you have an interest
• Participate in continuing education programs to grow your skills both technically and in the Williams-Sonoma business domain
• Serve as a member of an agile engineering team and participate in the team's workflow
  

Criteria

• 5 years of experience as a professional software engineer
• 3 - 5 years of experience with big data technologies
• Experience in building, distributed, scalable, and reliable data pipelines that ingest and process data at scale and in batch and real-time
• Strong knowledge of programming languages/tools including Spark, SQL, Python, Java, Scala, Hive, and Elasticsearch
• Experience with streaming technologies such as Spark streaming, Flink, or Apache Beam
• Experience with various messaging systems such as Kafka
• Experience in implementing Lambda Architecture
• Working experience with various SQL and NoSQL databases such as Snowflake, Cassandra, HBase, MongoDB, and/or Couchbase
• Working experience with various time-series databases such as OpenTSDB and Apache Druid
• Familiarity with ML and Deep Learning
• Working knowledge of various columnar storage such as Parquet, Kudu, and ORC
• An understanding of software development best practice
• Enthusiasm for constant improvement as a Data Engineer
• Ability to review and critique code and proposed designs, and offer thoughtful feedback in a collegial fashion
• Skilled in writing and presenting -- able to craft needed messages so they are clearly expressed and easily understood
• Ability to work independently on complex problems of varying complexity and scope
• Bachelor's degree in Computer Science, Engineering or equivalent work experience
  

About Us