Senior Technology & Data Engineer

Job Description

About this role: Wells Fargo is seeking a Senior Data Engineer. We believe in the power of working together because great ideas can come from anyone. Through collaboration, any employee can have an impact and make a difference for the entire company. Explore opportunities with us for a career in a supportive environment where you can learn and grow. In this role, you will: Lead moderately complex initiatives within Technology and contribute to large scale data processing framework initiatives related to enterprise strategy deliverables Build and maintain optimized and highly available data pipelines that facilitate deeper analysis and reporting Review and analyze moderately complex business, operational or technical challenges that require an in-depth evaluation of variable factors Oversee the data integration work, including developing a data model, maintaining a data warehouse and analytics environment, and writing scripts for data integration and analysis Resolve moderately complex issues and lead teams to meet data engineering deliverables while leveraging solid understanding of data information policies, procedures and compliance requirements Collaborate and consult with colleagues and managers to resolve data engineering issues and achieve strategic goals Required Qualifications: 4+ years of Data Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education Desired Qualifications: A bachelors degree or higher in computer science 4+ years of software engineering experience Default Required 4+ years of working experience in Data Ingestion, Data Curation, Data Extraction 4+ years of experience working on Basic spark (Spark architecture, Spark JDBC) and SQL Server 3+ years of experience with SQL & NOSQL database integration with Spark (MS SQL server and MongoDB) Working experience in Unix, GitHub (any version mgmt), Autosys, DevOps Working experience working on performance optimization in SQL Server and Spark 2+ years of Agile experience Job Expectations: Understanding of distributed systems (CAP theorem, partition and bucketing, replication memory layouts, consistency) Understanding of cloud-ready enterprise solutions in one or a combination of the following: Amazon Web Services (AWS), Google Cloud Platform (GCP) or Pivotal Cloud Foundry (PCF) Knowledge of Python, Apache Kafka, or Confluent Enterprise Ability to work effectively, as well as independently, in a team environment.