Hadoop/Spark Lead Data Engineer

About this role:

Wells Fargo is Seeking a Lead Data Engineer.

In this role, you will:

• Lead complex initiatives with broad impact and act as key participant in large scale software planning for the Technology area
• Design, develop, and run tooling to discover problems in data and applications and report the issues to engineering and product leadership
• Review and analyze complex software enhancement initiatives for business, operational or technical improvements that require in depth evaluation of multiple factors including intangibles or unprecedented factors
• Make decisions in complex and multi-faceted data engineering situations requiring understanding of software package options and programming language and compliance requirements that influence and lead Technology to meet deliverables and drive organizational change
• Strategically collaborate and consult with internal partners to resolve highly risky data engineering challenges

Required Qualifications:

• 5+ years of Database Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education

Desired Qualifications:

• 5+ years of experience in building and leading data driven application design and implementation using Hadoop/Spark/Scala with very good experience in any of relational databases Teradata/Oracle Exadata.
• Designing, Developing and maintaining data pipelines using Apache Spark/Hadoop/MapReduce/HBase in MapR or other Hadoop distributions.
• Optimizing Spark Jobs for performance, scalability and resource utilization in shared infrastructure.
• Experience in Python/Scala/Java Programming languages.
• Experience with one of the cloud providers (AWS, GCP, Azure) preferably in GCP in the data area. Experience in data storage service, Google Clouse Storage, data processing Google Cloud Dataflow and data warehousing like Redshift/Azure Synapse/Google Big query.
• Designing and building Data Lake/Datawarehouse solution with experience in data modeling and ETL process using Teradata/Oracle relation databases.

• Experience in building Semantic model and reporting Application using Power BI
• Experience in Abinitio/Talend ETL tool