Lead Data Engineer

About this role:

Wells Fargo is seeking a Lead Data Engineer

In this role, you will:

Lead moderately complex initiatives within Technology and contribute to large scale data processing framework initiatives related to enterprise strategy deliverables

Build and maintain optimized and highly available data pipelines that facilitate deeper analysis and reporting

Review and analyze moderately complex business, operational or technical challenges that require an in-depth evaluation of variable factors

Oversee the data integration work, including developing a data model, maintaining a data warehouse and analytics environment, and writing scripts for data integration and analysis

Resolve moderately complex issues and lead teams to meet data engineering deliverables while leveraging solid understanding of data information policies, procedures and compliance requirements

Collaborate and consult with colleagues and managers to resolve data engineering issues and achieve strategic goals.

Required Qualifications:

6+ years of Data Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education

Desired Qualifications:

6+ years of Data Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education

6+ years of Strong Experience of Spark/Scala of scala:map,flatMap,option,future,lazy,implicits,fold,immutability, Spark Core, Spark SQL, Data Frames, Datasets

3+ Experience on Python or other scripting languages

3+ years of data warehouse experience, SQL experience (Oracle, SQL, PL/SQL). Understand and write the complex SQL queries and have in-depth understanding of oracle database

Prior experience of leading the teams and running the major programs is needed.

Strong experience with Hadoop, Hive, Autosys

Good knowledge of non-relational DBMS platforms, (MongoDB or Neo4j), real-time data streaming via Kafka

Working knowledge in developing end to end ML/AI pipeline in Apache Spark, Sparkling Waters, H2O, experience in working on LLMs. Exposer to Agentic AI frameworks.

Ability to work with Data Engineers in discovering and optimizing bottlenecks in the AI/ML pipeline for real-time or near-real-time applications that consumes large throughput of data

Perform various complex activities related to statistical/machine learning. Provide analytical support for developing, evaluating, implementing, monitoring and executing models across business verticals using emerging technologies including but not limited to Python, Agentic AI frameworks like ADK, GCP vertex AI and NLP.

Good understanding of distributed system and parallel processing, spark architecture in depth

Prior knowledge on Ab initio ETL or any other ETL tools would be beneficial but not mandatory.

Proficient in large scala data processing, Hands-on experience with different file formats, very good understanding of Unix command & Shell scripting.

Hands-on experience with GCP or other cloud platforms (AWS/Azure)

Familiarity with CI/CD pipelines, infrastructure as code and cloud deployment best practices

Ability to conduct code reviews with focus on testability and code coverage.

Should have executed end to end projects in data engineering

Should have experience working in an Agile environment using Scrum or Kanban.

Fluent in communication

Posting End Date:

21 Jun 2026

Job posting may come down early due to volume of applicants.

We Value Equal Opportunity

Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business unit’s risk appetite and all risk and compliance program requirements.

Candidates applying to job openings posted in Canada: Applications for employment are encouraged from all qualified candidates, including women, persons with disabilities, aboriginal peoples and visible minorities. Accommodation for applicants with disabilities is available upon request in connection with the recruitment process.

Applicants with Disabilities

To request a medical accommodation during the application or interview process, visit Disability Inclusion at Wells Fargo.

Drug and Alcohol Policy

Wells Fargo maintains a drug free workplace. Please see our Drug and Alcohol Policy to learn more.

Wells Fargo Recruitment and Hiring Requirements:

a. Third-Party recordings are prohibited unless authorized by Wells Fargo.

b. Wells Fargo requires you to directly represent your own experiences during the recruiting and hiring process.