Data Engineer

Requisition ID: 205977

Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.

The Wealth Data engineering team within the Global Wealth Engineering (GWE) is the key team delivering operational data solutions to various stake holders within Wealth Management.

We are seeking an experienced Data Engineer with deep expertise in Google Cloud Platform (GCP) to join our growing team. In this role, you will be responsible for designing, building, and maintaining scalable data architectures that support our data-driven initiatives. You will collaborate with a team of engineers including data architects, solution architects, business systems analysts and data engineers and ensure that our data infrastructure is robust, secure, and optimized for performance.

Is this role right for you? In this role you will:

• Designing, building, operationalizing the Wealth Data Hub (WDH) using Google Cloud Platform (GCP) data services such as DataProc, Dataflow, CloudSQL, BigQuery, CloudSpanner in combination with third parties such as Spark, Apache Beam/ composer, DBT, Cloud PubSub, Confluent Kafka, Cloud storage Cloud Functions & Github
• Designing and implementing data ingestion patterns that will support batch, streaming and API interface on both the Ingress and Egress
• Work with a team of data engineers in developing framework and custom code using best practices that will meet the demanding performance requirements
• Design and build production data pipelines from data ingestion to consumption using GCP services, Java, Python, Scala, BigQuery, DBT, SQL etc.
• Develop solutions using Cloud Dataflow and Java/Python for deploying streaming jobs in GCP as well as batch jobs using text/JSON files and writing them to BigQuery
• Build and manage data pipelines with a deep understanding of workflow orchestration, task scheduling and dependency management
• Ability to do proof of technology using GCP technologies and work with data architects, solution architects to achieve the desired results and performance.
• Technical ability and expertise on how to effectively use Google Cloud to build solutions; creatively applying cloud infrastructure and platform services to help solve business problems; and communicating these approaches to different business users
• Implement application logging, notification, jobs monitoring and performance monitoring

Do you have the skills that will enable you to succeed in this role? We'd love to work with you if you have:

• 4+ years of experience in data engineering, performance optimization for large OLTP applications with a minimum of 2+ years of working experience as Google Cloud Platform (GCP) developer
• Experience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub etc.
• Experience with Google Cloud Platform Databases (SQL, Spanner, PostgreSQL)
• Experience working with relational/NoSQL databases
• Experience with data streaming and technologies such as Kafka, Spark-streaming etc.
• Experience with Infrastructure as Code (IaC) practices and frameworks like Terraform
• Knowledge of Java microservices and Spring Boot
• Strong architecture knowledge with experience in providing technical solutions for cloud infrastructure
• Working knowledge of developing and scaling JAVA REST services, using frameworks such as Spring
• Good communication and problem-solving skills. Ability to effectively convey ideas to business and technical teams
• Understanding of Wealth business line and the various data domains required for building an end-to-end solution
• Bachelor's degree in computer science, Engineering, or a related field. A master's degree is a plus
• GCP certifications (e.g., Professional Data Engineer, Professional Cloud Architect) are highly desirable

What's in it for you?

• Diversity, Equity, Inclusion & Allyship - We strive to create an inclusive culture where every employee is empowered to reach their fullest potential, respected for who they are, and are embraced through bias-free practices and inclusive values across Scotiabank. We embrace diversity and provide opportunities for all employee to learn, grow & participate through our various Employee Resource Groups (ERGs) that span across diverse gender identities, ethnicity, race, age, ability & veterans.
• Accessibility and Workplace Accommodations - We value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. Scotiabank continues to locate, remove and prevent barriers so that we can build a diverse and inclusive environment while meeting accessibility requirements.
• Upskilling through online courses, cross-functional development opportunities, and tuition assistance.
• Competitive Rewards program including bonus, flexible vacation, personal, sick days and benefits will start on day one.
• Dynamic Ecosystem - Free tea & coffee, universal washrooms, and lots of space for team collaboration.
• Community Engagement - No matter where you choose to work from; we offer opportunities for community engagement & belonging with our various programs such as hackathons, contests, cooking with friends, Humans of Digital and much more!

Working location condition: Hybrid

#LI-Hybrid

Location(s): Canada : Ontario : Toronto

Scotiabank is a leading bank in the Americas. Guided by our purpose: "for every future", we help our customers, their families and their communities achieve success through a broad range of advice, products and services, including personal and commercial banking, wealth management and private banking, corporate and investment banking, and capital markets.

At Scotiabank, we value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. If you require accommodation (including, but not limited to, an accessible interview site, alternate format documents, ASL Interpreter, or Assistive Technology) during the recruitment and selection process, please let our Recruitment team know. If you require technical assistance, please click here. Candidates must apply directly online to be considered for this role. We thank all applicants for their interest in a career at Scotiabank; however, only those candidates who are selected for an interview will be contacted.