Share this Job

Title:  Lead Data Engineer

 

 

 

Requisition ID: 80261

 

Join the Global Community of Scotiabankers to help customers become better off.

 

 
As Scotiabank’s engine of modernization, the PLATO platform enables technology teams to build software quickly and securely using modern practices. PLATO is an integrated set of technical capabilities, services and processes that encapsulate critical enterprise functions through standardization, re-use and automation.

 

The PLATO team is comprised of engineers, problem solvers, agilists and creatives in roles such as Enterprise Platform Engineering and Architecture, Enterprise Data Services, Cloud Infrastructure and Architecture, Product Engineering, and Product Management. Together, the team provides the platform that enables the Bank to deliver transformative experiences that help our 24 million customers become better off.

Interested in joining an agile team that’s impacting change for our customers around the world? Watch our video.

 

 

Job Summary

The data engineer designs, develops, tests, implements, and maintains complex (SQL) ELT functions, user defined functions  and complex queries for custom solutions with limited direction. Leads and coordinates code/peer review of focused development work to insure it aligns to the business and technical requirements

 

Key Accountabilities

1) Data Pipeline Development

  • Analyze, define and document requirements for data pipelines on GCP including workflow, logical processes, hardware and operating system environment, interface with other systems, internal and external checks, controls, and outputs
  • Work with business/data analyst in performing investigation, analysis and evaluation to determine business requirements
  • Design, develop and maintain ELT specific code
  • Design reusable components, user defined functions
  • Troubleshoot production support issues post - deployment and come up with solutions as required

 

2) Data Testing

  • Coordinate coding, testing, implementation, integration and documentation of solution. Develop program specifications
  • Perform complex applications programming activities. Code, test, debug, document, maintain, and modify complex applications program
  • Provide support in the implementation of processes within the QA and production environments

 

3) Code Development

  • Develop functions/apis in Python, Java for use in other ELT tools such as CDF

 

Functional Competencies

  • Possesses solid knowledge of design and analysis methodology and application development processes from both an industry and client perspective
  • Ability to translate business source-to-target mappings to relevant technical source-to-target mapping
  • Demonstrates good understanding of the Software Development Life Cycle
  • Proficiency in ETL tools - specifically Talend, Data Stage or Informatica. Cloud Data Fusion experience a huge plus.
  • Strong understanding of Cloud concepts and technologies (GCP, Azure or AWS)
  • Experience of working with relational or columnar databases specifically BigQuery or Cloud Spanner
  • Strong SQL skills
  • Experience and knowledge of data architecture and concepts of relational and dimensional databases
  • Experience with enterprise application architecture and enterprise integration patterns
  • Ability to implement re-usable data-integration/ETL code in an enterprise data-warehouse environment
  • Previous experience of working in an Agile Development environment
  • Ability to work well in a challenging environment.
  • Strong troubleshooting skills
  • Excellent writing skills, oral communication skills, strong process skills, and leadership ability.
  • Ability to multi-task and prioritize for self and team members.
  • Examine and solve the performance bottlenecks in the ETL process

Must Have

  • Python/Java/Scala
  • Experience with MapReduce

 

 

Location(s):  Canada : Ontario : Toronto 

As Canada's International Bank, we are a diverse and global team. We speak more than 100 languages with backgrounds from more than 120 countries. Our employees are committed to a superior customer experience and use the Bank’s six guiding sales practice principles to ensure they act with honesty and integrity.

 

At Scotiabank, we value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. If you require accommodation (including, but not limited to, an accessible interview site, alternate format documents, ASL Interpreter, or Assistive Technology) during the recruitment and selection process, please let our Recruitment team know. If you require technical assistance, please click here. Candidates must apply directly online to be considered for this role. We thank all applicants for their interest in a career at Scotiabank; however, only those candidates who are selected for an interview will be contacted.


Job Segment: Database, Bank, Banking, Engineer, Developer, Technology, Finance, Engineering