Before Borders

Specialist - Data Engineering

ltimindtree•Mississauga, ON•Posted Nov 18, 2026
SeniorFull Time

About this role

Job Summary

Seeking a Specialist with 5 to 7 years of experience in Scala and Apache Spark to design develop and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem

Job Description

Design develop and optimize scalable data processing applications using Scala and Apache Spark Collaborate with crossfunctional teams including data scientists analysts and architects to build and maintain robust data pipelines Analyze large and complex datasets to extract actionable insights supporting business objectives Develop highperformance applications in distributed computing environments leveraging SparkSQL Ensure code quality maintainability and adherence to Scala programming best practices Continuously evaluate and integrate emerging big data technologies and tools to enhance platform capabilities Troubleshoot and resolve complex data processing issues to maintain system reliability Document technical designs and implementation details for effective knowledge sharing

Roles and Responsibilities

Lead the development and deployment of big data solutions leveraging Scala Apache Spark and SparkSQL

Collaborate with stakeholders to gather requirements and deliver effective data solutions

Optimize Spark jobs for performance and scalability in production environments

Mentor junior team members and provide technical guidance on best practices

Conduct code reviews to ensure adherence to coding standards and promote continuous improvement

Monitor system performance proactively and address bottlenecks or failures

Participate in sprint planning estimation and agile ceremonies to deliver highquality software

Ensure compliance with data governance and security policies Mandatory Skills : Apache Spark, Scala

Good to Have Skills : Hadoop Spark SparkSQL - Scala

Responsibilities

  • Lead the development and deployment of big data applications using Scala within Hadoop and Spark ecosystems

Qualifications

  • check
    Seeking a Specialist with 5 to 7 years of experience skilled in Scala and Apache Spark to design and develop scalable big data solutions within the Hadoop and Spark ecosystems
  • check
    Design develop and maintain scalable big data applications using Scala in Hadoop and Spark environments Implement efficient data processing pipelines leveraging Apache Spark for largescale data transformation and analysis Collaborate with crossfunctional teams to integrate big data solutions with enterprise systems Optimize existing Spark applications and workflows to enhance performance and relia
  • check
    Architect and implement SparkSQL queries to support data analytics and reporting requirements
  • check
    Mentor junior team members and provide technical guidance on Scala and big data technologies
  • check
    Collaborate with data engineers data scientists and business stakeholders to understand requirements and deliver solutions
  • check
    Ensure data quality security and compliance standards are met throughout the data lifecycle
  • check
    Drive continuous improvement initiatives to enhance data processing efficiency and scalability
  • check
    Manage and monitor production big data workflows to ensure high availability and fault tolerance

Immigration pathway

ON • Express • onsite • TEER 1