Senior Data Engineering Technical Lead
Administration/PA/Secretary - Datacapturing Western Cape FULL TIME Job Summary Key Responsibilities Data Engineering & Migration Leadership * Design and deliver large-scale data migration strategies supporting identity transformation across multi-petabyte datasets. * Develop data lineage mapping and validation frameworks to ensure migration accuracy, traceability, and data integrity. * Build scalable batch and streaming data transformation pipelines with parallelized orchestration. * Lead JDK and Apache Spark upgrade initiatives while maintaining production stability and performance. * Implement monitoring, alerting, and observability capabilities to optimize data pipeline performance and system health. * Create robust testing and validation frameworks to support complex migration and transformation scenarios. Technical Leadership & Engineering Excellence * Take technical ownership of critical platform and data engineering components. * Mentor and support engineers through pair programming, code reviews, and collaborative problem-solving. * Lead technical design and architecture discussions, ensuring alignment with engineering best practices and enterprise standards. * Drive successful delivery by proactively identifying risks, dependencies, and blockers. * Collaborate closely with cross-functional stakeholders to achieve technical alignment and project objectives. Required Experience & Qualifications * Minimum of 8 years' experience in Data Engineering or related software engineering roles. * Bachelor’s or Master’s degree in Computer Science, Engineering, or equivalent practical experience. * Demonstrated expertise in large-scale data migration programs and ETL pipeline development. * Advanced proficiency in Scala and Java, with experience using Gradle or Maven. * Strong hands-on experience with Apache Spark and distributed storage systems such as HDFS, Amazon S3, or Google Cloud Storage. * Experience working with cloud-based data platforms including AWS, GCP, Azure, or Databricks. * Practical experience with AWS EKS and Kubernetes-based deployments. * Sound understanding of data privacy, security, and compliance regulations, preferably GDPR. * Strong distributed systems knowledge, architecture expertise, and problem-solving capabilities. Preferred Experience…
This page lists jobs opportunities in Unknown. Use the filters to narrow by city, work model, and closing date, then open each listing on the original employer or job board page before you apply.
Applying for permanent roles
- Mirror the job title and top three requirements in your CV summary and most recent experience.
- Quantify results where possible: sales targets, cases handled, tickets closed, or team size.
- Proofread contact details and filenames before submitting — small errors cost interviews.
- Verify the company and role on the source page before sharing ID copies or banking details.
Need broader help? Read our job scam safety guide and editorial policy.
The full posting may include additional requirements. .