Data Engineer – Banking (CIB)

In brief

**Overview** BluePearl Consulting is seeking a Data Engineer to join a software and data engineering team within a Corporate and Investment Banking (CIB) environment. This is a single vacancy for a 12-month contract, with a potential extension up to 36 months. The role is based in Rosebank, Johannesburg, Gauteng, and operates on a hybrid work arrangement requiring approximately 3 days onsite per week. The expected start date for this position is 1 January 2027. The successful candidate will specialise in designing, developing, and maintaining scalable data pipelines, data integration solutions, and cloud-based data platforms, with a core focus on AWS. **What you will do** Key responsibilities for this role include: * Designing, developing, and maintaining scalable ETL/ELT pipelines and data ingestion processes. * Writing, optimising, and troubleshooting advanced SQL queries, including CTEs and window functions. * Developing reusable Python modules, libraries, and automated tests. * Building and maintaining relational, dimensional, and analytical data models. * Implementing data transformations, mappings, validation, and reconciliation processes. * Developing and maintaining data pipelines using AWS data services. * Implementing data orchestration and workflow automation using appropriate tools. * Working with distributed processing technologies such as Spark and PySpark where required. * Supporting data warehousing, data lakes, and lakehouse architectures. * Implementing data quality rules, exception handling, and source-to-target reconciliation. * Applying data security, access control, encryption, and privacy practices. * Implementing logging, monitoring, alerting, and data observability. * Contributing to Git-based version control, CI/CD, and automated deployment pipelines. * Developing and maintaining unit, integration, regression, and reconciliation tests. * Troubleshooting production incidents, conducting root-cause analysis, and supporting operational recovery. * Maintaining technical documentation, data mappings, designs, and operational runbooks. * Collaborating with software engineers, data engineers, and business stakeholders. **Requirements (from the original advert)** The following are non-negotiable requirements for this position: * Relevant banking or financial services experience. * Strong hands-on Data Engineering experience. * Advanced SQL engineering, including query optimisation, CTEs, window functions, and query plans. * Strong Python engineering, including reusable modules, libraries, and testing. * Practical ETL/ELT, data ingestion, and transformation experience. * Data modelling experience across relational, dimensional, or analytical models. * Cloud data engineering experience, with AWS as the core platform requirement. * Experience with data quality, validation, and reconciliation. * Knowledge of data security, access control, and privacy. * Familiarity with Git, CI/CD, automated testing, and production support. * Strong troubleshooting, problem-solving, and technical documentation skills. * Ability to work independently and take ownership of deliverables. * Excellent communication and stakeholder management skills. * Availability to work onsite in Rosebank approximately 3 days per week. * Availability to commence on 1 January 2027. Core technical skills required include: * AWS * Advanced SQL * Python * ETL/ELT * Data ingestion and transformation * Data modelling * Data quality and reconciliation * Data orchestration * Git and CI/CD * Automated testing * Monitoring and production support Role-critical technologies include: * AWS S3, Glue, Lambda, Athena, Redshift, and EMR. * Spark and PySpark. * Kafka and event-driven processing. * Data warehousing, data lakes, and lakehouse engineering. * Delta Lake and medallion architecture patterns. * SQS, SNS, and EventBridge. * Airflow/MWAA and Step Functions. * Terraform and Infrastructure as Code. * Metadata, data catalogues, and lineage. * Performance optimisation, partitioning, and query tuning. **Who should apply** The ideal candidate is described as a strong, experienced, hands-on Data Engineer with relevant banking or financial services experience. They should possess advanced SQL and Python capabilities and AWS expertise. This individual should be a proactive self-starter who takes ownership of deliverables, solves problems independently, and has a proven ability to deliver reliable data solutions. They are expected to maintain high standards of data quality, security, and engineering discipline, requiring minimal supervision. Key attributes include strong banking awareness, analytical problem-solving skills, excellent written and verbal communication, strong attention to detail and data quality, professional stakeholder engagement, and a smart, professional presentation appropriate to a banking environment. **Deadline** Not specified **Reference** Original posting: https://www.jobmail.co.za/jobs/it-computer/other-it-computer/johannesburg/data-engineer-%E2%80%93-banking-cib-id-7608466 Source: jobmail

Summary drafted with AI assistance from the original advert. The advert itself is the authority — how we use AI.

At a glance

• Python
• SQL
• AWS
• Git

Extracted automatically from the advert; confirm requirements on the original listing.

Job description

Before you apply

• Confirm the requirements and closing date on the original listing (jobmail). SPANi lists vacancies from other sites and may not reflect last-minute changes.
• Legitimate employers do not charge application, registration or training fees.
• Don't send your ID or bank details before you have confirmed the employer is real.

How to spot a job scam

Applying for contract roles

• State your notice period, contract length you can commit to, and earliest start date.
• Highlight recent project delivery and tools used, not only long-ago permanent roles.
• Confirm whether the role is PAYE, independent contractor, or labour-broker before accepting.
• Keep records of the listing URL and closing date in case you need to follow up.