Data Engineer (WI_Data Engineer)
- Location
- Johannesburg, Gauteng
- Minimum qualification
- Bachelor's degree
- Closing date
First listed . Last checked at source .
In brief
**Overview** The Data Engineer role at andBeyond, specifically within Wild Impact and based at their Johannesburg Head Office, reports to the Senior Manager: Impact Insights. This is an experienced, above-entry-level position designed for a hands-on professional. The role focuses on designing, building, and maintaining the organisation’s data infrastructure. The successful candidate will be responsible for creating reliable data pipelines and a secure central data platform, improving data quality and accessibility, and enabling recurring programme reporting, ad hoc analysis, and biannual Impact overview reports across Wild Impact’s global portfolio. **What you will do** * Act as technical owner of the organisation's operational data and data platform, accountable for its integrity, availability, security and day-to-day running, and agree data ownership and stewardship roles with programme and business teams. * Keep data systems running reliably: monitor them, fix problems quickly, manage changes carefully and document how they work. * Design, build and maintain scalable, secure and cost-efficient batch and near-real-time data pipelines, including from field collection tools (e.g. ODK, SurveyCTO, Survey123, Microsoft Forms). * Establish and maintain a central data platform in Azure, including data lakes, warehouses (e.g. Azure SQL Database and/or Microsoft Fabric) and curated data outputs that support programme and organisational impact review reporting. * Develop and orchestrate ETL/ELT processes that ingest, transform and integrate structured and unstructured data from programme, GIS and operational systems. * Take responsibility for building well-designed relational databases and managing the workflows involved in moving from a spreadsheet-based system to them, including planning the migration and cleaning, validating and loading existing spreadsheet data. * Optimise data solutions for performance, scalability, maintainability and cloud cost. * Define and maintain data models, schemas, metadata, documentation (including a data dictionary and data flow maps) and data lineage to improve accessibility and consistent use of information. * Turn well-structured operational data into M&E data: map operational records to results frameworks and indicator definitions, build and maintain the transformation logic that derives indicators, and validate the outputs with the Impact Insights team. * Manage data imports, cleansing, reconciliation and master-data practices, including unique beneficiary identifiers, and resolve the root causes of recurring quality issues. * Work with the Impact Insights team to digitise and version data collection forms and keep them aligned to indicator changes. * Build automated dashboards and reports in Power BI for programme managers, executives, the board and funders. * Automate recurring reporting to reduce manual spreadsheet work. * Respond to ad hoc data requests with clear documentation of sources and assumptions. * Apply appropriate access controls (Microsoft Entra ID), encryption, backup and recovery practices, with particular care for children's and health data. * Support compliance with data governance, privacy and security requirements, including POPIA, the organisation's data protection policy and funder requirements, working with the Information Officer. * Support consent management and data subject requests and assist with breach response procedures. * Contribute to data-sharing agreements with partners, government departments and evaluators. * Partner with programme teams, the GIS Insights and Systems Officer, analysts and other stakeholders to translate requirements into practical data solutions, and recommend improvements to data collection, tracking and presentation. * Provide training and technical support to Johannesburg-based and regional programme teams to strengthen data literacy and accurate data capture. * Support the recruitment, mentoring and day-to-day technical guidance of Junior Data Analysts, in collaboration with the GIS Insights and Systems Officer. * Recommend fit-for-purpose, cost-effective tools, making full use of Microsoft non-profit licensing, and stay current with sector practice in operational data management, digital M&E and responsible data use. **Requirements (from the original advert)** * Bachelor’s degree in computer science, Data Engineering, Information Systems or a closely related field. * 3 to 5 years' relevant experience in data engineering or a closely related role. * Demonstrated experience designing, building and maintaining data warehouses, data lakes and robust ETL/ELT pipelines. * Strong proficiency in SQL and Python, including data transformation, automation, testing and performance tuning. * Practical experience with relational databases and exposure to NoSQL technologies. * Hands-on experience with at least one major cloud platform, preferably Microsoft Azure. * Experience with version control, code review, automated testing, CI/CD and infrastructure-as-code practices. * Working knowledge of POPIA and good data protection practices. * Valid South African driver's licence and willingness to travel to programme sites. **Who should apply** An experienced, above-entry-level data engineering professional who is hands-on and capable of working independently. The ideal candidate can guide junior team members and partner effectively with programme, GIS, Data teams, and organisational stakeholders. They should possess a strong background in designing, building, and maintaining data infrastructure, pipelines, and platforms, with a commitment to data integrity, security, and accessibility. **Deadline** Not specified **Reference** Original posting: https://www.myjobmag.co.za/job/data-engineer-wi-data-engineer-andbeyond Source: myjobmag
Summary drafted with AI assistance from the original advert. The advert itself is the authority — how we use AI.
At a glance
- At least 3 years of experience.
- Python
- SQL
- Azure
- Power BI
- Driver's licence
Extracted automatically from the advert; confirm requirements on the original listing.
Job description
Before you apply
- Confirm the requirements and closing date on the original listing (myjobmag). SPANi lists vacancies from other sites and may not reflect last-minute changes.
- Legitimate employers do not charge application, registration or training fees.
- Don't send your ID or bank details before you have confirmed the employer is real.
Also listed on: myjobmag.
Before you apply
- Read the full advert and confirm you meet the minimum requirements before applying.
- Tailor your CV headline and most recent experience to the job title and key skills.
- Note the closing date and reference number, and keep a copy of what you submit.
- Apply only through the employer or job board link — never pay to apply.