Python / Spark / AI Developer

We are looking for a skilled Python / Spark / AI Developer to join a growing technology team. You will be responsible for developing scalable data pipelines, replatforming legacy SQL workloads onto modern Spark and lakehouse technologies, and supporting the development of APIs and AI-driven features. The ideal candidate is a strong Python developer with hands-on production experience in Apache Spark/PySpark, SQL, Delta Lake and REST APIs. Key Responsibilities * Build Spark/PySpark data pipelines using Delta Lake. * Replatform legacy T-SQL logic into Spark SQL. * Develop modern, type-safe and well-tested Python applications. * Build REST APIs using FastAPI or equivalent frameworks. * Implement authentication, idempotency and job-status functionality. * Validate migrated pipelines against legacy systems and provide parity evidence. * Work from technical specifications, design documents and ADRs. * Develop automated tests using pytest. * Contribute to CI/CD pipelines, code reviews and technical documentation. Minimum Requirements * 4+ years of professional Python development experience. * 2+ years of production experience with Apache Spark / PySpark. * Strong knowledge of Spark SQL and DataFrame APIs. * Production experience with Delta Lake or equivalent technologies such as Iceberg or Hudi. * Strong SQL skills and experience working with legacy T-SQL. * Experience with pytest and automated testing. * Experience developing REST APIs, preferably with FastAPI. * Experience with Docker and containerised development environments. * Strong Git and CI/CD experience. * Experience with type-hinted Python and static analysis tools such as Pyright or Mypy. * Experience with modern Python tooling such as uv or Poetry. * Ability to work independently from written technical requirements and design documentation. * Bachelor’s degree in Computer Science, Engineering or a related field, or equivalent experience. * Proven track record of delivering production Python/Spark pipelines independently. Advantageous Skills * Experience with LLM / AI integration. * Experience with Ollama, vLLM, llama.cpp, LM Studio or hosted AI APIs. * Knowledge of data governance, privacy engineering and POPIA/GDPR principles. * Experience with Hive Metastore, Trino or Apache Ranger. * Azure experience, including ADLS Gen2, Synapse, ADF, Key Vault or Service Bus. * Experience with structured logging, OpenTelemetry or OpenLineage. * Data migration and pipeline parity testing experience. * Databricks Certified Developer for Apache Spark or equivalent certification. How To Apply: Contact Hire Resolve today for your next career-changing move Our client is offering a highly competitive salary for this role based on experience. Send your CV to: or connect with Mischa Bornman via LinkedIn. Alternatively, you can also contact me directly at Hire Resolve mischa.bornman@hireresolve.us We will contact you telephonically in 3 days should you be suitable for this vacancy. If you are not suitable, we will put your CV on file and contact you regarding any future vacancies that arise. Hire Resolve IT/Computer Recruiter About Specialists in Civil, Structural, Mechanical Engineering, Information Technology, Mining, Manufacturing and Finance Careers! Hire Resolve is one of the larger and more agile South African recruitment companies that focus on placing professionals and skilled people in permanent employment and contract employment. We prefer and focus on working with top quality professionals and candidates in South Africa and Africa. Hire Resolve has successfully placed Engineering, Mining, IT, Manufacturing and Finance professionals with top firms across the Western Cape, Eastern Cape, KwaZulu Natal, Gauteng and in Africa. Hire Resolve has assisted candidates to find jobs at over 100 JSE listed companies of which many are global companies with offices and operations in South Africa and Africa. It is for this reason that we are well respected in the industries we operate in and in the recruitment industry.