Approval statement by the Chairperson of Umalusi Council, Prof. Yunus Ballim
16 January 2023
The CEO of Umalusi – Dr Mafu Rakometsi,
Umalusi Management and staff,
Members of the media,
Ladies and Gentlemen,
1. As explained by the CEO, Dr Rakometsi, Section17A(4) of the General and Further Education and Training Quality Assurance (GENFETQA) Act (58 of 2001), as amended in 2008, entrusts Umalusi with the duty and power to perform standardisation of examination results at exit points:
“The Council may adjust raw marks during the standardisation process.”
2. Accordingly, the Assessment Standards Committee (ASC) of Umalusi Council held its meetings between 12 December 2022 and 9 January 2023 to standardise results of examinations in 510 subjects. The subjects are spread over four qualifications that are assessed by the Department of Basic Education (DBE), Department of Higher Education and Training (DHET), Independent Examinations Board (IEB) and South African Comprehensive Assessment Institute (SACAI).
3. Colleagues, the standardisation principles of Umalusi are a matter of public knowledge. Employers and education institutions that are expected to tly applied and defensible standardisation principles in adjusting marks.
4. More importantly, parents and learners rely on persistently applied educational principles to ascertain the reliability and validity of the results they receive. It is this awareness that gives such institutions and other stakeholders confidence in the results that appear on a learner’s certificate of educational achievement.
5. It is necessary at this stage to remind us about three of those principles:
1) In general, adjustments should not exceed 10 percentage points or the historical average (norm). That is:
a. No adjusted mark should be beyond the norm or historical average.
b. No adjustment should exceed 10 percentage points.
2) In exceptional circumstances, adjustments in excess of 10% (10 percentage points) may be considered and recommended by the Assessment Standards Committee to EXCO of Council for approval – in instances where there are compelling reasons to do so. This principle should be read in conjunction with Principle 1(a) above.
3) In the case of the individual candidate, the adjustment effected should not exceed 50% of the raw mark obtained by the candidate. This principle should be read in conjunction with Principle 1 above.
As Dr Rakometsi mentioned, the standardisation principles were strengthened in 2022 in consultation with all four assessment bodies. I find it necessary to inform the South African public that the ASC arrives at its decisions after going through various qualitative and quantitative reports to look for evidence that can serve as the basis of its decisions.
7. The committee spent considerable amount of time carefully analysing and discussing the information at its disposal in connection with each of the subjects presented across the four qualifications assessed by four assessment bodies. The process is quite involved and rigorous and this is done to safeguard the integrity and credibility of all the results presented.
8. It is equally important to inform members of the public that the Assessment Standards Committee’s standardisation processes have built-in mechanisms for review and appeal, to be used whenever an assessment body presents a proposal which differs from the decision of the ASC. One such mechanism is the practice of “parking of subjects” to allow the assessment body to gather new evidence and to strengthen the argument that it presents to the ASC in motivation for an alternative proposal for standardisation.
9. The final decisions of the ASC are then presented for the consideration of the Executive Committee (EXCO) of Council during its meetings to approve the release of results. I am now going to present EXCO’s approval decisions for each qualification and assessment body, starting with the National Senior Certificate (NSC). The NSC is offered by three assessment bodies, namely the
a) SACAI (a private assessment body accredited by Umalusi),
b) IEB (a private assessment body accredited by Umalusi), and
c) DBE which is a public assessment body.
Let me start with the results of the South African Comprehensive Assessment Institute (SACAI).
10. The NSC examinations administered by the SACAI
a) The SACAI has for the first time conducted and managed the 2022 examinations as a fully accredited assessment body after Umalusi granted it full accreditation status to assess the NSC and the General Education and Training Certificate: Adult Education and Training (GETC: ABET) with effect from 1 October 2022.
b) The SACAI administered the NSC examinations to 4 951 candidates in 2022.
c) The SACAI presented to Umalusi 25 subjects for standardisation. After considering the reports presented, i. raw marks were accepted for 15 subjects (60%),
ii. 7 subjects (28%) were adjusted mainly upward, and
iii. the remaining 3 subjects (12%) were adjusted mainly downward.
d) Because some people may be interested to know the actual breakdown of the standardised subjects, we have tabulated the information in the statement, which will be published on the Umalusi website immediately after this briefing. Hard copies will also be made available to you.
Statement to approve the release of results:
Having studied all the evidence presented, the Executive Committee (EXCO) of Umalusi Council concluded that the examinations were administered largely in accordance with the Regulations Pertaining to the Conduct, Administration and Management of the National Senior Certificate Examination.
The irregularities identified during the writing and marking of the examinations, were not systemic and therefore did not compromise the overall credibility and integrity of the November 2022 National Senior Certificate examinations administered by the South African Comprehensive Assessment Institute (SACAI).
The Executive Committee of Council therefore approves the release of the SACAI November 2022 National Senior Certificate examination results. In respect of an identified irregularity, the SACAI is required to nullify the results of the candidate implicated in the irregularity. Umalusi is concerned about the storage of examination scripts at examination centres for a prolonged period and the negligence observed in the sharing of the question papers with the Umalusi Post Examination Analysis team, which led to a compromise of 4 approved November 2022 NSC examination question papers. The Executive Committee of Council commends the SACAI for conducting a successful examination.
I will now move on to focus on the IEB results.
11. The NSC examinations administered by the IEB
a) The IEB had 13 536 candidates who wrote the examinations at 262 examination centres
b) The total number of subjects presented by the IEB for standardisation was 61 and, after considering the accompanying evidence
i. raw marks were accepted in 47 subjects (77%),
ii. mainly upward adjustments were effected in 10 subjects (16.4%), and
iii. mainly downward adjustments were made in 4 subjects (6.6%).
c) The next table presents the 61 subjects by type of adjustment made.
Statement to approve the release of results:
Having studied all the evidence presented, the Executive Committee (EXCO) of Umalusi Council concluded that the examinations were administered largely in accordance with the examination policies and regulations. The irregularities identified during the writing and marking of the examinations, were not systemic and therefore did not compromise the overall credibility and integrity of the November 2022 National Senior Certificate examinations administered by the Independent Examinations Board (IEB).
The Executive Committee of Council therefore approves the release of the IEB November 2022 National Senior Certificate examinations results. In respect of identified irregularities, the IEB is required to nullify the results of all candidates implicated in irregularities. The Executive Committee of Council commends the IEB for conducting a successful examination.
The third set of NSC results that the EXCO considered are those of the DBE.
12. The NSC examinations administered by the DBE
a) The DBE’s examinations were administered to 921 879 candidates.
b) Of this number, 167 119 or 18% of the candidates were part-time candidates.
c) The examinations were administered at 6 907 centres throughout the country.
d) The marking of examination scripts happened at 191 centres across the country.
e) The DBE presented to Umalusi 66 subjects for standardisation.
f) After spending considerable amount of time thoroughly analysing and intensely discussing the qualitative and quantitative information provided to the Assessment Standards Committee (ASC) in connection with each of the 66 subjects,
i. raw marks were accepted for 47 subjects (71.2%),
ii. mainly upward adjustments were made in 16 subjects (24.2%), and
iii. mainly downward adjustments were effected in 3 subjects (4.5%).
13.About the problematic Question 5.1 in Maths Paper 2
a) Regarding the problematic Question 5.1, Umalusi appointed a three[1]person independent panel ‘to investigate how the error/s in the Mathematics Paper 2 may have crept in and went undetected until the final question paper was administered by the DBE on 7 November 2022.
b) In terms of process, the panel audited four processes linked to the
question paper, which are the
i. examination paper development process,
ii. external moderating process,
iii. editing and typesetting process, and
iv. proof-reading process.
c) The panel evaluated the documents provided and interviewed the examiner/s, internal and external moderators, and language editors.
Based on that, the finding of the panel is that the error in Mathematics Paper 2 November 2022 occurred at the last step in the chain of internal and external moderation; and language editing and typesetting processes.
d) Before the submission of the report, Umalusi had, based on its obligation
to mitigate the possible impact of the error on leaner performance, advised the DBE to exclude the faulty question in its entirety from the marking. Therefore, no marks were allocated to Question 5.1 (7 marks), thereby reducing the total of 150 marks by 7 marks to 143. All candidates were marked out of a total of 143 marks and the marks achieved were converted to a mark out of 150 marks.
e) The mainly upward adjustment of the marks for students in Mathematics has dealt with the error in the Mathematics paper. Umalusi is satisfied that it has mitigated the effect of the error in the paper through the standardisation processes. The mainly upward computer adjustment served as an additional mitigation factor.
f) Since at the heart of the process was finding solutions, the EXCO is grateful that both Umalusi and the DBE have derived valuable lessons from the panel’s work in terms of how to manage real or perceived errors in any question paper going forward. The lessons should be extended to the rest of the assessment bodies in order to strengthen the systems on a continuous basis.
Statement to approve the release of results:
Having studied all the evidence presented, the Executive Committee (EXCO) of Umalusi Council concluded that the examinations were administered largely in accordance with the Regulations Pertaining to the Conduct, Administration and Management of the National Senior Certificate Examination. The irregularities identified during the writing and marking of the examinations, were not systemic and therefore did not compromise the overall credibility and integrity of the November 2022 National Senior Certificate
examinations administered by the Department of Basic Education (DBE). The Executive Committee of Council therefore approves the release of the DBE November 2022 National Senior Certificate examinations results.
In respect of identified irregularities, the DBE is required to block the results of all candidates implicated in irregularities including the candidates who are implicated in the alleged acts of dishonesty pending the outcome of the DBE investigations and verification by Umalusi. Particular attention should be paid to recurring matters of non-compliance. The Executive Committee of Council commends the DBE for conducting a successful examination on such a large scale.
I will now focus on the General Education and Training Certificate (GETC) examinations administered by the SACAI, IEB and DHET. I will start with the results of the SACAI.
14. The GETC: ABET examinations administered by the SACAI
a) The SACAI administered the examinations to 374 candidates.
b) The highlight for this year is that raw marks were accepted in all learning areas.
Statement to approve the release of results:
Having studied all the evidence presented, the Executive Committee (EXCO) of Umalusi Council concluded that the examinations were administered largely in accordance with the applicable policies and guidelines. There were no systemic irregularities reported, that might have compromised the overall credibility and integrity of the November 2022 General Education and Training Certificate: Adult Basic Education and Training (GETC: ABET) examinations administered by the South African Comprehensive Assessment Institute (SACAI).
The Executive Committee of Council approves the release of the SACAI November 2022 GETC: ABET examinations results. The Executive Committee of Council commends the SACAI for conducting a successful and irregularity free examination.
Let me now focus on the GETC results of the IEB.
15. The GETC: ABET examinations administered by IEB
a) The IEB administered the 2022 examination to 467 candidates in 7 learning areas.
b) Of the seven learning areas, raw marks were accepted for 4 whereas downward adjustments were made in 3 learning areas.
c) No upward adjustments were made in 2022.
Statement to approve the release of results:
Having studied all the evidence presented, the Executive Committee (EXCO) of Umalusi Council concluded that the examinations were administered largely in accordance with applicable policies and guidelines. There were no systemic irregularities reported, that might have compromised the overall credibility and integrity of the November 2022 General Education and Training Certificate: Adult Basic Education and Training (GETC: ABET) examinations administered by the Independent Examinations Board.
The Executive Committee of Council approves the release of the IEB November 2022 GETC: ABET examination results.
The Executive Committee of Council commends the IEB for conducting a successful examination.
In this final section of the statement, the focus is on three sets of results linked to the examinations administered by the Department of Higher Education and Training (DHET). I deal first with the GETC results.
16. The GETC: ABET examinations administered by DHET
a) A total of 36 742 candidates wrote the examination in 26 learning areas.
b) 26 learning areas were presented for standardisation and the decisions taken are as follows:
i. raw marks were accepted in 10 learning areas,
ii. 11 learnings areas were adjusted mainly upward, and
iii. 5 learning areas were adjusted mainly downward.
Statement to approve the release of results:
Having studied all the evidence presented, the Executive Committee (EXCO) of Umalusi Council concluded that the examinations were administered largely in accordance with the National Policy Pertaining to the Conduct, Administration and Management of the Examinations of Colleges, Established, Declared or Registered in Terms of the Continuing Education and Training Act.
The irregularities identified during the writing and marking of the examination, were not systemic and therefore did not compromise the overall credibility and integrity of the November 2022 General Education and Training Certificate:
Adult Basic Education and Training (GETC: ABET) examinations administered by the Department of Higher Education and Training.
The Executive Committee of Council therefore approves the release of the DHET November 2022 GETC: ABET examination results.
In respect of identified irregularities, the DHET is required to block the results of all candidates implicated in irregularities including the candidates who are implicated in the alleged acts of dishonesty pending the outcome of further DHET investigations and verification by Umalusi. Umalusi is concerned about the high number of reported cases of group copying. The Executive Committee of Council commends the DHET for conducting a successful examination.
The next set of results are for the NC(V) Levels 2-4 examinations.
17. The NC(V) Levels 2-4 examinations administered by the DHET
a) The NCV Levels 2-4 examinations were written by 166 184 candidates.
b) A total of 261 instructional offerings were submitted for standardisation and the decisions taken are that:
i. raw marks were accepted for 146 subjects (55.9%),
ii. mainly upward adjustments were made in 66 subjects (25.3%), and
iii. mainly downward adjustments were effected in 49 subjects (18.8%).
Approval statement for the release of results:
Having studied all the evidence presented, the Executive Committee (EXCO) of Umalusi Council concluded that the examination was administered largely in accordance with the National Policy Pertaining to the Conduct, Administration and Management of the Examinations of Colleges, Established, Declared or Registered in Terms of the Continuing Education and Training Act.
The irregularities identified during the writing and marking of the examination, were not systemic and therefore did not compromise the overall credibility and integrity of the November 2022 National Certificate (Vocational) [NC(V)] L2-L4 examination administered by the Department of Higher Education and Training. The Executive Committee of Council therefore approves the release of the DHET November 2022 NC(V) L2-L4 examination results.
In respect of identified irregularities, the DHET is required to block the results of all candidates implicated in irregularities including the candidates who are implicated in the alleged acts of dishonesty pending the outcome of further DHET investigations and verification by Umalusi. The Executive Committee of Council commends the DHET for conducting a successful examination.
18. The NATED (N2-N3) examinations administered by the DHET
a) The number of candidates who wrote the NATED programme (N2-N3) examinations was 78 619.
b) A total of 56 instructional offerings were submitted for standardisation and the decisions taken are that:
i. raw marks were accepted for 35 subjects (62.5%),
ii. mainly upward adjustments were made in 11 subjects (19.6%), and
iii. mainly downward adjustments were effected in 9 subjects (16.1%).
c) I must report that Electrical Trade Theory N3 could not be standardised for two reasons. Firstly, while Umalusi moderated and approved a question paper for this subject, the paper that was administered by the DHET on 22 November 2022 is not the one that was approved by Umalusi.
Secondly, the paper that was administered by the DHET contained questions worth of 73% of marks that were based on the old syllabus. For these reasons, the ASC felt that these were not sufficiently credible set of results to standardise. The DHET has informed Umalusi that it is arranging for the candidates concerned to re-write this examination on 6 February 2023. Thereafter the results will be submitted to Umalusi for standardisation and approval.
Statement to approve the release of results:
Having studied all the evidence presented, the Executive Committee (EXCO) of Umalusi Council concluded that the examination was administered largely in accordance with the National Policy Pertaining to the Conduct, Administration and Management of the Examinations of Colleges, Established, Declared or Registered in Terms of the Continuing Education and Training Act.
The irregularities identified during the writing and marking of the examination, were not systemic and therefore did not compromise the overall credibility and integrity of the November 2022 NATED Report 190/191 Engineering Studies N2-N3 examination administered by the Department of Higher Education and Training (DHET). The Executive Committee of Council therefore approves the release of the DHET November 2022 NATED N2-N3 examination results.
The DHET is required to:
i. In respect of identified irregularities, block the results of all candidates implicated in irregularities including the candidates who are implicated in the alleged acts of dishonesty, pending the outcome of further DHET investigations and verification by Umalusi;
ii. Nullify the November 2022 Electrical Trade Theory N3 examination results;
iii. Block the results of candidates and centres that failed to comply with ICASS requirements pending the outcome of further investigations by the DHET and verification by Umalusi; Develop a strategy to address the recurring irregularities that emanate mainly from private colleges and report on progress to Umalusi;
v. Submit a report on the action taken against officials implicated in irregularities; and
vi. The Executive Committee of Council commends the DHET for conducting a successful examination.
19.Directives for compliance and improvement
a) On the basis of the findings emanating from the quality assurance processes that were conducted by Umalusi per assessment body before, during and after the writing of the examinations, Umalusi has issued to the relevant assessment bodies specific directives for compliance and improvement.
b) The assessment bodies concerned are required to submit to Umalusi by 15 March 2023 their plans indicating how they will address the areas flagged.
20.Conclusion
a) As the Council for Quality Assurance in General and Further Education we would like to urge all assessment bodies to ensure that the interest of students continue to be protected by the integrity of the system.
b) Umalusi Council will continue to strive for a system that maintains high quality standards in the interest of South African learners for whom education is a constitutional right.
c) It is precisely for this reason that all stakeholders within the South African education system are urged to approach the education of our children as a social justice issue.
d) As pointed out by the CEO, Dr Rakometsi, Umalusi has put in place rigorous and robust procedures that provide assurance that all learners receive appropriate recognition for their performance in line with agreed national standards so that no learner should feel that s/he was born in the wrong year.
e) I thank the CEO, Dr Rakometsi, his management team and staff in general for the excellent work that they produce at all times.
f) These people work tirelessly and under tremendous pressure to deliver the best for the country.
g) I would like to thank all members of the Assessment Standards Committee under the leadership of Professor Loyiso Jita for a job well done.
h) On behalf of Umalusi Council, I wish to extend our hearty congratulations to all the learners who have succeeded in these examinations.
Congratulations also to their teachers, parents, guardians and all those who have supported these learners in their studies.
i) To those who have not succeeded, there is another chance for you this year. So please do not give up – take heart, work hard and you will do better this year.
j) Wishing you all the best for 2023.
k) Thank you.
Professor Yunus Ballim
Chairperson of Umalusi Council
