We explain why, despite having the better offer, Bazan ended up with a worse score
JOHANNESBURG - The Sunday Times this week published further details of a August 3 1998 memorandum prepared by Christoph Hoenings, an Thyssen Krupp executive and member of the German Frigate Consortium (GFC). The GFC was awarded the contract to supply the South African navy with four frigates in the infamous 1999 ‘arms deal.'
According to the newspaper the memorandum reads:
"The last trip (27-30.07.1998) was suggested by C Shaikh [Chippy Shaik] , Director Defence Secretariat. During one of our meetings he asked once again for explicit confirmation of the verbal agreement made with him for payment to be made in case of success, to him and a group represented by him, in the amount of $3-million. I confirmed this to him and offered to record this agreement in writing at any time and proposed to put the latter in a safe that can only be accessed jointly. C Shaikh will report back on this shortly."
The memo goes on to say: "Mr Shaikh has emphaised that the B+V/TRT offer was pulled into first place in spite of the Spanish offer being 20% cheaper. The Spanish offset was according to him also higher than ours. In this respect, it had, according to him, been no simple exercise to get us into first place."
In an earlier April 2008 article on Politicsweb we detailed how exactly the contract was swung the GFC's way. We are re-publishing it below in light of these latest revelations:
The mystery of why Bazan lost despite (it seems) having the better offer (April 8 2008)
-->
In its indictment of Jacob Zuma the National Prosecuting Authority notes that up until the final decisions were made on the arms deal there were two separate and parallel processes. On the one hand there was the "The formal evaluation of the competing bidders ... conducted through an ostensibly rigorous and scientific evaluation process." On the other, there was an "informal process" through which "persons and entities interested in participating in the contracts sought to glean information about the process and exert influence, directly or indirectly, on formal decision makers."
From the evidence already gathered by German, British and South African investigations it seems that, with most elements of the arms deal, the "informal process" subverted the prescribed one. Choices were predetermined in backroom meetings, and the evaluation of the different bidders was then manipulated to ensure the desired outcome.
This seems to have been the case in the corvette contract as well. What other inference can one draw from the payment of $25m in bribes by the German Frigate Consortium (GFC) to "South African officials and members of cabinet" following its successful bid?
There is a contrary view that the GFC's Meko A200 won the corvette contract on legitimate grounds and if the Germans "did pay any bribes, they were wasting their money." [The GFC has also denied the bribery allegations.] Certainly, the GFC's bid was a good deal less bad than certain of the other winning contenders (most notably BAe's Hawk 100 - which won the jet trainer contract.)
-->
It is a matter of public record that the GFC beat Bazan of Spain on the strength of their National Industrial Participation (NIP) offer. However, there is evidence to suggest that if the integrity of formal evaluation process had been maintained Bazan would have come out ahead of GFC in the assessments - even with their lower rating on the NIP.
Each of the bidders for the corvette contract (as on the other elements of the arms deal) was supposed to be assessed on a formula combining price, military performance, financing cost, defence industrial participation (DIP), and NIP. The closing date for the Request for Final Offers was May 11 1998 and the assessments by each of the evaluation teams began very soon after.
They were all completed by the end of June that year and consolidated at a SOFCOM meeting on July 1-2 1998. By the time of a meeting of the Armaments Acquisition Council on July 13 1998 the GFC's Meko A200 had come out ahead of the other bidders on the best value rankings. By this stage each of the process the bidders were assessed on the following formula:
Best Value (BV) = Military Value (MV) + Industrial Participation (IP) + Financing Index (FI)
-->
Military Value was determined by dividing military performance over cost. Industrial Participation by a combination of each bidder's NIP and DIP ratings. If the information presented by the Auditor General in their report into the arms deal is correct, the result of the evaluations of the different bidders (in mid-July) would have been as follows:
Table 1. Original best value results (BV = MV + IP + FI )
Bidders
MV
-->
IP
FI
BV score
BV normalised
Ranking
GFC MEKO A200 (Germany)
91.9
100
79
270.9
100
1
Bazan 590B (Spain)
100
82
84
266
98.2
2
GEC F3000 (UK)
74.7
57
100
231.7
85.5
4
DCN Patrol Corvette (France)
65
82
90
237
87.5
3
It is clear then that by this stage the GFC bid had come out slightly, but not insubstantially, ahead of Bazan with 4.9 points between them. The normalised scores on "best value" were 100 for the GFC bid to 98.2 for Bazan's.
Originally the value system that was supposed to be used to assess the different bids was:
BV = MV + IP FI
However, this was changed to BV = MV +IP + FI at the July 1-2 SOFCOM meeting. The minutes of the meeting recorded that "The Chairman [Chippy Shaik] emphasises the importance of showing the values of the three evaluation domains in a progression which culminates in a best value of Military value + IP value + Financing value."
The minutes of the special Armaments Acquisition Screening Board meeting on July 8 1998 further recorded:
"The Chief of Acquisition [Chippy Shaik] briefly reviewed the process, stressing the integration of the results of four independent evaluations per equipment undertaken by SOFCOM. Due to disproportionate influence of the financing result in the top-level value system, the SOFCOM accepted a modified equation prior to integration, i.e. Ranking = Technical + IP + Financing (each evaluation contributing one third to the final ranking)."
This decision to change the formula was highly irregular as SOFCOM was an ad-hoc committee with no formal decision making powers. In his interview with arms deal investigators in 2001 Erich Esterhuyse, the co-chair of SOFCOM, said that he had been on holiday at the time this decision was made. "When I came back, I was presented with this particular slide that says, this is now the value system."
"I looked at this and I said, this does not make sense from a mathematical point of view. You cannot change a multiplier into a plus-factor and I could not figure out why it was done. And I said, fine, if I look at the results of, from the project, the study teams, if this new formula changes the outcome from one contractor to the other, then I will object violently. I could not find a single case where the outcome was effectively changed by the change in approach."
At that time the main concern of Esterhuyse (and others) was with the efforts to push through the contract for the Hawk 100 - regardless of cost - and the change in formula did little to help BAe's bid in that regard. However, if the original formula had been used for rating the corvette contract the results would have been as follows:
Table 2. Results using the original formula (BV = (MV + IP)/FI )
Bidders
MV
IP
FI denominator
BV score
BV Normalised
Ranking
GFC MEKO A200
91.9
100
100
1.92
100
1
Bazan 590B
100
82.00
95.4
1.91
99.37
2
GEC F3000
74.7
57.00
79.2
1.66
86.63
4
DCN Patrol Corvette
65
84.44
89.6
1.67
86.89
3
Thus, although the GFC bid still came out ahead on the original value system, the differential between it and Bazan was much smaller.
In the NIP evaluations, carried out by at team at the Department of Trade & Industry (Minister: Alec Erwin), the GFC had been given over double the score (100) to Bazan (48). This was despite the fact that their offers were - in dollar terms - about the same. Bazan had however presented a far superior DIP offer to the GFC both qualitatively and quantitatively.
It was the only bidder to provide a detailed business plan for its counter-trade offer on the combat suite. It had promised 21.9% counter-trade on the platform component, as well as indirect defence counter-trade to the value of $406m. By contrast the GFC offered only 11.5% direct DIP on the platform, and only $6m indirect defence counter-trade. It had also failed to meet a series of minimum criteria on the DIP offer which should have led to its disqualification.
Although Bazan was given the best score on its DIP offer (100) the GFC was not all that far behind (81). This rating for the GFC was built partly on some questionable decisions and partly on miscalculation. When the Auditor General's Office re-examined the DIP calculations they uncovered a number of errors. According to their revised figures the GFC should only have received 71 points to Bazan's 100. What this meant is that Bazan's IP score should have been 86.5 rather than the 82 it was given.
If the correct DIP rating had been used - on the later formula - the differential between the two "best value" scores would have been reduced from 4.9 points to 0.4 points (out of 300). Bazan would have received a normalised best value score of 99.9 to the GFC's 100.
On their own the miscalculations in the DIP scores, and the change of formula, did not change the GFC's number one ranking (although they both came as close as damnit to doing so). But combined they certainly do. On the original formula, and using the correct IP ratings, Bazan comes out well ahead of the GFC. It has a normalised score of 100 to the GFC's 98.2. What this means - if the Auditor General's figures are correct - is that the R6,9bn corvette contract was swung from Bazan to the GFC on the basis of a combination of calculation errors (on the DIP) and a questionable change in the value system.
Table 3. Results using correct IP and original formula (BV = (MV + IP)/FI )
Bidders
MV
IP corrected
FI denominator
BV score
BV normalised
Ranking
GFC MEKO A200
91.9
100
100
1.92
98.2
2
Bazan 590B
100
86.51
95.4
1.95
100
1
GEC F3000
74.7
60.03
79.2
1.70
87.03
3
DCN Patrol Corvette
65
84.44
89.6
1.67
85.32
4
APPENDIX: Detailed breakdown of results.
1.) Military Value
The cost of each of the bids was made up of the platform cost - proposed by the bidders - and the combat suite. The ceiling price of the latter was set by the navy at R1470m in February 1998, and it was meant to be provided largely by South African suppliers led by Altech Defence Systems (ADS). Bazan's offer was, at $423m (excluding the combat suite), the most inexpensive - a full $110m cheaper than the Meko A200. See Table 1.
Table 1. Relative costs of the bidders
Bidders
Platform cost USD m
Normalised (denominator)
Combat suite cost USD m
Total cost USD m
Normalised (denominator)
Ranking
GFC MEKO A200 (Germany)
533.4
90.4
313.6
847.0
93.7
2
Bazan 590B (Spain)
423.5
71.8
313.6
737.1
81.6
1
GEC F3000 (UK)
550.0
93.2
313.6
863.6
95.6
3
DCN Patrol Corvette (France)
590.0
100
313.6
903.6
100
4
The Meko A200 came out on top on the military performance evaluation with a score of 810.5 out of 1080, just ahead of the 590B's 766.6. Thus, the Meko A200 had a 5% better military performance than the 590B but at 25% greater cost on the platform. Military Value was determined by dividing military performance over cost.
Military Value = Military Performance Cost
On this measure Bazan's 590B came out on top with a normalised rating of 100 compared to 91.9 for the Meko. See Table 2. The differential would have been greater had the ‘fixed' combat suite price not been included in the cost. If the military value had been judged on the cost of the platform alone the Meko A200 would have had a rating of about 84 as opposed to the 100 of the 590B. It turned out, in any event, that the combat suite price was not fixed. After the GFC had been named the preferred bidder, the price of the combat suite was dramatically inflated (by 100%). It was only brought down again by stripping out functionality.
Table 2. Military performance and value
Bidders
Military performance score (1080)
Normalised (numerator)
Ranking
Cost normalised (denominator)
Military Value normalised
Ranking
GFC MEKO A200
810.5
100.0
1
93.7
91.9
2
Bazan 590B
766.6
94.6
2
81.6
100
1
GEC F3000
649.9
80.2
3
95.6
74.7
3
DCN Patrol Corvette
618.3
76.3
4
100
65
4
2.) National Industrial Participation (NIP)
The Industrial Participation (IP) ratings were determined by a combination of Defence Industrial Participation (DIP) and National Industrial Participation (NIP).
Industrial Participation = Defence Industrial Participation (DIP) + National Industrial Participation (NIP). According to the Auditor General "no approved value system could be obtained" for the NIP assessment.
However, an "economic value system" was drafted by Allan Hirsch and Vassie Ponsamy of the Department of Trade & Industry. "This was the first value system they ever drafted as the NIP projects had never before been used to select preferred bidders." The evaluation of the NIP proposals was carried out by Cassie Nakooda under the supervision of Ponsamy.
Although the Bazan and GFC bids had similar offers in dollar terms the GFC was given over double the score by the DTI. The GFC's NIP offer was made up of a promise to build a "mini steel mill", a "crank shaft foundry", and to purchase "automotive components" from South Africa.
Table 3. National Industrial Participation (NIP)
Offer USD m
Score DTI
Normalised
Ranking
GFC MEKO A200
2730.8
52423525
100
1
Bazan 590B
2722.6
25030877
47.7
3
GEC F3000
413.9
5892344
11.2
4
DCN Patrol Corvette
1684.0
27519751
52.5
2
3.) Defence Industrial Participation
In terms of the Request for Final Offer bidders were required to offer a minimum of ten percent counter-trade on the platform and sixty percent on the combat suite. Bazan had by far the best DIP offer both qualitatively and quantitatively. It offered 21.9% direct DIP on the platform, as well as indirect DIP to the value of $406m. It was also the only bidder which provided a detailed business plan and commitment to the 60% DIP on the combat suite.
By contrast the GFC offered only 11.5% direct DIP on the platform, and only $6m indirect DIP. In its original bid it did not provide "a bank or sovereign guarantee to the value of 5 percent of the DIP commitment." It also failed to supply a business plan for the DIP on the combat suite element. Yet, when it came to evaluating the DIP offers on the combat suite, all the bidders were given the same score on that component as Bazan.
Despite the poor DIP offer from the GFC, and its non-compliance with a series of requirements, it was still given a remarkably high rating of 81 as opposed to the 100 of Bazan. The Auditor General's investigation later found that there had been a calculation error in the score allocated to the GFC - and it should have received a rating of 71 to Bazan's 100.
Table 4. Defence Industrial Participation Offers and Ratings
GFC Meko A200
Bazan 590B
GEC F3000
DCN Patrol Corvette
Total platform value USD
533,364,133
423,453,000
550,000,000
590,000,000
Countertrade offer USD
61,464,000
81,400,000
42,000,000
59,950,000
% of platform cost
11.5%
19.2%
7.6%
10.2%
Indirect countertrade offer USD
6,498,000
406,600,000
527,000,000
129,500,000
% of platform cost
1.2%
96.0%
95.8%
21.9%
Combat suite (fixed) USD
313,600,000
313,600,000
313,600,000
313,600,000
Countertrade on combat suite (fixed)
188,000,000
188,000,000
188,000,000
188,000,000
% of combat suite cost
59.9%
59.9%
59.9%
59.9%
Original rating DIP
81
100
92
96
Corrected score (Auditor General)
4.7
6.64
6.05
6.09
Rating (corrected - AG)
70.8
100.0
91.1
91.7
Ranking
4
1
3
2
4.) Industrial participation
In the original assessment the NIP and DIP ratings were combined to give an overall industrial participation (IP) rating. The GFC received the best score and a rating of 100. Bazan came second with a rating of 82. However, if the DIP had been calculated correctly, Bazan would have received 86,5 points to the GFC's 100.
Under the financing evaluation system a score of one to 1 to 5 was given on each criterion with 1 being "excellent" and 5 being "poor." According to the Auditor General's report "the bidder with the best financing proposal would receive the lowest score in view of financing forming the denominator" in the (original) formula. GEC received the best score on this index, then DCN, then Bazan. According to the Auditor General, GFC's offer was the worst and it was ranked fourth.
Table 6. Financial evaluation
Bidders
Score (denominator)
Normalised (denominator)
Normalised (numerator)
Ranking
GFC MEKO A200
2.786
100
79.0
4
Bazan 590B
2.659
95.4
84.0
3
GEC F3000
2.2071
79.2
100
1
DCN Patrol Corvette
2.497
89.6
90.0
2
Click here to sign up to receive our free daily headline email newsletter