Document naming, bundle creation and performance
Document naming, bundle creation and performance
There is no dispute between the IT experts that documents were named with lengthy alphanumeric reference numbers when loaded automatically from SPS. I find, as Mr Britton accepted in his second report that ‘it would have been a great improvement in the User Interface to have provided meaningful names’: The other naming issue, not raised in cross-examination or disputed by Mr Britton, was, as Dr Hunt identified in her first report, that even if the user changed the document names manually, this name would not be displayed when trying to select documents to insert into a bundle. Instead, only the internal content identifier was visible.
I accept Dr Hunt’s conclusion, unchallenged in cross-examination, that TCS’s ‘design of the integration between Siebel, document generation and bundling appears to have taken no account of how users would work with the system’, and that as such it would not have been carried out in accordance with GIP. I also accept Dr Hunt’s evidence that TCS’s design of the integration between Snowbound and Siebel made the bundling functionality ‘effectively unusable’. Mr Britton’s evidence was not materially different. He accepted in cross-examination (Day19/30):
Q. all the things that Snowbound was introduced to do in terms of the things we looked at earlier, saving documents, editing documents, redacting documents, creating bundles, well, then, the R1 solution, as delivered, effectively didn't give you usable functionality of that kind?
A. As delivered, yes. But of course they did make performance improvements.
Part of the DBS process related to the creation of a minded to bar (‘MTB’) bundle. This included identifying the correct documents, redacting them, creating an appendix of the documents, and drafting an accompanying letter. As such, it was a task impacted by the Snowbound issues discussed above and I accept that, as a result of the issues they encountered with snowbound, DBS implemented a workaround to create bundles in excess of 200 pages manually.
As to wider performance issues generally, DBS plead that ‘the system is slow, in that every action a user attempts to perform on the system suffers from a time lag of several seconds’ (paragraph 99.3 of the Amended Defence and Counterclaim). DBS also made complaints about reliability and log in times (paragraphs 99.2.1 and 99.2.2 of the Amended Defence and Counterclaim).
There was a performance test in the SIT-L environment, which was explored in cross-examination. The Non Functional Requirement for retrieval of a .pdf document from the database was to test a 10-page document, and the test was passed in relation to load times for retrieval of documents. I accept Dr Hunt’s opinion that the testing ought, in compliance with GIP, to have included a test under the load likely to be expected in use, and that, having reviewed the Test Completion report for Performance Testing that it did not. Moreover, other response times applicable to caseworkers’ use of the Snowbound tool were exceeded. The Agreement specified Application Response Times of 99% within 2 seconds and 1% within 3 seconds for a user executing any transaction within the application: Schedule 2-2. I accept TCS’s submission that the results show each response time was in excess of this requirement, and that similar response times were encountered even after Snowbound had been upgraded by TCS to version 4.13.
However, Dr Hunt, in her Appendix K, analysed the Post Go-Live Defects in relation to the reliability, login failures and time lag pleaded at paragraph 99.2 of the Amended Particulars of Claim, and in relation to each one concluded that responsibility was ‘primarily’ HPE, because of bandwidth limits imposed. Dr Hunt also concluded that these issues should have been rectified by BCR1642 but implementation of this was delayed by issues which were the responsibility of HPE and DBS. Dr Hunt’s conclusion on performance in cross-examination was as follows (Day 19/176):
Q. Now, a large part -- after the initial HPE fixes,
a large part of fixing the Snowbound issues, including
the performance issues I'm talking about here
specifically, was upgrading the Snowbound software,
wasn't it?
A. It was certainly a significant part, yes.
Q. And that suggests, doesn't it, that at least those --
that significant part of the problem wasn't in fact
caused by the TCS built DMS system and its inability to
cope with load, it was a Snowbound software issue?
A. Well, we don't really know, I think is the -- is
the real answer to that question. Snowbound was
something that could be upgraded, so it was, and it gets
better when they improve Snowbound. So the general
feeling is that that was probably the culprit, but I'm
not sure that anybody has investigated DMS performance
in any real sense.
Q. But in a sense, absent any other intervention, if you
make intervention A, upgrading the Snowbound software,
and the result is everything goes faster, then it's --
A. Yeah.
Q. -- a fair --
A. A fair cop.
Q. -- deduction, isn't it --
A. Yes --
Q. -- that that was the issue, or at least that was a major
issue?
A. Yes.
Q. And that means that -- if that is right, it means that
it's not anything that TCS did wrong with its
design-and-build of DMS, the contention is in
the client, the Snowbound client?
A. Most likely, yes.
Q. And certainly you haven't identified, I think, correct
me if I'm wrong, but in either of your reports anything
that TCS could and should have done to improve
performance but they didn't do?
A. Apart from the upgrading Snowbound, which --
Q. Yes.
A. Yeah.
Q. Yes, apart from upgrading Snowbound?
A. Yes.
Snowbound updates were carried out in July 2018 from v4.7.2 to v4.10: the v4.8 and v4.9 updates had stability problems and were not implemented) and to v4.13 in June 2019. In the circumstances, it is not possible to conclude that there existed general performance related issues which were the responsibility of TCS, other than those associated with Snowbound integration, even though it is likely that the problems encountered post-Go Live would probably have been identified sooner if the testing had taken place at appropriate load. The system performance problems themselves were, as Dr Hunt concluded and I accept, primarily the responsibility of HPE and bandwidth related issues.
I accept that the Snowbound issues which have been established were a material contribution to the decision by DBS to implement a workaround to create MTB bundles in excess of 200 pages. DBS submits that it continued to experience issues with creating MTB bundles, even after the bandwidth issue had been resolved. That this was so was supported by Dr Hunt’s analysis (see first report paragraph 495). Contemporaneous support is also found in some of the documents: see for example the email exchange dated 19 February 2018, in which it was recorded that, ‘we have not found that lift of the cap on bandwidth by one of our suppliers, has seen a decent improvement on the DMT specifically. It didn’t demonstrate any improvement in the speed of Siebel generally however…’ Having sought feedback from caseworkers dealing with MTB bundles in excess of 50 pages, one caseworker stated: ‘I don’t have a case with over 50 pages but I have done a bundle this morning with 42 pages and it was horrendously slow. I could have gone to make a cup of tea each time I tried to move down a page.’
In terms of specific cost claims arising out of Snowbound (as opposed to DBS’s loss of anticipated efficiency claim, of which the Snowbound complaints play a part), DBS claims Snowbound Tool remediation costs in the sum of £293,069 (item 21 of the Updated Schedule of Loss), and Adobe licence costs, in the sum of £8,270 (item 20 of the Updated Schedule of Loss).
- Heading
- CONTENTS
- IntroductiON
- The Factual Witnesses
- Expert Evidence
- Programming Experts
- Forensic Accounts
- The Parties Submissions
- Principles Applicable to Issues of Construction
- The Defendant’s Obligations and Responsibilities
- Clause 15
- Clause 9.5 which states
- Clause 14.5 of Schedule 2-6 which states
- The Delay and Notice Provisions
- Clause 7
- Conditions Precedent: Clauses 5 and 6
- Conditions Precedent: the authorities
- Clause 5.6
- Clause 6
- Clause 8
- Limitations of Liability
- A single or multiple caps?
- The Delay Damages cap under Clause 52.2.5
- Is TCS’s claim for loss of anticipated costs savings excluded by Clause 52?
- Compliance with Clause 5.3, Agreement and Estoppel Introduction
- Express Agreement
- Estoppel
- Introduction
- R1 B&B Delays
- Mr Britton’s First Analysis
- Mr Britton’s Second Analysis
- Conclusion on Mr Britton’s Analyses
- TCS’s submission based upon Mr Jardine’s analysis
- Responsibilities for Delay on the ‘Infrastructure’ Critical Path
- R1-D
- Compliance with Notice Provisions
- Analysis of Delays
- Up to August 2017
- From August 2017 to 19 September 2018
- Analysis
- Failed to confirm its desired functional scope of R1 Disclosure in relation to the Customer-to-Business portal and Accountable Officer’s Update Service functionality. Such confirmation was a prerequis
- Failed to make available an end-to-end test environment for the Interactive Voice Response system
- Failed to agree upon a data migration approach, without which the Claimant could not complete the build of a data migration environment so that anonymised data could be made available for testing
- Failed to ensure that relevant external stakeholders were available to participate in Final Systems Integration Testing
- Partial Termination
- TCS’s Claims
- Non-Manpower Costs
- Anticipated Cost Savings
- Summary of TCS’s Delay Claim Recovery
- DBS’s Claims
- Delay Payments
- R1-B&B Delay
- Disclosure Scotland Extension Costs – Item 1 of the Updated Schedule of Loss
- Loss of Anticipated Savings – Item 3 of the Updated Schedule of Loss
- R1-D Delay
- R0 Licence Costs – Item 4 of the Updated Schedule of Loss
- R0 Hosting and Infrastructure Costs - Item 5 of the Updated Schedule of Loss
- R0 Technology Refresh – Item 6 of the Updated Schedule of Loss
- R0 N-1 Sustainment Costs – Item 7 of the Updated Schedule of Loss
- R0 Maintenance Costs – Item 8 of the Updated Schedule of Loss
- Savings
- Introduction
- Quality-related Obligations
- Good Industry Practice and Defects
- Digital by Default Standards
- Section 71
- The Basics Portal
- Section 73
- The Barring Portal
- Section 75
- Section 76
- Barring Portal: Loss of productivity - Item 11 of the Updated Schedule of Loss
- LPF Portal
- Siebel Useability Issues
- Redaction
- Document naming, bundle creation and performance
- Adobe Licence (Item 20)
- Document Storage (Item 21)
- Other B1 Barring Quality Issues
- Scan on Demand
- Special Characters
- Letters
- Item 24 : Loss of Efficiency Claims arising out of R1 Barring Quality/Useability Issues
- N-1 Sustainment Costs
- Causation and Loss
- Exit/Service Transfer
- Identification of all services (3.2.2)
- Knowledge Transfer (3.2.6 and 3.2.7)
- Section 95
- Providing all documentation to a replacement contractor (3.2.1 and 3.2.10)
- The identification of all leases, maintenance agreement and support agreements in connection with the provision of the services (3.2.3)
- Providing any other information or assistance reasonably required by a replacement contractor (3.2.14)
- Causation and Loss
- The Security Incidents
- The Charges Variation Dispute Introduction
- Issue 1: How the amount of an ‘over-recovery of the Forecast Revenue’ (Clause 2.8.4) or ‘under-recovery of the Forecast Revenue’ (Clause 2.8.5) is to be measured
- Section 104
- Issue 4: How Clause 2.8.5 of Schedule 2-3 applied to Volume Based Service Charges in Service Year 5
- Issue 2: Whether the Predicted Volumes for Basics in Service Year 4 were 1,000,000 (TCS’s case) or 320,374 (DBS’s case)
- Conclusion on Volume Based Service Charge
- Conclusions
![HT-2020-000448 - [2024] EWHC 1185 (TCC)](https://backend.juristeca.com/files/emisores/logo_yJUntHA.png)