Get creative: Mastering metrics
First published in the 1LoD Global Benchmarking Survey & Annual Report 2019
Where once knowledge was power, data now rules. With huge processing capabilities (literally) in the palm of the hand, the internet and “smart” devices are changing ways of working and democratizing information. Set against this technological revolution, the legal sector has long been ripe for “disruptive innovation”.
From practice management software to e-discovery, IP management, document production and even qualitative contract review, start-ups offering tech-driven efficiencies have exploded. The artificial intelligence their algorithms create and exploit is increasingly capable of taking on the work of junior lawyers, presenting both a threat and an opportunity to the traditional legal powerhouses.
Technology now allows huge volumes of various data to be aggregated and processed rapidly with minimal margin of error. This is “big data”: volume, variety, velocity and veracity – the “four Vs”. For businesses it creates huge potential for database-driven relational decision-making based on analysis of hard facts.
In time it will lead to the automation of most human based tasks. AI is already capable of performing complex surgical operations or detecting disease with much more precision than the human margin for error. The change potential for all organizations (and for society at large) is enormous, and it is already happening in an arbitration-specific context.
Dispute Resolution Data is a US start-up that collates case data from a number of arbitral institutions (including the ICC, ICDR and CEDR) and claims to provide “insight through historic and current geographic and case-type reports on dispute resolution claims, durations and processes” for “users to formulate strategies that transform levels of service”. For the time being, information covers industry type, claim amount, location, cost, duration and macro outcomes (settled, withdrawn, final award issued etc.). It provides a trend analysis tool for businesses to take decisions about whether, where, when and how to pursue arbitration effectively.
But the potential for big data to disrupt arbitration is potentially far larger when considered alongside the ongoing transparency debate.
At the same time that technology has been empowering the masses with information, arbitration has come in for criticism (fairly or not) as cliquey and shadowy; a private safe haven for commercial men to fight their battles out of the public eye. There has also been the fierce investor-state dispute (ISDS) debate, where the right of private investors to bring arbitration claims against foreign governments on the basis of policy decisions has been questioned.
Whilst public controversy has been at its highest in the investment context, it has also provoked inward reflection in commercial arbitration circles. “Transparency” remains a buzz-word on the conference circuit without consensus as to what it should mean or how much is too little, too much, or about right.
Lord Thomas, Lord Chief Justice of England and Wales, cast attention on an important issue in this context back in spring 2016 when he suggested that the success and popularity of arbitration, combined with a presumption of the confidentiality of arbitration proceedings in English law, had been “a serious impediment to the development of the common law by the courts in the UK”.
The insight is an important one in support of the case for the democratization of arbitration data to go further. Lord Thomas’ point was that there should exist a system of law that offers both clarity and predictability, at the same time as being capable of developing in a principled manner. Put simply, he argues that the development of the common law is hindered if too many important commercial decisions remain behind closed doors.
Other members of the English judiciary have anecdotally recalled occasions where they have decided important principles of law whilst sitting as arbitrator, only to have to wait years for the same question to arise again in a public forum, when the answer can finally emerge into the light of day.
Others reasonably question whether the decisions of private arbitrators, appointed by parties with a wide freedom to choose whosoever they wish, and with little independent vetting of their experience and expertise, should influence the development of the law.
However, there is an arguable case for change. One elegant proposal for shifting the balance, rather than rocking the boat, is to switch the default position in English law from a presumption of confidentiality to a presumption against. This would at least ensure more arbitrable decisions are public and, while not binding precedent, available to assist parties and arbitrators in dealing with and deciding complex and novel legal issues.
What this would yield, indeed what the transparency debate is really about when the potential of big data is considered, is the democratization not merely of trend data but the potential for microscopic analysis of the substance of arbitration decisions and reasoning.
Such democratization might do to arbitration what Judge Analytics attempts to do to the US justice system. The platform of Ravel Law launched in 2015 to “judge the judges”. By collating and processing the huge volume of data churned out by the US courts, the platform provides users with an at-a-glance insight into how a specific judge thinks, with information on what opinions that judge has rendered and what opinions and other judges they have cited.
The idea is to make the law more transparent. In part because nothing that is presented on the platform is information that wouldn’t be ordinarily available to a litigation party with sufficient resources to pay sufficiently resourced lawyers. It is simply that technology has made the information more accessible.
However, whilst improving access to justice and advancing the commercial law might be publicly desirable outcomes in the interests of the common good they are both difficult to incentivise. For as long as there has been trade there have been disputes and there have been merchants wanting to resolve those disputes without resorting to the courts. There will always be business disputes that businessmen would prefer to keep confidential. This is a need that arbitration serves.
Further, might the democratization of substantive arbitration data bring about unintended perils? There are certainly several important cornerstones of arbitration that will be fundamentally disrupted by a big data revolution in arbitration.
One obvious area is arbitrator selection. Many have written on the sanctity of the right to nominate an arbitrator and arbitration awards have been challenged on the basis of alleged failures of party-nomination procedures. There are obvious parallels between what Judge Analytics does and the potential for big data to influence arbitrator selection but again, no wheel would be re-invented: already arbitrator due diligence is common practice (particularly in an investment arbitration context where past awards are public) and amounts to paying for research into whether a potential nominee has determined any issue or said anything publicly that might indicate a tendency towards a favorable position.
But would the potential of big data to provide instant insight into every opinion that every potential arbitrator has ever publicly expressed on every issue truly improve arbitration, or does it risk prejudice, unbalanced tribunals and more dissenting opinions?
Would the pool of arbitrators (criticized as cliquey and homogenous) be encouraged to grow by such technology, or would parties instead look to appoint from within only a limited pool of those most known to support positions likely to help them to prevail?
All relevant information is already out there somewhere of course. The difference is that technology is making the information much more readily (and cheaply) available. Perhaps the real threat then is the pace of change, and the real question is whether the thinking and approach of arbitrators, practitioners and institutions can keep up with the inevitable advances and disruptions that technology will bring?
Longer-term (but potentially sooner than you think) might human arbitrators simply become irrelevant, as with the example of the surgeon? There will also be those who consider that human discretion will always be a necessary part of dispute resolution. But if arbitration exists to serve the interests of commercial business people, and when technology can or soon will offer solutions that are quicker, cheaper, datadriven and reduce margin for error, then perhaps it is inevitable.
First published in the 1LoD Global Benchmarking Survey & Annual Report 2019
Insights on global urban migration and infrastructure projects in an evolving market