Skip to main content

The growing inequality of doing AI research

Axios Future

By Bryan Walsh ·Oct 03, 2020

A new report shows that cripplingly high computational costs mean just a handful of big companies are able to do top-flight AI research.

Why it matters: AI will do more than any other technology to shape our future. If only the Googles and the Microsofts of the world have the resources needed to move the field forward, it will solidify their power — and possibly strangle innovation.

By the numbers: It likely cost the Microsoft-funded research group OpenAI more than $10 million to train GPT-3, its cutting-edge, new natural language processing algorithm, according to the annual State of AI Report published Thursday.


  • What this means "is that a handful of well-capitalized entities are now in control of artificial general intelligence research," says Ian Hogarth, a visiting professor at University College of London and one of the co-authors of the report.

Of note: OpenAI was originally founded as a nonprofit with the purpose of pursuing AI research for the benefit of all humanity.

  • But last year it set up a for-profit arm and accepted a billion-dollar investment from Microsoft.
  • Last month Microsoft announced it would be exclusively licensing GPT-3.

What they're saying: "This is a direct reflection of the cost of doing frontier research in compute and talent," says Hogarth.

Context: In the future the costs of developing these massive models may become prohibitive even for the richest tech companies.

  • The report found that without major research breakthroughs, reducing the error rate for ImageNet — a massive database used for visual recognition research — from 11.5% to 1% could cost 100 billion billion dollars. (Yes that's two "billions.")
  • All that compute requires lots of energy, which in turn means that AI research has a growing environmental footprint.

The bottom line: It doesn't make sense scientifically or ethically for high-level AI research to be done only by those companies that can afford it, but changing the paradigm won't be easy.


Comments

Popular posts from this blog

Menon meets Karzai, discusses security of Indians

Kabul/New Delhi/Washington, March 5 (IANS) India Friday said that the Feb 26 terror attack in Kabul will not deter it from helping rebuild Afghanistan as National Security Adviser Shivshankar Menon met Afghan President Hamid Karzai in Kabul to review the security of around 4,000 Indians working in that country. Menon, who arrived here Friday morning on a two-day visit, discussed with Karzai some proposals to bolster security of Indians engaged in a wide array of reconstruction activities, ranging from building roads, bridges and power stations to social sector projects. The Indian government is contemplating a slew of steps to secure Indians in Afghanistan, including setting up protected venues where the Indians working on various reconstruction projects will be based. Deploying dedicated security personnel at places where Indians work is also being considered. Menon also met his Afghan counterpart Rangin Dadfar Spanta and enquired about the progress in the probe into the Kabul atta

Iran is losing the game to regional actors in its strategic depth

Rethink before It’s Too Late http://www.irdiplomacy.ir/index.php?Lang=en&Page=21&TypeId=15&ArticleId=7108&BranchId=19&Action=ArticleBodyView Iran is losing the game to regional actors in its strategic depth –Afghanistan. By Houman Dolati It is no more a surprise to see Iran absent in Afghanistan affairs. Nowadays, the Bonn Conference and Iran’s contributions to Afghanistan look more like a fading memory. Iran, which had promised of loans and credit worth five-hundred million dollars for Afghanistan, and tried to serve a key role, more than many other countries, for reconstruction and stabilization of Afghanistan, is now trying to efface that memory, saying it is a wrong path, even for the international community. Iran’s empty seat in the Rome Conference was another step backward for Afghanistan’s influential neighbor. Many other countries were surprised with Iran’s absence. Finding out the vanity of its efforts to justify absence in Rome, Iran tried to start its

Pakistani firm whose chemicals were used to kill US troops seeks subsidy for Indiana plant

By Jennifer Griffin, Justin Fishel Published March 22, 2013   A Pakistani fertilizer maker whose chemicals have been used in 80 percent of the roadside bombs that have killed and maimed American troops in Afghanistan is now seeking U.S. taxpayer subsidies in order to open a factory in Indiana.  The request appears to be on hold pending further review, but the situation has stirred outrage in Congress, where some accuse the Pakistani government of halting efforts to clamp down on the bomb-making.  For the past seven years, the U.S. government has known that the raw material calcium ammonium nitrate, or CAN, is making its way across the border into Afghanistan where the Taliban use it to fuel their most deadly weapons, namely the improvised explosive device. IEDs have long been the number one killer of U.S. and coalition troops.  The material largely comes from Pakistani fertilizer maker the Fatima Group. But the Pakistani government has stymied attempts by the Pentagon to stop the