Webcasts for the Symposium on Big Data and Development

The Symposium on Big Data and Development that we hosted in Oxford  last month was a great success. There were some excellent papers there, and there are now range of follow-up ideas and initiatives that have been spun out of it (including an edited book containing some of the contributions to the meeting).

If you weren’t able to make it to the symposium (and I know many didn’t because we were massively oversubscribed), we managed to film the three keynotes, and the concluding panel. You can watch them all below:

Big data, the Global South, and digital transformation

The University of the Witwatersrand (Wits), in Johannesburg, recently made the news for the launch of one of the most innovative centers in Africa seeking to leverage academic research to promote new applications in the fields of big data, digital business, and social innovation.

In parallel with this effort, we (the Media Department, and Journalism Department and the LINK Center), launched a series of seminars reflecting on the transformative power of the Internet. The focus on the first seminar was on big data and development. In resonance with the spirit informing the Big Data and Development Incubator at Oxford, scholars and practitioners from different disciplines – from information systems, to journalism, media studies and urban planning – reflected on the promises and drawbacks of the abundance of digital born data, and its relevance for countries seeking to combat poverty, exclusion, and guarantee basic services.

While the format was a typical round-table, the debate and discussion that followed, offered unusual lessons that are important to share more broadly with the community reflecting on – and seeking to shape – the relationship between big data and human development.

The first part of the seminar highlighted continuities and discontinuing between the rhetoric characterizing “new” debates on big data and development and “older” debates on the “digital divide”, those that dominated the late 1990s and early 2000s. The language used by most international organizations reflects these continuities. For example, the argument, “Big data gives unprecedented power to understand, analyze, and ultimately change the world we live in”, included in the United Nations Big Data and the 2030 Agenda for Sustainable Development in 2015, dramatically resembles “The rapid progress of ICTs opens completely new opportunities to attain higher levels of development”, that could be found in the Declaration of Principles of the World Summit on the Information Society, twelve years earlier.

Obvious discontinuities are the amount of data produced everyday, both in the Global North and in the Global South, and in the processing power that can turn even digital exhaust into potentially useful information to understand human behavior. This quality, well exemplified by the Data for Development Challenge launched by Orange Telecom in Ivory Coast, can prove particularly important in countries striving to build strong enough institutions able to offer reliable statistics (a challenge well explained in Morten Jerven’s Poor Numbers).

A less obvious discontinuity, and the one that I want to emphasise here, depends on the different tone that can – potentially – characterize the relationship between the powerful (e.g. global corporations, donor countries) and the less powerful (e.g. low-income users, developing countries). In the 1990s and 2000s, most initiatives aimed at reducing the global digital-divide built on the assumption that those at the margin should – and wanted to? – catch up with the innovations created at the center. The dominant imagery was somehow bulkier than what we are used to today. It revolved around hardware that had to be moved from one place to another, and on the idea of a gap, or a time that had to pass for an innovation to reach the less innovative. Even the most well-meaning initiatives were built on a relationship of dependency, between those who had the technology and the skills, and those who did not, but might aspire to get some of it.

The big data and development agenda does share some of these traits, but, as the conversation at Wits highlighted, it does not have to. So far users, academics, entrepreneurs, even governments in the Global South seem to have been relatively compliant with the status quo, accepting also in this case to depend on the goodwill of those that appear to be driving the development agenda. In the case of Orange’s Data for Development Challenge, for example, while the data released were those of Ivorian users, as highlighted by Taylor and Schroeder, the teams making use of them were all from institutions outside of Ivory Coast, mostly in the Global North. When compared to digital transformations of 1990s and 2000s, however, it is important to take note that the raw materials fuelling this new “revolution” are of a different kind. Data are not hardware that need to be moved, or innovations that need to be mastered. They are already “there”, they are produced everyday, by – almost – everyone, skilled and unskilled. Orange was generous in releasing some of the data in its possession, allowing experimentation. But users, when collectively organized, can push the agenda a bit further. They can turn someone else’s generosity into a duty. They can demand that some of the data, those with the greatest public relevance is released in the public domain. This logic does not apply only to telecom operators, but to many other players that are contributing to shape the information society.

Facebook has recently boosted its philanthropic and developmental rhetoric, with initiatives like Free Basics, aimed at using satellites, drones, and other innovations to connect the disconnected, even in the most remote areas. But, as we illustrated in a recent study we published with UNESCO, Facebook has also strongly resisted any request from academics, civil society groups, and other organizations to release some of the data it possesses, even those with a clear public utility. Uses of Facebook to incite hatred and possibly lead to violence are a good example. Facebook has developed a notice and takedown approach, asking users to flag content they consider abusive or dangerous. The aggregated data emerging from this process could offer a useful early warning system to understand whether and to which extent a minority group is at greater risk of being attacked in a specific national context. Similarly to Free Basics, this issue is of great relevance to those interested in the impact of digital technology in the Global South and in their uses that can support human development. Facebook, however, appears to have shown little interest in responding to these types of requests, and trailing on agendas that are not of its own making.

More than in the past, however, the relationship of digital dependency – one that assumes that a more powerful actor will generously relinquish some of its rights, or act in support of the less powerful – could be broken. Playing with the contradictions some of the tech giants (e.g. Facebook, Twitter, Google) are creating for themselves as they seek to boost their image by helping the “poor”, or seek to combat injustices, can be a way to do so. Users in the Global South may be the first, asking for their data to be freed for “development”, seeking to set the rules for global corporation to help them, rather than waiting for their innovations and generosity. After all, as the global resonance of #Rhodesmustfall and #feesmustfall movements that first emerged in South Africa has indicated, innovations (in imagery, not just in technology) do not have to travel only in one direction to be effective.

Symposium on Big Data and Human Development – closing remarks

It has been an extremely rewarding two days at the Symposium on Big Data and Human Development that Eduardo Lopez and I organised. We had a full room of people from academia, government, and the development sector – all speaking about how we might better use big data in the contexts of development.

There are many threads that we’ll try to tie up over the next few weeks (an edited book, some workshop reports, perhaps another conference next year, etc.). But in the meantime, it might be useful if I reproduce the notes that I used to sum up the event here. Those of you who attended, please do comment if you see that I omitted anything. Those of you who didn’t, please feel free to use this as a prompt to get involved.


This has been a much-needed conversation at a moment in which we’re awash with hype about ‘big data’.

We’ve learnt a lot about some of the potentials of big data: We’ve got new sorts of early warning signals. And – as we move from data to information to knowledge – we seem to be getting better at figuring out what to look for when it comes to disease tracking, or predicting things like student failure rates or corruption.

The fact that so much data comes from mobile phones has also created a specific opportunity to look at human mobility. And the relative democratisation of connectivity has important implications for deliberation and public participation at scales that have never before been possible.

But, with all that in mind, I want to pick up with areas that I think we still need to find ways to resolve as we all move forwards at this intersection of topics:

First, one theme that keeps coming up is that of data presences and absences really mattering. We have great data about some places, processes, people. But there are still big gaps – and, going forwards, we’ll really to address this head-on. If we’re using data to deploy scarce resources or deliver essential services, but there are blank spots on our map – then what strategies should we be employing to deal not just with our known unknowns, but also our unknown unknowns? Some of this might entail really getting good about asking questions about outliers in our models: Where are they, who are they, when are they?

Second, another important theme is not just data presences and absences – but even within the presences, there is the question of open versus closed data. So, for instance – many of us – me included – tend to use Twitter data to ask and answer a range of questions. And we do this because it is easily available and free and relatively straightforward to use.

But we should be careful that we don’t get into the sort of situation in which the tail wags the dog rather than the dog wags the tail – as my colleague Ralph Schroeder puts it. What sorts of questions are we prevented from asking because of a lack of open, available data sources? What sorts of questions or topics are we perhaps focusing too much energy on? And what sorts of questions do our data lend or not lend themselves to?

Third, and relatedly, we’re faced with some tension between issues of privacy, ownership, and control. How do we balance the desire to have more open data with best practices that prevent data leakage and still afford citizens with some control over their own data shadows?

There was an interesting discussion in the session that I organised with Richard Heeks at the DSA conference earlier this week about what we might learn from the literature on resource management – if we treat data as a resource.

And more broadly, are we happy with the current political-economy of development data? What current rights of access, control, and use should be rethought and challenged?

Fourth, how do we ourselves operate with maximum transparency – especially when we’re not just dealing with descriptive analytics, but predictive analytics, and even prescriptive analytics? If our research, and the data we use, impacts on real people in real ways – are we happy with the current scientific models of dissemination that we use – or do we need any sort of alternate strategies that better engage with the communities that are the users – or subjects – of development?

Fifth, what can, or should, we learn across contexts? Or specifically, what should we rethink and relearn in different places or contexts? What sorts of things aren’t transferrable? This is maybe where the repeated call throughout this conference for all of us to be thinking and collaborating in a multidisciplinary way comes in useful.

Symposium on Big Data and Human Development | Sept 15-16 2016 | Final Programme

This workshop aims to move forward the debate about the ways in which big data is used, can be used, and should be used in development.

This symposium will also serve as a bridge between methodological knowledge about big data, critical academic research on the topic, and the desires of stakeholders and practitioners to achieve key developmental outcomes and goals.

This conference will use the hashtag #datahumdev

With keynotes by:

  • Professor Bitange Ndemo, Former Permanent Secretary of Kenya’s Ministry of Information and Communication, and Lecturer at the University of Nairobi
  • Professor Alex (Sandy) Pentland, Academic Director of Data-Pop Alliance, and Director of the MIT Human Dynamics Lab
  • Dr Linnet Taylor, Assistant Professor in Data Ethics, Law & Policy, Tilburg Institute for Law, Technology and Society (TILT)



Thursday 15 September
Start End Schedule
12:30 13:00 Registration
13:00 13:15 Welcome & Opening Remarks

13:15 14:15 Keynote

  • Dr. Bitange Ndemo, Former Permanent Secretary of Kenya’s Ministry of Information and Communication and University of Nairobi Business School
14:15 14:45 Coffee Break
14:45 15:15
15:15 15:45
15:45 17:45 ‘Health and Big Data’

  • Speakers TBC
Friday 16 September
Start End Schedule
09:00 10:00 Keynote

10:00 10:30 Coffee Break
10:30 11:30 Parallel Session A (Lecture Theatre 04)Title TBC

“The Diffusion of Ultrasound Technology and Missing Women: An Analysis based on Google Searches for India”

 10:30 11:30 Parallel Session B (Seminar Room)“Exploring the Potential of Open Data and Aid Transparency for Development”

“Building the Online Labour Index”

“Emergency Event Detection Using Mobile Phone Data”

11:30 12:30 Parallel Session A (Lecture Theatre 04)“The Economic Geography of the Internet 2.0: Digital Social Capital and Cities.”

“Data, Visualisation and Human Development”

“Measuring the Hidden Contours of the Global Knowledge Economy with Big Data”

 11:30 12:30 Parallel Session B (Seminar Room)“The Making of Beneficiaries: On the Datification of Anti-Poverty Programmes”

“Big data for development research in the Global South: Experiential lessons from LIRNEasia”

“Combining Big and Traditional Data Sources to Enhance Public Policy Decision Making for Sustainable Development”

  • Dr. Jonggun Lee, Pulse Lab Jakarta – United Nations Global Pulse
12:30 13:30 Lunch (provided)
13:30 14:30 Keynote

14:30 15:30 Parallel Session A ( Lecture Theatre 04)“Algovernance: Can Open Algorithms Revive Democratic Principles and Processes?”

“Digging into big data and development: Findings from three Indian cases”

14:30 15:30 Parallel Session B (Seminar Room)“Using IATI Data in “big data for human development” Research”

“Big Data and Development: the Role of Competition Law and Policy”

Title TBC

15:30 15:50 Coffee Break
15:50 16:50 Panel & Keynote

16:50 17:00 Closing Remarks

Symposium on Big Data and Human Development

We are happy to announce a two-day symposium (Sept 15-16) that we are running in Oxford on the topic of big data and human development. This workshop aims to move forward the debate about the ways in which big data is used, can be used, and should be used in development.

This symposium will also serve as a bridge between methodological knowledge about big data, critical academic research on the topic, and the desires of stakeholders and practitioners to achieve key developmental outcomes and goals.

We are lucky to have keynotes lined up from the following speakers:

  • Professor Bitange Ndemo, Former Permanent Secretary of Kenya’s Ministry of Information and Communication, and Lecturer at the University of Nairobi
  • Professor Alex (Sandy) Pentland, Academic Director of Data-Pop Alliance, and Director of the MIT Human Dynamics Lab
  • Dr Linnet Taylor, Fellow at the Department of International Development, University of Amsterdam

Call for abstracts

We welcome the submission of abstracts (of max 250 words) for talks, panels, and sessions at the workshop. Submit them to christopher.dobyns@oii.ox.ac.uk by 15 July 2016.

Papers presented in the conference will be considered for an edited volume in big data and human development.

Please contact Mark Graham (mark.graham@oii.ox.ac.uk) with any questions.

The Oxford Human Development and Big Data Incubator is working to stimulate policy-oriented research. Topics that we seek to focus on in our workshop include (but are not limited to):

  • What ‘big data’ can tell us about human development; how we can facilitate better decision-making and accountability in previously data-sparse environments;
  • What presences and absences of data tell us about issues of participation and exclusion among marginalised populations;
  • What tools have emerged globally that can maximise citizen ownership of big data, by making data meaningful within the cultures of participation that characterise different localities.
  • Research results of projects employing big data in the contexts of development.

Submissions may include:

Talks: Contributors are invited to submit full-length talks (15 min) related to the conference themes

Panels: Contributors are invited to pitch a panel discussion on core conferences themes

Demonstrations: Contributors are invited to submit an idea for a demonstration (which may be facilitated as part of a panel as a stand-alone event)

To attend, please email your name and affiliation to events@oii.ox.ac.uk. Attending this conference is free of charge. Please note space is limited and registration preference will be given to contributors of selected abstracts. Otherwise, check out our official events page for up-to-date information, and hope to see you in Oxford!

Using Alternative Data Sources to Validate International Surveys?

The narrative of misleading development statistics has been iterated in recent years. Morton Jerven’s well-known text, How We are Misled by African Development Statistics and What to Do about It, challenges the reliability of development statistics and calls for new approaches to data collection. More recently, Michael Robbins and Noble Kuriakose have determined that approximately 1 in 5 international surveys contain fabricated data.

By reviewing responses from more than 1000 surveys, Robbins and Kuriakose identified 17% of these surveys as “likely to contain a significant portion of fabricated data. For surveys conducted in wealthy westernized nations, that figure drops to 5%, whereas for those done in the developing world it shoots up to 26%.”

The two researchers came to these conclusions by identifying duplicate responses in surveys. One existing hypothesis is that many survey responses are biased due to the presence of data collection assistants (who are often collecting data door to door). Although some researchers have challenged Robbins and Kuriakose’s methods, many others believe that the problem is even larger than the stated 17 percent.

Clearly, there is a strong argument to be had that additional data sources should be used to validate survey responses. One of our objectives at the Big Data and Development Incubator is to understand how data has been effectively harnessed in the context of development. By furthering the conversation on data and development, we aim to support development professionals, practitioners, and scholars.

What role for the Big Data and Human Development research network? Reflections from the UN Expert Group Meeting on Big Data and the 2030 Agenda for Sustainable Development, 14-15 December, Bangkok

UN EGM on Big Data and the 2030 Sustainable Development Agenda

Participants at the UN Expert Group Meeting on “Big Data and the 2030 Agenda for Sustainable Development”

(Photo credit: Eri Nomikou, https://twitter.com/ENomikou/status/676274507384938496)


With a critical view on “Big Data” and “human development” across low-, middle-, and high-income countries, we position ourselves as a unique research network in the expanding Big Data and development landscape. Having returned from a recent United Nations Expert Group Meeting on “Big Data and the 2030 Agenda for Sustainable Development,” I believe that a key contribution of our network is to foster a North-South dialogue and to offer multidisciplinary perspectives and competencies that are largely under-represented among the existing Big Data actors.

Make no mistake: The debate at this high-level forum was nuanced and critical rather than focused on utopian ideas about the limitless potential of big data. Actors from the public, private, and academic sectors agreed that we first need to focus on the development problems and then solve the respective data needs, not the other way round. Problems of data solution “patchwork,” data privacy and consent, viable private sector business models for public-private partnerships in big data, or closed versus open data environments were debated openly and honestly.

But it is also clear that many issues surrounding big data remain unresolved and require critical reflection and research. For example, because the skills and capacity to produce, handle, and analyse Big Data are likely to rest outside of government boundaries, increasing the use of Big Data in policy can be problematic. While often framed under broadening participation (e.g. Twitter data), “partnerships” for a wider data ecosystem, and private sector “data philanthropy” (i.e. companies donating data), private partners might also have vested interests to shape and select the data and indicators that correspond to desired policy changes from their perspective. This could mean a transfer of knowledge and power from the public to the private sector. How could we then ensure that transparency and accountability mechanisms apply to the same extent to private actors as to public ones? Even where such situations do not occur, continuity and reliability in such partnerships are not guaranteed. For example, voluntary donation of data by a company may be useful, but once economic constraints tighten, how would that company be prevented from stopping this practice in order to keep costs in check? How would private data sharing agreements alter if the company is bought by a competitor? What if national development policies are based on data provided by a company that is about to go bankrupt (the same applies to NGOs with erratic income streams)?

My point here is not that Big Data uses for development policy should be discouraged, but that we need to have a better grasp of such fundamental questions before we advocate alterations of fundamental policy processes in favour of non-conventional data (even existing “conventional” data appears widely underutilised). Among the numerous problem areas surfacing at the Expert Group Meeting was the need for overarching frameworks (e.g. ethical, evaluation, data governance, and knowledge management frameworks) and for a better problem-specific and micro-level understanding of Big Data’s opportunities and intrinsic limitations (e.g. the social context of data generation, informational value of Big Data vs. conventional data to monitor specific Sustainable Development Goal indicators). The illustration below summarises some of the many themes that arose in the meeting.



Summary of Big Data problem areas

In my view, the high-level conversations at the Expert Group Meeting serve a useful purpose for putting “Big Data” on the policy agenda. What is needed next (and we are not quite there yet) is to build a knowledge base to understand how and how not to use various kinds of data in development policy and processes. Countries may articulate data and knowledge demands for specific development problems, and work with other “stakeholders” in pilot projects to develop institutional frameworks and mechanisms to make the best use of Big Data in light of its limitations. One plausible scenario might be that Big Data solutions help governments to save money when monitoring variations in development indicators for a majority group in urban areas (e.g. mobile phone data on economic performance and incomes), but the costs saved for data collection in one area should then be reinvested in order to understand the problems of the groups omitted by these data sources (e.g. remote and disconnected population groups). (Pilot projects, despite their seemingly poor reputation at the meeting, can help to build such knowledge, provided that evaluation frameworks are developed to articulate the learning outcomes up-front.)

The participation in a debate among experts has reinforced my conviction that research networks like ours are an indispensable ingredient to a more comprehensive understanding of Big Data. It is especially the North-South dialogue and the interdisciplinary expertise in our network that can open new perspectives and add much-needed depth to a Big Data debate that is still taking place at a high level.

Big data and development mailing list

We have started a mailing list for anyone wanting to stay in touch about the ‘big data and development’ initiative, and engage in conversation with the network. Just send a message to [bigdatadevelopment-subscribe@maillist.ox.ac.uk] to sign up.

The new Big Data and Human Development research network

Data are now almost ubiquitous. Sensors and software are digitising and storing all manner of social, economic, political and environmental patterns and processes. As the size of these datasets has increased exponentially, many have begun to focus on how ‘big data’ harvested from online sources can allow potentially unprecedented insights into our world that may facilitate efforts to enhance human development.

Yet relatively little is known about how best to harness ‘big data’ in ways that could effectively inform development processes, particularly for the most disadvantaged, and whether those at the margins who produce the least amount of data risk becoming even more invisible. While new expertise is emerging, it remains unclear whether, and how, ordinary citizens will be able to seize these opportunities, individually and collectively and use them to their advantage.

Our initiative:

The ‘big data and human development’ research network aims to investigate the potential uses of ‘big data’ for advancing human development and addressing equity gaps. We are establishing a cross-disciplinary and global network to map what data sources and techniques exist for harnessing new digital data and address persistent concerns regarding human development, inequity, exclusion, and participation.

Our Goals:

The goals of this network will be to stimulate policy-oriented research that seeks to understand: (1) what presences and absences of data tell us about issues of participation and exclusion; (2) what data tell us about gaps in human development: facilitating better decision-making and accountability in previously data-sparse environments; (3) what tools have emerged globally that can maximise citizen ownership of big data, by making data meaningful within the cultures of participation that characterise different localities.

Our Approach:

We plan to achieve these goals with three core activities.

1) First, we plan build a digital observatory that seeks to assess the potentials of different data sources for informing human development. This observatory will be a web-platform that can link to relevant data and metadata.

2) Through the use of detailed case studies, we aim to empirically illustrate some of the promises and perils of using big data to inform human development. These case studies will be carried out in collaboration with end-users is some of the countries that most need to access big data and harness them for human development, but lack the expertise to make use of them as they are currently offered.

3) Third, we plan to bring together research and policy from both Global North and South to ensure that methodological knowledge about big data is appropriately mapped on to the interests of stakeholders to achieve key development outcomes. We hope to bring together key figures in order to avoid what Schroeder 2014 refers to as the tail of big data wagging the dog.

Our Planned Activities:

  • An initial workshop will be held in Oxford in the first year of the initative bringing together a limited number of key stakeholders to discern the potential use of big data for human development. This workshop will help inform development of the data observatory and selection of case studies.
  • A core activity for our project is the development and maintenance of a data observatory of big data and its potential for informing human development
  • A final workshop will be held in the second year to disseminate our preliminary findings to a broader range of stakeholders and further engage with the types of empirical research being pursued.
  • We also plan to host a seminar series focusing on ‘big data and human development.’ This will be an open event for anyone in Oxford, and will be freely webcast for a broader audience.

Our hope is that this project will bring together a range of disciplinary strengths at Oxford and beyond. At this early stage, we welcome inputs, suggestions, and collaborations, to steer and guide this initiative. Bringing together work in this area will not only result in ground-breaking, cross-disciplinary research, but will also ultimately serve to inform more evidence based human development programmes around the world.