19
Oct 14

2014 and the Ministry of Truth | Newspeak: Minitrue

Abigail Leffler says Big Data Brother… one bit at a time

ICT (Internet communications technology) enables gathering of digital data derived from our online interactions and other iterations such as those that come from GPS (Global Positioning System)-equipped devices. This interactivity being ‘a necessary condition for social, cultural and political participation’ (Lievrouw: 2013, p. 15) functions as a catalyst for change, development and humanitarian relief.

Just consider that all the tweets, blogposts and Facebook entries generate big data and so do all the ‘likes’ and endorsements and any other information pointing to user connection networks and to activity levels of individuals on the Net.

To give you an idea of how large big data actually is, every minute of every day we create

Continue reading →


18
Oct 14

Big Data and You: Accessing Big Data

Johannes Kast on open data and big data… and the data revolution.

Big Data is shaping the way we look at the world and offers an alternative way of predicting what is going to happen next. And the amount of data is exponentially increasing. While in 2012, 2.8 Billion Terrabyte of data were saved, the IDC predicts that this number will increase to 40 Billion in the year 2020. Data is changing how we make sense of the the world, it changes classic business models drastically and it has the potential to revolutionise social sciences and the development sector.

There is an obvious benefit for companies to use their collected user data to analyse their markets and consumers, a practice that social media has monetized for a while now. And the tendency to collect massive amounts of data by government agencies has been demonstrated by the scope of the recent NSA scandal. However the Open Data and Open Government trend, which is essentially unstructured data being made publicly available to everyone, is growing as well and can potentially open up new possibilities how non-profits (or other third parties) can play a more active and creative role in shaping our world.

While it can be argued that the current form of data being released is supply driven, while it should be demand driven there are already several access points made available. With more than 150,000 data sets and tools to use them, the US Open Data initiative is a step into the right direction, offering raw information on over twenty topics, such as agriculture, climate and education.

Continue reading →


17
Oct 14

Resource – open data Kenya

An interesting example of open data application – contribution by Catarina Nilsson.

Kenya launched an online portal with government data in 2011, claiming it to be the first one in Sub-Saharan Africa.

It says on the website: “The goal of opendata.go.ke is to make core government development, demographic, statistical and expenditure data available in a useful digital format for researchers, policymakers, ICT developers and the general public.”

As we see throughout this blog and elsewhere, more and more organisations make their data available openly, which opens a world of possibilities.

But how do we, as users without deeper insight into the data collection methods, assess the data quality?


16
Oct 14

Open data in use – a few examples from Tim Berners-Lee

What happens when open data gets connected and is used? Please watch this interesting video introduced by Catarina Nilsson.

In this short TED-talk from 2010 Tim Berners-Lee, the physicist who is known for laying the ground for the Word Wide Web, shows a few examples of how it looks when open data gets connected and used.

[youtube]http://www.youtube.com/watch?v=3YcZ3Zqk0a8[/youtube]

Also don’t miss his related reading list!


08
Oct 14

A story about when public data was too big, and maybe not so public after all

How open is Sweden to open data? Charlotta Duse investigates.

A daily routine at the local newspaper where I work, and at many others, is that the news chief goes to the town hall to fetch the daily public documents. In these documents one finds correspondence between institutions, decisions made in the municipality, prosecutions, judges, new guidelines, construction permits etc; basically anything that goes on nearby. 

Anyone can get these documents, the data is public and protected by the principle of public access (http://www.regeringen.se/content/1/c6/24/55/92/61c8bc18.pdf): a principle to make sure that the democratic system can be looked into, as well as to promote civic participation. Just as we saw in Abigails post Open Data, transparency is, and should be, one part of ”the good” of open data.

After getting the daily documents, the editorial sorts out what is of interest for its readers. (It should be pointed out that this is no objective process – here lies a big risk of misinterpretation, focus on some things while ignoring others, judging what is public interest and what is not etc.) After choosing the happenings of interest the reporter write his or her article based on the document, a document often written in a complicated language, in a manner that anyone can understand the information given in it.

But some time ago, colleagues in Kalmar had troubles getting access to these public papers. The reason? 

Continue reading →


06
Oct 14

Visualising aid – Sweden’s Open Aid project

Catarina Nilsson presents a practical application of open data in development.

The Swedish government through the ministry for foreign affairs in collaboration with the Swedish International Development Agency (Sida) launched the website www.openaid.se in 2011. The idea was to make the whole chain of events in a development aid contribution available to the public, with transparency as a leading principle.
In line with the increased use of open data www.openaid.se was recently developed and updated. The new site is built as an open source site, which makes it possible for anyone to fetch data and use the software.

openaid.se display of aid to Uganda 2013

openaid.se display of aid to Uganda 2013

The data is available through an API (Application Programming Interface) that enables anyone to construct a query. Sida chose to develop its system in a way that allows anyone to visualise chosen data in an own way.
But which data? A fancy visualisation is never better than the data it is based on. The data used in Open Aid comes from Sida’s systems, so however openly they are shown it still builds on that the agency has its statistics and financial systems in order.

All data is packed in the so called IATI standard, making it somewhat comparable in an international setting. The International Aid Transparency Initiative (IATI), launched as a collaborative initiative at the High Level Forum on Aid Effectiveness in Accra 2008 and has become an international standard in aid transparency.
The IATI standard as used on Open Aid has its problems though, for example are substantial sectors of aid not technically classified as such not yet possible to identify. For example research support or ICT.

Further reading:
About Open Aid www.openaid.se
About IATI www.aidtransparency.net


06
Oct 14

Real Virtualities

Abigail Leffler considers the use of open data in academia

Do you like cartoons? If you do, you may enjoy this eight and a half-minute long one by Piled higher and Deeper (PhD) advocating for the use of open data in academia.

The authors submit that ‘tax payers are already paying for knowledge to be distributed broadly’ (Shockey and Eisen: 2012). Research and peer-reviewed papers in the public domain benefit not only students and researchers in both developed and less developed countries (for the latter, open data is precious as it may be the only resource at hand), but authors as well, as it helps them gain more visibility in their field.

Continue reading →