You are browsing the archive for aid.

Charting Progress

- March 20, 2013 in aid, Data Blog, impact

When is poverty going to end? How many donors are reaching the 0.7% target? How much does the UK spend on aid?
Image credit: chartingprogress.org

Image credit: chartingprogress.org

We ask these questions every day, and yet it is often difficult to find the answers. The data often isn’t available, and even when it is, finding the answer means diving into row upon row of spreadsheets. Data is often out of date by the time it is published. Help is at hand. Charting Progress is a unique new graph blog that examines key issues in relation to ending poverty in pictures rather than words. It provides a single graph on a regular basis telling the development stories of the day. It provides up-to-date and myth-dispelling data, as it emerges, on the key poverty-related issues being talked about in the media and elsewhere. Over time, it builds a comprehensive bank of data that can be scrutinised, downloaded, and shared on social media. The site, provided by Development Initiatives (an independent organisation that champions the use of information to end poverty), is based on the principle that information is much more powerful if it is presented properly. By providing high design values and simple, intuitive navigation, users can find the information they need quickly and clearly. The site also provides a sneak preview of analysis that DI is undertaking including on its major Investments To End Poverty initiative, which seeks to become the go-to source on all resources for ending poverty. The project will simplify and map out the complex landscape of all resources relevant to poverty eradication and highlight information gaps in data that need to be filled to maximise the efficient allocation of resources. As data emerges on the project, it will be placed on Charting Progress in the first instance before being presented in more comprehensive reports. Initial data planned includes information on all official flows, the breakdown of aid budgets, and private giving. The site will also carry data from our other popular DI programmes including Global Humanitarian Assistance and aidinfo. Finally, Charting Progress provides an opportunity for you to interact with those who have an interest in the same issues. You can comment on each graph, leave observations on the site, and get in touch if you want to know more about any of the issues raise. We also welcome feedback on the product itself so that it is of maximum use to you, the user. flattr this!

Charting Progress

- March 20, 2013 in aid, Data Blog, development, impact

When is poverty going to end? How many donors are reaching the 0.7% target? How much does the UK spend on aid?
Image credit: chartingprogress.org

Image credit: chartingprogress.org

We ask these questions every day, and yet it is often difficult to find the answers. The data often isn’t available, and even when it is, finding the answer means diving into row upon row of spreadsheets. Data is often out of date by the time it is published. Help is at hand. Charting Progress is a unique new graph blog that examines key issues in relation to ending poverty in pictures rather than words. It provides a single graph on a regular basis telling the development stories of the day. It provides up-to-date and myth-dispelling data, as it emerges, on the key poverty-related issues being talked about in the media and elsewhere. Over time, it builds a comprehensive bank of data that can be scrutinised, downloaded, and shared on social media. The site, provided by Development Initiatives (an independent organisation that champions the use of information to end poverty), is based on the principle that information is much more powerful if it is presented properly. By providing high design values and simple, intuitive navigation, users can find the information they need quickly and clearly. The site also provides a sneak preview of analysis that DI is undertaking including on its major Investments To End Poverty initiative, which seeks to become the go-to source on all resources for ending poverty. The project will simplify and map out the complex landscape of all resources relevant to poverty eradication and highlight information gaps in data that need to be filled to maximise the efficient allocation of resources. As data emerges on the project, it will be placed on Charting Progress in the first instance before being presented in more comprehensive reports. Initial data planned includes information on all official flows, the breakdown of aid budgets, and private giving. The site will also carry data from our other popular DI programmes including Global Humanitarian Assistance and aidinfo. Finally, Charting Progress provides an opportunity for you to interact with those who have an interest in the same issues. You can comment on each graph, leave observations on the site, and get in touch if you want to know more about any of the issues raise. We also welcome feedback on the product itself so that it is of maximum use to you, the user. flattr this!

Aid Data: From XML to Visualisations – IATI data in OpenSpending

- June 5, 2012 in aid, IATI, Open Government Data, Open Spending, Open Standards, open-government, OpenSpending, WG Development

Are the World Bank and Department for International Development (DfID) spending money on projects in similar sectors and countries? Does all aid to Kenya go the North-East? How much aid in total did India receive last year? Until recently, it was impossible to know. But now, thanks to the International Aid Transparency Initiative (IATI), we’ve been able to start to answer these questions – making the aid process more transparent, which is crucial for making it more effective. IATI is a political agreement by the world’s major donors – including international banks, private foundations and NGOs – on a common way to publish aid information. It also defines a technical standard for exactly how that information should be published, IATI-XML. So far, 29 donors representing 74% of Official Development Finance (ODF) have committed to publishing to IATI. A further 13 donors representing 45% of ODF have already published, and 12 NGOs and foundations have published their own data. This post details how we converted each donor’s data, using simple scripts and open source tools, from raw XML data in the IATI Registry into a consolidated dataset and then, via loading into OpenSpending to visualisations like those shown above and an easy-to-use RESTful API.

From this....

... to this.

Getting the Data Together

Full details of how we got the data together are in this case study on OpenSpending … but to summarize:
  • We grabbed a list of all the IATI data files via the IATI Registry API (the IATI registry is running CKAN so this is very easy)
  • We converted the data to an SQLite database and a simplified CSV format and posted these on the IATI dataset on the DataHub
  • Modelled and loaded it into OpenSpending, creating views to visualize it in basic forms.

What you can see

You can now explore the complete dataset of aid data released so far through IATI, exploring the aggregate and detailed data on OpenSpending. You can drill down through the data and look at it from different perspectives, from exploring the largest sectors in a country, to different implementing organisations in that sector, to looking at all the projects implemented by a single organisation.

Drill down from one layer…

IATI 1

… to the next – we’re zooming in on China here, breaking down by flow type…

IATI China Zoom

… and you can switch between breakdowns – slicing data here up by organisations implementing the aid…

IATI China Implementing Organisation

… and here by funding organisation

IATI China Funding Organisation

More details

We’ve also just put together a briefing on how we worked with the IATI data on OpenSpending.org. The briefing covers in depth what IATI is, using the IATI registry, consolidating data into a simple format, loading data into OpenSpending and using the API.

Next steps & get involved.

For those keen to put coding knowledge to good use to further the IATI mission, some ideas below:
  • Use the API – you can use OpenSpending’s API to build applications – read the briefing for more ideas and instructions
  • Review our scripts for converting IATI data. We’ve been compiling a list of known issues with possible future extensions such as geo-coding, reconciling organisations and handling currencies.

What’s in the data, what’s still to come

The dataset contains current and future spending by major aid donors representing 44% of ODF, with disbursement data running up to the current month in some cases. It also contains commitment data up to 2016 from one donor (and from multiple donors up to 2014). However, the data does not contain any information from donors who have not yet published to IATI, and it also does not yet include results, project documents or geo-coded data. Future projects might include:
  • Validation – to ensure that data is properly formatted and uses standard codelists;
  • Adding results, geo-coding and project documents to the OpenSpending visualisation – some of this is already available in the original source data, but has not yet been incorporated to this dataset;
  • Other visualisations – for example, a map, and activity and transaction views;
  • Running the dataset compilation automatically – so that it runs on a server nightly, is up-to-date and imports the latest version to OpenSpending as it’s updated.

The future

Eventually what we’d like to see is something like this: an integrated dataset of aid and budgets in each country, so that the full picture of resource flows is available. PWYF Uganda Which country will be next to join up their aid and budgetary flows? You can get in touch with us via the mailing list if you have any questions about this project or the data. This post was written by Mark Brough. It is cross-posted on the OpenSpending blog.