Using 360Giving Data

Find out how developers, researchers and others can use 360Giving data.

Using 360Giving data

This page is designed to help developers, data analysts and other technical users access and use grants data published to the 360Giving Standard.

360Giving Data Standard

The 360Giving Data Standard is a specification for sharing grants data. The standard is applicable to two formats: tabular data (Excel, CSV, etc) and JSON. The JSON version is the canonical data standard, but the standard operates the same across both formats.

Organisations publish data about grants they have made using this standard. They can choose the format they publish in – Excel, CSV or JSON.

The standard is maintained on Github, based on decisions made by the Standard Stewardship Committee.

Data registry

In order to help grantmakers, developers and analysts discover and use data that uses the 360Giving Standard, 360Giving maintains a register of data at data.threesixtygiving.org. The Data Registry contains a list of the data known to have been published using the 360Giving Data Standard (that is both valid and licensed as open data), along with details of who has published it. All the files on the register should conform to the 360Giving Data Standard.

The majority of publishers (more than 90%) publish their data in Excel format. You can download files directly from the registry if you wish to use it in the original form it was created in.

Registry feed

A JSON feed of files published to 360Giving Standard is available at data.threesixtygiving.org/data.json. This file is updated daily and includes current publishers that have notified 360Giving that they have published data. The JSON is an array of objects in the following format (based on DCAT):

[
  {
     "title":"Title of the dataset",
     "description":"Description about the dataset",
     "identifier":"An internal identifier for this dataset from our
                  storage system",
     "license":"A link to the license information for this dataset.
                  Should be a valid URL",
     "license_name":"A human readable title of the license given in
                      the license field",
     "issued":"The date (YYYY-MM-DD) this dataset was first
                        recorded as published",
     "modified":"The datetime that this record was last changed.
                       The change could relate to any of the metadata
                       about the dataset",
     "publisher": {
        "name":"Name of the organisation publishing this dataset",
        "website":"Should be a valid URL to a website of that publisher",
        "logo":"Should be a valid URL to a logo for that publisher.
                You may not necessarily have permission to use this
                logo for your own purposes.",
        "prefix":"The unique 360Giving prefix used by this publisher
                  to identify the grants they publish."
     },
     "distribution":[ {
        "downloadURL":"A valid URL to directly access the data",
        "accessURL": "A valid URL, usually to a web page, where access
                      to the downloadURL can be found. The web page
                      usually has other useful information about the data",
        "title":"Title of the dataset"}
     ]
  },
]

Metadata feed

360Giving provides a JSON feed that contains metadata about files in the registry, including file statistics (including size, location, validity against the standard), aggregate statistics (including total grants, values, and dates) and useful insights (including organisation identifier schemes used).

A coverage JSON report is also available, which contains the contents of status.json plus coverage reports on field usage for each dataset.

Additionally, a CSV report is available, which contains a subset of the fields available in the JSON feed, focussed on the aggregate statistics.

Using the data

Use data from publishers

Most 360Giving Data Standard data files are published in XLSX format, with a small number published as CSV format or JSON data. The Data Registry provides separate download links for each file in its original file format.

When handling multiple files, you’ll need to bear in mind that not all files will contain the same columns. As well as the required fields that all valid data must include and any optional fields from the standard, publishers have flexibility to include additional non-standard fields based on their needs. So when merging multiple files together you’ll need to ensure you account for each file having different columns in a different order.

360Giving Datastore

360Giving offers a convenient way for developers, researchers and others to access grants data published in the 360Giving data standard – the 360Giving Datastore.

The Datastore is updated every night by fetching data from every file on the 360Giving Data Registry. GrantNav is then updated based on this latest data.

For users with more complex data needs or with specific technical skills, it is possible to directly access the Datastore and run queries on it. Potential uses of the Datastore include:

  • Creating a filtered dataset as raw data for a research project.
  • Producing a bespoke dataset that can be regularly imported into a database powering a web app.

The Datastore is designed to facilitate one-off or repeating data transfers covering a large part of the 360Giving data corpus.

Get in touch on labs@threesixtygiving.org if you are interested in using the 360Giving Datastore.

GrantNav Data

GrantNav is a web tool developed by 360Giving which provides a search interface for grants data published to the 360Giving Data Standard.

The 360Giving Datastore offers the best route for bulk access to 360Giving data. However, GrantNav offers access to the entire GrantNav data set as CSV or JSON (links will download large files):

The whole data set is several hundred MB and growing, so we recommend that you store the data locally for your own application to work from. The data is updated daily from the 360Giving Datastore. A list of all data sets and the date on which they were last updated is maintained on GrantNav.

Please note that while this file contains all of the publisher’s data in one tabular or JSON format, not all 360Giving data is necessarily included.  Any files that fail validation, or aren’t available under a suitably open license (ie, one that permits re-use for any purpose) isn’t included. This means that all data in GrantNav is valid against the 360Giving Data Standard, and is available for re-use for any purpose.

In addition, this dataset DOES NOT contain all of the original fields that were published by the publisher. It contains only the fields that are relevant to GrantNav’s work. If you want to look at the original data, please download them from the Data Registry. You can also find out more about what is included in the export files.

The data set also contains augmented data that is not present in the original data set – for example, additional location data such as ‘ward’ and ‘region’ are added to grant records in order to enable some of GrantNav’s filtering options to work. See the Data used in GrantNav page for a full reference of all the data used in creating GrantNav, and the license under which the GrantNav data can be used. You must attribute GrantNav if you use the data.

Downloading Data in bulk

datagetter is a python application which downloads all of the data that is listed in the registry, and converts it to JSON for use in an application. You can also use the GrantNav data extract, detailed above.

360Giving Data Quality Tool

The 360Giving Data Quality tool allows you to upload, paste or provide a link to data in the 360Giving Data Standard format, and this application will convert between JSON, Excel and CSV formats, allowing you to download the original file, and the converted versions. The tool inspects key information from the data so you can check if data is valid against the 360Giving Data Standard schema and also receive feedback on aspects of data quality.

The Data Quality tool works with Flatten-Tool, which converts single or multi-sheet spreadsheets to a JSON document and back again, allowing a dataset to be round-tripped between structured JSON and tabular data packages or spreadsheets: providing a bridge between richly structured datasets and accessible flat formats.

360Insights data

The 360Insights tool produces aggregate data based on a 360Giving file, which can either be loaded from the Data Registry or manually uploaded. This data is augmented with information about recipient organisations from Find That Charity as well as location information from Find That Postcode.

Once a file has been loaded onto 360Insights the amended file with additional information on organisations and locations can be downloaded in Excel or CSV format for further analysis.

Licence

Creative Commons License

All JSON feeds linked from this page are licensed under a Creative Commons Attribution 4.0 International License.

Organisations publishing data to the 360Giving Data Standard may use the 360Giving Publisher Badges provided by 360Giving to tell the world that they publish open grants data and are part of the open grants movement. Non publishers referring to or using 360Giving data may not use the 360Giving logo or 360Giving Publisher Badges without permission.

Contributing to 360Giving software

360Giving has several open source applications, available at github.com/threesixtygiving. You are more than welcome to send feedback, comments and pull requests to any of them.

Guidance is available on how to contribute to our GitHub repositories, you can also get in touch with us directly if you have any questions.

GrantNav is open source software developed by Open Data Services for 360Giving. You can find the source code for GrantNav on GitHub.

360Insights is open source software developed by David Kane and 360Giving. You can find the source code for 360Insights on GitHub.

All other software used and developed by 360Giving is available through the 360Giving GitHub organisation.

Contact us

If you’re developing an application that uses 360Giving data, we’d love to hear from you – email us at labs@threesixtygiving.org.

Glossary

360Giving Standard

A data standard developed to help organisations share data about grants they have made.

360Giving (organisation)

360Giving supports organisations to publish their grants data in an open, standardised way and helps people to understand and use the data in order to support decision-making and learning across the charitable giving sector. 360Giving is a company limited by guarantee (company number 09668396) and a registered charity (charity number 1164883).

Data registry

A list of all files made available by data publishers. The Data Registry only includes files that are valid 360Giving data with an appropriate open license that the 360Giving team have been made aware of.

GrantNav

A web tool developed by 360Giving which provides a search interface for grants data published to the 360Giving standard.

360Insights

A web tool developed by 360Giving which gives an aggregate picture on the information available in a 360Giving standard format file.

Metadata

Information about the published data that is added by 360Giving or included by publishers in the files. Metadata could include the file size or format, or aggregate information such as the number of grants included in a file.

Publisher

A grant making organisation which has published grants data which meets the 360Giving standard.