Technical users and the 360Giving Datastore

Find out how developers, researchers and others can use 360Giving data

Technical users and the 360Giving Datastore

This page is designed to help developers, data analysts and other technical users access and use grants data published using the 360Giving Data Standard.

360Giving Data Standard

The 360Giving Data Standard is a specification for sharing grants data. The Standard is applicable to two formats: tabular data (spreadsheets) and JSON. The JSON version is the canonical Data Standard, but the Standard operates the same across both formats.

Organisations publish data about grants they have made using this Standard. They can choose the file format they publish, either in Spreadsheets using Excel, CSV, OpenDocument Spreadsheet or using JSON.

The Standard is maintained on Github, based on decisions made by the Standard Stewardship Committee.

Data registry

In order to help grantmakers, developers and analysts discover and use 360Giving data, 360Giving maintains a register of data at data.threesixtygiving.org. The Data Registry contains a list of the data known to have been published using the 360Giving Data Standard (that is both valid and licensed as open data), along with details of who has published it. All the files on the register should conform to the 360Giving Data Standard.

The majority of publishers (more than 90%) publish their data in Spreadsheet format – mostly using Excel. You can download files directly from the Registry if you wish to use them in their original format.

Registry feed

A JSON feed of files published using 360Giving the Data Standard is available at data.threesixtygiving.org/data.json. This file is updated daily and includes current publishers that have notified 360Giving that they have published data. The JSON is an array of objects in the following format (based on DCAT):

JSON

[

  {

     “title”:”Title of the dataset”,

     “description”:”Description about the dataset”,

     “identifier”:”An internal identifier for this dataset from our

                  storage system”,

     “license”:”A link to the license information for this dataset.

                  Should be a valid URL”,

     “license_name”:”A human readable title of the license given in

                      the license field”,

     “issued”:”The date (YYYY-MM-DD) this dataset was first

                        recorded as published”,

     “modified”:”The datetime that this record was last changed.

                       The change could relate to any of the metadata

                       about the dataset”,

     “publisher”: {

        “name”:”Name of the organisation publishing this dataset”,

        “website”:”Should be a valid URL to a website of that publisher”,

        “logo”:”Should be a valid URL to a logo for that publisher.

                You may not necessarily have permission to use this

                logo for your own purposes.”,

        “prefix”:”The unique 360Giving prefix used by this publisher

                  to identify the grants they publish.”

     },

     “distribution”:[ {

        “downloadURL”:”A valid URL to directly access the data”,

        “accessURL”: “A valid URL, usually to a web page, where access

                      to the downloadURL can be found. The web page

                      usually has other useful information about the data”,

        “title”:”Title of the dataset”}

     ]

  },

]

Metadata feed

360Giving provides a JSON feed that contains metadata about files in the Registry, including file statistics (such as size, location, validity against the Standard), aggregate statistics (including total grants, values, and dates) and useful insights (including organisation identifier schemes used).

A coverage JSON report is also available, which contains the contents of status.json plus coverage reports on field usage for each dataset.

Additionally, a CSV report is available, which contains a subset of the fields available in the JSON feed, focussed on the aggregate statistics.

Using the data

We recommend booking a free 1-1 Data Support call where we can support you to understand how to use the data, and how the 360Giving dataset can help to answer your questions or develop your understanding of how to tackle a data project.

Use data from publishers

Most 360Giving Data Standard data files are published in XLSX format, with a small number published as CSV and OpenDocument Spreadsheet or JSON data. The Data Registry provides separate download links for each file in its original file format.

When handling multiple files, you’ll need to bear in mind that not all files will contain the same columns. As well as the required fields that all valid data must include and any optional fields from the Standard, publishers have flexibility to include additional non-standard fields based on their needs. So when merging multiple files together you’ll need to ensure you account for each file having different columns in a different order.

360Giving Datastore

The 360Giving Datastore offers a convenient way for developers, researchers and others to access grants data published using the 360Giving Data Standard. 

The Datastore is updated every night by fetching data from every file on the 360Giving Data Registry. GrantNav and 360Insights are then updated based on this latest data.

For users with more complex data needs or with specific technical skills, it is possible to directly access the Datastore and run queries on it. Potential uses of the Datastore include:

  • Creating a filtered dataset as raw data for a research project.
  • Producing a bespoke dataset that can be regularly imported into a database powering a web app.

The Datastore is designed to facilitate one-off or repeating data transfers covering a large part of the 360Giving data corpus.

You can read more detailed information about the Datastore – including the Datastore access request form and code of conduct which you must agree to to gain access.

GrantNav data

GrantNav is a web tool developed by 360Giving which provides a search interface for grants data published using the 360Giving Data Standard.

The 360Giving Datastore offers the best route for bulk access to 360Giving data. However, GrantNav offers access to the entire GrantNav dataset as CSV or JSON (links will download large files):

The whole dataset is several hundred MB and growing, so we recommend that you store the data locally for your own application to work from. The data is updated daily from the 360Giving Datastore. A list of all datasets and the date on which they were last updated is maintained on GrantNav.

Please note that while this file contains all of the publishers’ data in one tabular or JSON format, not all 360Giving data is necessarily included. Any files that fail validation, or aren’t available under a suitably open licence (ie, one that permits re-use for any purpose) aren’t included. This means that all data in GrantNav is valid against the 360Giving Data Standard, and is available for re-use for any purpose.

In addition, this dataset does not contain all of the original fields that were published by the publisher. It contains only the fields that are relevant to GrantNav’s work. If you want to look at the original data, please download the files you are interested in from the Data Registry. You can also find out more about what is included in the export files.

The dataset also contains augmented or enriched data that is not present in the original dataset – for example, additional location data such as ‘ward’ and ‘region’ are added to grant records in order to enable some of GrantNav’s filtering options to work. See the ‘Data used in GrantNav’ page for a full reference of all the data used in creating GrantNav, and the licence under which the GrantNav data can be used. You must attribute GrantNav if you use the data, see our guidance on how to do this.

Downloading data in bulk

Datagetter is a python application which downloads all of the data that is listed in the Registry, and converts it to JSON for use in an application. You can also use the GrantNav data extract, detailed above.

360Giving Data Quality Tool

The 360Giving Data Quality Tool allows you to upload, paste or provide a link to data in the 360Giving Data Standard format, and this application will convert between JSON, Excel and CSV formats, allowing you to download the original file (and the converted versions). The Tool inspects key information from the data so you can check if data is valid against the 360Giving Data Standard schema and also receive feedback on aspects of data quality.

The Data Quality Tool works with Flatten-Tool, which converts single or multi-sheet spreadsheets to a JSON document and back again, allowing a dataset to be round-tripped between structured JSON and tabular data packages or spreadsheets: providing a bridge between richly structured datasets and accessible flat formats.

360Insights data

The 360Insights tool produces aggregate data based on a selection of 360Giving data, or the whole dataset if no filters are set. This data is augmented with information about recipient organisations from Find That Charity as well as location information from Find That Postcode.

Once a selection has been made in 360Insights, some results can be opened in GrantNav and  downloaded in Excel or CSV format for further analysis.

Data Quality Dashboard

The Quality Dashboard tool produces aggregate data based on the 360Giving dataset as a whole, and by Publisher of the data, about features of the data such as the use of geocodes, organisation identifiers and programme names.

License

All JSON feeds linked from this page are licensed under a Creative Commons Attribution 4.0 International License.

Organisations publishing data using the 360Giving Data Standard may use the 360Giving publisher badges provided by 360Giving to tell the world that they publish open grants data and are part of the open grants movement. Non-publishers referring to or using 360Giving data may not use the 360Giving logo or 360Giving publisher badges without permission. More information about publisher badges can be found in the After you’ve published section of our website. 

Contributing to 360Giving software

360Giving has several open source applications, available at github.com/threesixtygiving. You are more than welcome to send feedback, comments and pull requests to any of them.

Guidance is available on how to contribute to our GitHub repositories, you can also get in touch with us directly if you have any questions.

GrantNav is open source software developed by Open Data Services for 360Giving. You can find the source code for GrantNav on GitHub.

360Insights is open source software developed by David Kane and 360Giving. You can find the source code for 360Insights on GitHub.

All other software used and developed by 360Giving is available through the 360Giving GitHub organisation.

Contact us

If you’re developing an application that uses 360Giving data, we’d love to hear from you – email us at labs@threesixtygiving.org

Glossary

360Giving Data StandardA data standard developed to help organisations share open data about grants they have made.

360Giving (organisation)360Giving supports funders to publish their data using the 360Giving Data Standard. This enables them to share information on who, where and what they fund in a way that others can access and use for free. 360Giving is a company limited by guarantee (company number 09668396) and a registered charity (charity number 1164883).

Data RegistryA list of all files made available by data publishers. The Data Registry only includes files that are valid 360Giving data with an appropriate open licence that the 360Giving team have been made aware of.

GrantNavA free web tool developed by 360Giving which provides a search engine  for grants data published using  the 360Giving standard.

360InsightsA free web tool developed by 360Giving which gives an aggregate picture on the information available in a 360Giving Standard format file.

Metadata – Information about the published data that is added by 360Giving or included by publishers in the files. Metadata could include the file size or format, or aggregate information such as the number of grants included in a file.

Publisher – A grantmaking organisation which has published grants data using the 360Giving Data Standard.