Developer

The MK Data Hub is a shared infrastructure for obtaining, managing and sharing data from many different sources, addressing many different domains and use cases. As a data infrastructure, a key principle of the MK Data Hub is that it provides resources for developers to create applications starting from APIs to access data, for different types of datasets.

Access to data

Different data sources are accessible through different mechanisms and APIs. The Data Catalogue first provides basic search and metadata for each of the datasets, including links to the relevant APIs, as well information about the policies that apply (data licences). Whichever is the method to access the data, any use of the Data Hub is subject to the Terms of Use of the MK Data Hub Portal.

Stream Data Sources: Feed API

Streaming data ingested using the Stream Data Source API can be accessed as a feed, which can be made of multiple streams. Such datasets are mostly used for time series corresponding to sensor values, but can also represent events or other time-related data values. Video tutorials on various subjects related to using the Feed API are available.

See also the documentation page: Feed API.

Custom Stream Data Sources: Read API

Streaming data can also be ingested with a free JSON structure through the Custom Stream Data Source API, and read using the related Read API.

See the documentation page: Custom Stream API.

File data sources

File datasets are accessible directly from the data catalogue, which provides direct access to the files.

Entity API

Some datasets provide access through the Entity API. This API integrates data from multiple data sources (i.e. multiple datasets from the catalogue) around entities. Entities might be for example places (wards, estates, postcodes), organisation (schools, restaurants) or other kinds of objects (images, roundabouts). Therefore, the API can be used simply by accessing the URI that represents the entity. To better understand and try the Entity API, the Entity Lookup facility provides a simple way to retreive entities of different types.

Geospatial data

Finally, several datasets will soon be made available that will provide geospatial data (maps and features) through standard OGC services.

Pushing and sharing data

You might choose to share data through the MK Data Hub to make them available to others, or privately, in order to benefit from the infrastructure of the Data Hub and from the ability to integrate your data with other data sources, and make them available in a homogeneous way to other datasets. Any creation of new data sources and uploading of data to the MK Data Hub is subject to the MK Data Hub Terms and Conditions for Data Providers.

Stream Data Sources: Feed API

You can create a new data feed using the New Stream Data source facility. This will enable creating the streams and the endpoints to upload/push data to the Feed Writing API.

Custom Stream Data Sources: Write API

Streaming data can also be ingested with a free JSON structure through the Custom Stream Data Source API. You can create a new data Custom Stream Data Source using the New Custom Stream Data source facility.

See the documentation page: Custom Stream API.

File data sources

File data sources or data from external APIs can be simply provided by attaching them to the catalogue entry created through the New File Data Source facility.

Entity API

The API for uploading and updating data for the Entity API is currently in development. However, you might want to share data as a file or a link to an external API as mentioned above, and we will look into integrating them through the Entity API.

Geospatial data

Currently, you can share geospatial data through using the New File Data Source facility and providing a link to an OGC service.

Development support

If you are a local SME or student with a need for a data-intensive application or with an idea about the way you could use the MK Data Hub, we might be able to help you by providing development resources, including a “development sandbox” from our private cloud facility. Please contact us using datahub-support@mksmart.org to discuss available opportunities, and check the range of services available for business support.