What's new

  • whatshot2017-05-05: Feedback welcome

    Current users please fill out this short usability questionnaire. It should not take you more than 2 minutes. Thank you.

  • whatshot2017-03-15: JSON-LD formatting

    JSON-LD files can now be created out of ordinary JSON files by adding a JSON-LD context using the JSON to JSON-LD component. Output JSON-LD files can be formatted to a Compacted, Flattened or Expanded JSON-LD format using the Format JSON-LD component.

  • whatshot2017-02-20: VoID support

    VoID is now supported for creating metadata via the VoID Dataset component, which can enrich the result of DCAT-AP Distribution so that the DCAT-AP to CKAN loader will create CKAN resources for VoID example resources and VoID SPARQL endpoint properties.

  • whatshot2017-02-19: Breaking change in develop branch

    When updating the develop branch, please see the update notes, there are some directories that need to be cleaned before update.

  • whatshot2017-02-01: Multithreading in XSLT and Virtuoso loader

    XSLT transformations can now run with multiple threads per file and OpenLink Virtuoso loader can tell Virtuoso to load files using multiple threads (one file per thread).

lightbulb_outlineMore Tips & Tricks

Featured component

Pipeline input
Pipeline inputopen_in_browser

Passes files from an HTTP POST pipeline execution request

Pipeline inputclose

Extractor, allows the user to pass files from an HTTP POST pipeline execution request.

extensionMore components

3-minute screencast

Features

view_module

Modular design

Deploy only those components that you actually need. For example, on your pipeline development machine, you need the whole stack, but on your data processing server, you only need the backend part. The data processing options are extensible by components. We have a library of the most basic ones. When you need something special, just copy and modify an existing one.

http

All functionality covered by REST APIs

Our frontend uses the same APIs which is available to everyone. This means that you can build your own frontend, integrate only parts of our app and control everything easily.

share

Almost everything is RDF

Except for our configuration file, everything is in RDF. This includes the ETL pipelines, component configurations and messages indicating the progress of the pipeline. You can generate the pipelines and configurations using SPARQL from your own app. Also, batch modification of configurations is a simple text file operation, no more clicking through every pipeline when migrating.