LP ETL Tips & Tricks
LinkedPipes ETL Tips & Tricks Stream compression

Stream compression

alarmJan 26, 2017

Now you can compress files using gzip and bzip2 stream compression. This can be used to produce smaller dumps still loadable directly to e.g. OpenLink Virtuoso.

The team

We are a team of Ph.D. students and researchers from Prague computer science universities. We worked on a number of European and local Linked (Open) Data projects involving hundreds of processed datasets.

The following organizations contributed to the development of LinkedPipes ETL:

  • Faculty of Mathematics and Physics, Charles University
  • Faculty of Informatics and Statistics, University of Economics in Prague
  • Faculty of Information Technology, Czech Technical University in Prague
  • NAKIT - National Agency for Communication and Information Technologies
  • Ministry of the Interior of the Czech Republic
  • Semantica.cz

In addition, the development of LinkedPipes ETL was supported by the following projects:

  • OpenBudgets.eu project. OpenBudgets.eu has received funding from the European Union’s H2020 EU research and innovation programme under grant agreement No 645833.
  • Czech Science Foundation (GAČR), grant number 16-09713S.
  • Wikimedia Foundation Project Grant Wikidata & ETL
Connect
  • GitHub
Brought to you by the LinkedPipes team