Skip to main content

Tutorial: Analyzing Revenue Increases Using Parquet Files and DuckDB SQL

Context

FME has recently introduced DuckDB through SQLExecutor and a Reader in the latest betas. This tutorial will guide you through using SQLExecutor to run complex and dynamic queries efficiently. We will analyze Finnish public revenues, identifying the biggest year-to-year increase in proportion for each revenue source using FME and DuckDB.

What to learn?

  • Creating temporary folders
  • Merging features
  • Writing data to Parquet files
  • Executing complex SQL queries
  • Pivoting and filtering data

Source Data

127f — Verot ja veronluonteiset maksut, vuosittain, 1975-2023

Extract of the data

Extract of the data: Each tax or revenue stream has a line with a column for each year from 1975 to 2023.
Step-by-Step Guide
Part 1 : Data preparation

Extract of the data: Each tax or revenue stream has a line with a column for each year from 1975 to 2023.

Step-by-Step Guide
Part 1 : Data preparation