Public transport data analysis and BI

Summary
The project “Public Transport Data Analysis and BI” was initiated to overcome the challenges in the analysis and evaluation of public transport traffic data. Previous methods were based on Excel and involved complex macros that took several hours to execute. The manual merging of data from different sources and the lack of effective ways to check results not only made data processing difficult, but also limited the accuracy and real-time capability of evaluations. The input data check was also inadequate and limited to manual steps.
Our services
The following solutions were implemented as part of the project:
- Power BI reports for punctuality, trip cancellations and passenger counting: The reports are now generated in minutes instead of days, which enables a timely response to changes.
- Automated and standardized input data checks: This allows errors and inconsistencies in the input data to be detected at an early stage.
- Automated merging of input data in a high-performance ProjectDB: This enables fast data processing and improves the overall efficiency of the system.
- Results verification with reference checks at Power BI Analytics level: Offers a wide range of options for validating results and increases the reliability of data analyses.
Technical implementation
The technical implementation comprised the following steps:
- Data engineering work: All relevant data sources were integrated into an OLAP database (DuckDB). The data was prepared using DBT, which enables efficient and scalable data processing.
- Data Analytics: The previous Excel-based evaluations and macros have been transferred to Power BI, which enables intuitive and powerful visualization and analysis of traffic data.
- Technology Stack: The project relied on modern technologies such as DuckDB, Python, dbt, Power BI, Power Query and DAX to ensure a robust, flexible and scalable solution.