Researchprojects

BAB 012/05: Structuring and management of the data pool

Initial situation

The work on facilitating access to and use of the INVEKOS data has so far been carried out mainly by Department II/1 of the BMLRT. The current scope of the data offered is documented in the form of a description of the tables available in the respective year and their contents. Regular evaluations from the data pool are carried out, inter alia, for the preparation of the Green Report of the BMLRT, for the evaluation of the Austrian Rural Development Programme, for the preparation of the Economic Accounts for Agriculture and for the servicing of research projects. A new query and evaluation system for the retrieval of anonymised individual farm accountancy data was developed and presented to the BMLRT. It is used to provide data for research purposes.

Objective

In the environment of the BMLRT or on its behalf numerous surveys and data evaluations are carried out, which regularly (annually, monthly, weekly) provide certain data sets. These include, among others, the agricultural structure surveys, surveys of cultivated areas, stocks, producer prices, the agricultural accounts and foreign trade statistics of Statistics Austria, IN-VEKOS and subsidy data of the AMA, accounting data of the LBG, GIS data of Department II/4 of the BMLRT or farm and land registers of the LFRZ. In addition, the BMLRT has extensive databases on groundwater quality, biodiversity and forestry. Between some of these data sources there are links and connections, with which it is possible to carry out concrete evaluations for a combination of data from several sources.
The aim of this project is to develop an overview of the different surveys and data sources and their content, to identify discrepancies between the data stock and the data needs and to establish compatibility between the available data stocks. All data available to the Federal Institute of Agricultural Economics and Mining Research (BAB) and the department are to be combined and made quickly and easily accessible via interfaces, while fully respecting data protection and data security.
In addition, monthly and annual data on the development of issues and markets relevant to agriculture are to be made available on the homepage of the Federal Institute of Agricultural Economics and Mining Research in up-to-date form.

Work 2021

- Training on the use of geographical data for BAB staff in QGIS
- Training on the use of data in the data pool for staff members of the BAB.

The following work is also planned for 2022:
- Programming of further evaluations for the table section of the Green Report
- Ongoing improvements and error corrections in the newly programmed ALFIS
- BAB internal testing of the new BAB ALFIS and the newly programmed graphical user interface (GUI)
- Extension of predefined evaluation options and reports of data from the foreign trade database. This makes sense, as it enables users to carry out periodic evaluations very quickly.
- Programming of a new tool for querying foreign trade data
- Revision of the hierarchical ALFIS structure, reprogramming of the existing ALFIS scripts for the new BAB-ALFIS and extension of the code for the creation of forecast data for IDB and test runs.
- The description blocks (meta information) of the ALFIS characteristics are revised and adapted to the requirements
- Incorporation, conversion and updating of further data  
- Updating the municipal database (GeDaBa) and incorporating new features
- Conception of an extension of the use of the PostGIS database
- Conception of further possibilities of use of the georeferenced aerial photographs together with the LFRZ
- Intersection of agricultural data with GIS data
- Programming of a new address database, which will then be kept evident by Dept. II/1
- Development of a project together with Dept. I/3 (protective water management) regarding flood data. In 2019, the AOD has already been tested for Department I/3. Since January 2020, the database has been replicated in real time to the AOD and enables Department I/3 to carry out internal evaluations. Operation will continue in 2022.
- Development of a data exchange concept with the Central Hydrographic Office.  The Callisto water level database has been in live operation at the BAB since 1 June 2021. It is being examined whether this data can also be implemented in the OpenDataCube. The water levels are interesting parameters for drought/precipitation monitoring.
- Organisation and technical implementation of the data transfer from the AMA from the beginning of 2022, after the AMA has ended all data flows and processing via the LFRZ and transferred them to the AMA's own system. In addition to these tasks, the LFRZ also provided the AMA with evaluation tools for exporting the data and automatic transfer to ALFIS. With the Market Transpa-rency Regulation, the data to be collected will be expanded and newly regulated. At the moment it is not yet known which data and in which structure the data will be provided by the AMA. In order to be able to continue all previous evaluations and the maintenance of the existing ALFIS characteristics, processes and calculations must be reprogrammed.
- Development of data structures and an interface for the transfer of auction data from the Central Association of Austrian Cattle Breeders (ZAR) as well as evaluations and automatic data transfer to the ALFIS database. This is necessary because the BMLRT is discontinuing the services it has provided up to now regarding the price reports for the marketing of breeding cattle and will transfer this task to the ZAR. Routine operation is to start at the end of 2022.
- Further development of the data pool
- Node-based concept, load-distributed queries
- Merging PostgreSQL and PostGIS onto one platform
- Kubernetes/Container
- GPU acceleration, machine learning and deep learning integration using TensorFlow and PyTorch.
- Direct access with R via PivotalR
- Jupyter Notebook Integration
- Development of web-based evaluation tools
o PgAdmin webbased install
o Test of gethue.com -> Integration of S3 and DB queries
o Jupyiter HUB
o R-Studio Docker Container web interface
- Merge the new web interfaces (jupyter hub) with the existing ones from the O-penDataCube.
- Secure all web interfaces with Active Directory or SingleSignOn and manage rights, directly accessible via intranet (also from BMLRT)
- Training on the use of geographic data for staff of the BAB in QGIS
- Training on the use of data in the data pool for staff members of the BAB.  
In 2022, the special evaluations for the area of compensatory allowances for disadvantaged areas (AZ) will be continued and the results analysed.

Work 2022


The area classifications (agricultural production areas, agricultural locations, alpine pasture regions) created annually by the FADN, as well as evaluations based on them, must be adapted to the new area status, as they are every year. The geodata of the area delineations must be harmonised in accordance with the INSPIRE Directive and made available via the national and European INSPIRE portal. Various regional evaluations and map representations must be prepared. The data published on the BAB homepage, including the Green Report Tables, comprises a total of more than 460 monthly and annual tables, some of which are also available in English. At the turn of the year, the annual adjustments of the monthly and annual tables are to be carried out. At the request of Division II/6, an abridged version (relating only to the livestock and meat sector) is prepared monthly via the online service. The tables of the Green Report, which are to be updated annually, including the evaluation results of the LBG accountancy holdings, are also published on the BAB website.
In 2022, the strategic orientation and further development of the data pool, which is subject to great dynamism in terms of its design and implementation due to ongoing technical innovations, will be further advanced and implemented.
Continuation of the restructuring and consolidation of all data available both in the BAB and in the BMLRT.

This text has been automatically translated with www.DeepL.com/Translator.

Project Leader

Team

GAHLEITNER, Gerhard

DI Gerhard GAHLEITNER

Agricultural Economics and Data Management
HAMBRUSCH, Josef

DI Dipl.-Päd. Ing. Josef HAMBRUSCH

Agricultural Economics and Data Management
MARIA, Richard

B.Sc. Richard MARIA

Agricultural Economics and Data Management
SCHROLL, Karin

DI.in Karin SCHROLL

Mountain Areas Research and Regional Development
SKIDMORE, Thomas

B.Sc. Thomas SKIDMORE

Agricultural Economics and Data Management
STICKLER, Yvonne

DI.in Dr.in Yvonne STICKLER

Agricultural, Environmental and Food Systems
TRIBL, Christoph

DI Dr. Christoph TRIBL

Agricultural, Environmental and Food Systems
WAGNER, Klaus

DI Klaus WAGNER

Mountain Areas Research and Regional Development
laufend
Dietrichgasse 27
1030 Wien
 +43 (1) 71100 - 637415

© 2022 bab.gv.at. all rights reserved