This example demonstrates the use of the library ncDataReader2 to access data sets from Modelica in a way suitable for the simulation system. The access is handled via external functions from Modelica which read and interpolate the data stored in netCDF files.
Dymola is used as the simulation system here. As ncDataReader2 is a simple, platform-independant library implemented in ANSI-C this approach should work (in theory) with other Modelica implementations too. As soon as I have tested other simulation systems the results will be documented here.
Why?
When working with complex models you often have to access external data. This may be measured time rows of climate parameters or friction factors for different plant components. Some advantages of using ncDataReader2 in such situations:
- data is presented as continous functions of one or two variables with automatic interpolation
- can handle very large data sets that will not even fit into memory at once (load on demand)
- offers different interpolation and extrapolation methods
- data is stored in netCDF format which offers very efficient access to multi-dimensional data
- data files can be easily exchanged without changing or recompiling your model
- data files can contain many different data sets (scalar, 1D, 2D) at the same time
- when you store interrelated data sets in one file, the chance of accidently mixing inconsistent data is minimized
A typical use is reading weather files into a thermal building simulation. The weather files contain different climate parameters like air temperature and humidity, radiation, wind speed as time rows for one year as well as latitude, longitude and the timezone for one location. You can easily exchange the data file and simulate the building in a totally different location without touching the model. ncDataReader2 is used in the Modelica library FluidFlow.
Prerequisites
If you don’t already have Dymola installed, you can download a demo version here. It has some restrictions but will work with the simple model used in this example.
The simple model
The following model is used as a starting point for our example. The equation for t will be exchanged with a function call in the next steps. x is just a dummy to have something to integrate.
http://download.j-raedler.de/Modelica/ncDataReader2/NcTest1.mo
Installing ncDataReader2
There is no special installation procedure. Just put the necessary header and library files into the working directory (usually where you saved the model file). Which files are actually needed depends on the Dymola version and the compiler (gcc, msvc). The easiest way is to extract the whole contents of precompiled binary package (Win32 zip) into the working directory. It includes everything needed by Dymola and the executables ncgen and ncdump which are used in the next step. If you compile ncDataReader by yourself, you should at least copy ncDataReaderEA.h and the netCDF and ncDataReader2 library files (dll and/or lib).
Defining Modelica functions
The next file makes the C functions of the library ncDataReader2 available in Modelica. It contains descriptions of the most important functions of the library (actually of the easy api / EA) that can be read by Modelica. Just put it in the working directory.
http://download.j-raedler.de/Modelica/ncDataReader2/NcDataReader2.mo
Generating the data file in netCDF format
The data must be stored in file in netCDF format. There are many different ways to convert data to this format. My favourite way is a python script that uses one of the netCDF-modules.
But in this example we will write a CDL text file and convert it to netCDF. This step does not require additional software. Use the command:
ncgen -o datafile.nc datafile.cdl
to convert the following file or download the example file here. ncgen is usually shipped with netCDF.
http://download.j-raedler.de/Modelica/ncDataReader2/datafile.cdl
This file contains the two variables time and temperature . The temperature will be interpolated with cubic Akima splines and time will be handled periodically. A netCDF file can be converted back to a CDL file with ncdump.
Adjust the model and simulate
The variable t as a function of time will now contain values from the file instead of the functions used above. An import statement is necessary to use the functions from the library. The call to NcEasyGet1D will return a value of the variable temperature in the file datafile.nc for the current value of the variable time.
http://download.j-raedler.de/Modelica/ncDataReader2/NcTest2.mo
That’s it! Just run the simulation and look at the results.
The temperature is read and interpolated from the file. It can be used as a normal variable in models.
Hints
This was only a very basic example. Of course you can read and interpolate a large number of variables using different methods of interpolation and extrapolation. Scalar parameters can be read as well. Please have a look at the documentation of ncDataReader2 for more information on the naming conventions, attributes and more.
The conversion of data to the netCDF formats looks confusing to the beginner but is not hard to understand. A typical CSV file can usually be converted with a couple of lines of Python code which is my favourite method.
ncDataReader2 works both with netCDF-3 and netCDF-4, but you should not mix the tools and libraries between both versions.
In the meantime I tested ncDataReader2 with Dymola on Linux and OpenModelica on Linux and Windows. With DAP-enabled netcdf libraries you can even fetch data from a server on demand. Next release of ncDataReader2 will contain a complete Modelica function file.