Polygon | reading and writing gpc files

A user pointed me to a problem when reading and writing gpc files. GPC understands two kinds of files, with or without hole-flags. Polygon supports both formats, but this was not yet documented. When using the Polygon() constructor with a filename or the read() or write() methods you may specify an optional  second boolean argument. It defaults to True (with hole-flags), with False you may read and write the old-style formats without hole-flags.

Caution: the file format will not be checked automatically! When using the wrong settings the coordinates read from file may be incorrect!

The next release of Polygon will contain updated documentation and a function to manually check the format of a gpc file.

Accessing external data from Modelica with ncDataReader2

This example demonstrates the use of the library ncDataReader2 to access data sets from Modelica in a way suitable for the simulation system. The access is handled via external functions from Modelica which read and interpolate the data stored in netCDF files.

Dymola is used as the simulation system here. As ncDataReader2 is a simple, platform-independant  library implemented in ANSI-C this approach should work (in theory) with other Modelica implementations too. As soon as I have tested other simulation systems the results will be documented here.

Why?

When working with complex models you often have to access external data. This may be measured time rows of climate parameters or friction factors for different plant components. Some advantages of using ncDataReader2 in such situations:

  • data is presented as continous functions of one or two variables with automatic interpolation
  • can handle very large data sets that will not even fit into memory at once (load on demand)
  • offers different interpolation and extrapolation methods
  • data is stored in netCDF format which offers very efficient access to multi-dimensional data
  • data files can be easily exchanged without changing or recompiling your model
  • data files can contain many different data sets (scalar, 1D, 2D) at the same time
  • when you store interrelated data sets in one file, the chance of accidently mixing inconsistent data is minimized

A typical use is reading weather files into a thermal building simulation. The weather files contain different climate parameters like air temperature and humidity, radiation, wind speed as time rows for one year as well as latitude, longitude and the timezone for one location. You can easily exchange the data file and simulate the building in a totally different location without touching the model. ncDataReader2 is used in the Modelica library FluidFlow.

Prerequisites

If you don't already have Dymola installed, you can download a demo version here. It has some restrictions but will work with the simple model used in this example.

The simple model

The following model is used as a starting point for our example. The equation for t will be exchanged with a function call in the next steps. x is just a dummy to have something to integrate.

http://download.j-raedler.de/Modelica/ncDataReader2/NcTest1.mo

Installing ncDataReader2

There is no special installation procedure. Just put the necessary header and library files into the working directory (usually where you saved the model file). Which files are actually needed depends on the Dymola version and the compiler (gcc, msvc). The easiest way is to extract the whole contents of precompiled binary package (Win32 zip) into the working directory. It includes everything needed by Dymola and the executables ncgen and ncdump which are used in the next step. If you compile ncDataReader by yourself, you should at least copy ncDataReaderEA.h and the netCDF and ncDataReader2 library files (dll and/or lib).

Defining Modelica functions

The  next file makes the C functions of the library ncDataReader2 available in Modelica. It contains descriptions of the most important functions of the library (actually of the easy api / EA) that can be read by Modelica. Just put it in the working directory.

http://download.j-raedler.de/Modelica/ncDataReader2/NcDataReader2.mo

Generating the data file in netCDF format

The data must be stored in file in netCDF format. There are many different ways to convert data to this format. My favourite way is a python script that uses one of the netCDF-modules.

But in this example we will write a CDL text file and convert it to netCDF. This step does not require additional software. Use the command:

ncgen -o datafile.nc datafile.cdl

to convert the following file or download the example file here. ncgen is usually shipped with netCDF.

http://download.j-raedler.de/Modelica/ncDataReader2/datafile.cdl

This file contains the two variables time and temperature . The temperature will be interpolated with cubic Akima splines and time will be handled periodically. A netCDF file can be converted back to a CDL file with ncdump.

Adjust the model and simulate

The variable t as a function of time will now contain values from the file instead of the functions used above. An import statement is necessary to use the functions from the library. The call to NcEasyGet1D will return a value of the variable temperature in the file datafile.nc for the current value of the variable time.

http://download.j-raedler.de/Modelica/ncDataReader2/NcTest2.mo

That's it! Just run the simulation and look at the results.

The temperature is read and interpolated from the file. It can be used as a normal variable in models.

Hints

This was only a very basic example. Of course you can read and interpolate a large number of variables using different methods of interpolation and extrapolation. Scalar parameters can be read as well. Please have a look at the documentation of ncDataReader2 for more information on the naming conventions, attributes and more.

The conversion of data to the netCDF formats looks confusing to the beginner but is not hard to understand. A typical CSV file can usually be converted with a couple of lines of Python code which is my favourite method.

ncDataReader2 works both with netCDF-3 and netCDF-4, but you should not mix the tools and libraries between both versions.

Making Windows work – free software essentials

Although working mostly with linux  I need to install or to use a MS Windows machine from time to time. Being spoiled by the large amount of software available for linux I really miss a lot of functionality on a "naked" windows computer. After the installation and update process of windows I usually install a bunch of packages which are open source or at least free (as in beer). Here's the list of my favourites. It's not meant as a complete list for typical users but more as a reminder for myself.

Office / Productivity / Multimedia

Programming / Math

  • python(x,y) - scientific python distribution with lots of additional packages
  • processing - programming language for graphical applications and sketches
  • TortoiseSVN - client for version control with svn
  • Scite - text editor for programmers (shipped with python(x,y))
  • gnuplot - plotter for data sets and functions (shipped with python(x,y))

Tools