4.9. Scalability and Performance:

TM provides support for the key JDBC optimisations such as pre-fetching when reading and batching when writing. By default some pre -fetching when reading is implemented automatically but batching must be requested explicitly. TM can operate batching when writing to multiple tables, and automatically determines the order in which records should be written to avoid constraint violations.

TM has a number of modes of writing data to ensure that duplicates are not created and has knowledge of identifying attributes of the model. Thus it may write data in a ‘find or create’ mode and if an item already exists the item is updated. To enhance performance if data is known not to exist already, an ‘insert’ mode of operation can be invoked. It is also possible to use the same transform statements with a mode of update configuration parameter to allow the same transform definition to be used in an update or bulk load scenario, as required.

SQL Table handlers can also be implemented as plug-ins to the adapters that take control of the reading and writing of one or more tables to enable overriding the standard behaviour of TM.

Using such features , TM is usually able to read or write database data at least as fast as hand written SQL and often much faster.

In addition, TM’s scalable XML feature is able to handle XML files of any size. TM processes XML data as it is being read and determines, based on the transform statements, when XML source instance data is no longer required and all related target data has been constructed. As target data is completed, TM writes the results while still processing the incoming XML data.

THE BENEFITS OF TRANSFORMATION MANAGER