MB-System Unix Manual Page

mbm_multiprocess

Section: MB-System 5.0 (1)
Updated: 3 June 2013
Index

NAME

mbm_multiprocess - Macro to run mbprocess on the swath files referenced by a datalist using parallel processes.

VERSION

Version 5.0

SYNOPSIS

mbm_multiprocess -Idatalist [-Xnprocesses -H -V]

DESCRIPTION

mbm_multiprocess is a macro used to effeciently process large numbers of swath data files by executing parallel instances of the program mbprocess. See the mbprocess manual page for a description of its operation.

The -Xnprocesses option sets the number of parallel processes that can be started by mbm_multiprocess. In general, the most efficient (fastest) execution of the overall command will be achieved when nprocesses equals the number of available CPUs or cores.

AUTHORSHIP

Christian Ferreira

  MARUM, University of Bremen
David W. Caress (caress@mbari.org)

  Monterey Bay Aquarium Research Institute
Dale N. Chayes (dale@ldeo.columbia.edu)

  Lamont-Doherty Earth Observatory

SIMPLE DESCRIPTION OF BASIC OPTIONS

-H: This "help" flag cause the program to print out a description of its operation and then exit immediately.
-I: datalist
Sets the input datalist filename. A datalist is an ascii file containing a list of the input swath sonar data files to be copied and their formats. In the datalist file, each swath data file should be followed by a data format identifier, e.g.:
datafile1 11

datafile2 24

As discussed in the MB-System manual page, datalists may reference other datalists, allowing users to construct recursive datalist structures. This program uses the MBIO library and will read or write any swath sonar format supported by MBIO. A list of the swath sonar data formats currently supported by MBIO and their identifier values is given in the MBIO manual page.
-V: Causes mbm_multiprocess to operate in "verbose" mode so that it outputs more information than usual.
-X: nprocesses
This option sets the number of parallel, simultaneous mbcopy processes that may be run.

EXAMPLES

Suppose one has two format 88 Reson 7125 data files:
        20110805_053612.mb88

        20110805_054149.mb88

and that these files are ready to be processed with mbprocess. In order to execute the processing using multiple, parallel processes, use the macro mbm_multiprocess with a datalist file referencing the target swath files as input:
        mbm_multiprocess -Idatalist.mb-1 -V -X2

The macro prints out the following as the processing proceeds:

Running mbm_multiprocess...

Program <mbprocess>

        Program <mbprocess>

        Version $Id: mbm_multiprocess.1 2096 2013-06-04 08:17:22Z caress $

        Version $Id: mbm_multiprocess.1 2096 2013-06-04 08:17:22Z caress $

        MB-system Version 5.3.1904

        MB-system Version 5.3.1904

Program Operation:

        Program Operation:

          Input file:      20110805_053612.mb88

          Input file:      20110805_054149.mb88

          Format:          88

          Format:          88

          Files processed only if out of date.

          Files processed only if out of date.

          Comments embedded in output.

Comments embedded in output.

        **: Data processed - out of date - unlocked:

                Input:  /Volumes/MappingAUVOps2011/test/20110805_054149.mb88

                Output: /Volumes/MappingAUVOps2011/test/20110805_054149p.mb88

        **: Data processed - out of date - unlocked:

                Input:  /Volumes/MappingAUVOps2011/test/20110805_053612.mb88

                Output: /Volumes/MappingAUVOps2011/test/20110805_053612p.mb88