Domain decomposition

Domain decomposition is used for saving computer memory by spatially dividing large burnup calculation problems between multiple calculation nodes. Each node handles particle transport only within its own domain, and particles crossing the domain boundaries are sent to another node to complete the history. The implementation in Serpent relies on a collision-based approach, i.e. the transfer is invoked when the particle undergoes a collision in a material which belongs to another domain. The decomposition affects only burnable materials divided into depletion zones using the div card. The most typical domain decomposition case is a full-core burnup calculation, in which the fuel is decomposed into separate domains to save memory. Interaction data for the other materials is shared by all parallel tasks.

The current implementation in Serpent 2 is relatively simple, and mainly designed for reactor cores. The number of domains is determined by the number of MPI tasks, and the division using the set dd input option. There are three division types:

1. simple, based on depletion zone index
2. geometry-based division into sectors
3. geometry-based division into sectors and a central zone

The method is illustrated by a full-core example, where the depletion zone division and domain decomposition is defined by input lines:

% --- Domain decomposition -----------------------------------------------------

% --- Divide fuel into depletion zones:

div fuel sep 1

% -- Domain decomposition (1 = simple, 2 = sector, 3 = sector + center)

set dd 3

% ------------------------------------------------------------------------------

When the calculation is run with 5 MPI tasks, it produces the following output:

sss2 -mpi 5 core

(...)

ividing materials into depletion zones...

Material fuel:

 - 63624 cells
 - 63624 depletion zones in total

Sorting lists (this may take a while)...
OK.

Counting cells...
OK.

Decomposing 63624 divided materials into 5 domains:

Domain 1: 12744 materials (20.0%)
Domain 2: 12720 materials (20.0%)
Domain 3: 12720 materials (20.0%)
Domain 4: 12720 materials (20.0%)
Domain 5: 12720 materials (20.0%)

(...)

and a geometry plot that shows the domains in different colors (switching the current setup from MODE 1, to MODE 2, to MODE 3, respectively):

(a) sector-wise division plus central zone (MODE 3), (b) sector-wise division (MODE 2), (c) index-based division (MODE 1).

Notes:

• The methodology was implemented in version 2.1.31, and is still under development. Any bugs or problems should be reported at the Serpent discussion forum.
• The domain decomposition methodology allows the use of the restart capability from Serpent 2.1.32 version and on. The multiple restart files generated within a domain decomposition simulation can be read either in a subsequent domain decomposition simulation, e.g., group-constant generation (matching the number of MPI tasks) or not, e.g., radioactive decay source. From Serpent 2.1.32 version and on, the associated depletion output file in a domain decomposition simulation is not limited to parent materials.