Domain decomposition

Domain decomposition is used for saving computer memory by spatially dividing large burnup calculation problems between multiple calculation nodes. Each node handles particle transport only within its own domain, and particles crossing the domain boundaries are sent to another node to complete the history. The implementation in Serpent relies on a collision-based approach, i.e. the transfer is invoked when the particle undergoes a collision in a material which belongs to another domain. The decomposition affects only burnable materials divided into depletion zones using the div card. The most typical domain decomposition case is a full-core burnup calculation, in which the fuel is decomposed into separate domains to save memory. Interaction data for the other materials is shared by all parallel tasks.

The current implementation in Serpent 2 is relatively simple, and mainly designed for reactor cores. The number of domains is determined by the number of MPI tasks, and the division using the set dd input option. There are three division types:

1. simple, based on depletion zone index
2. geometry-based division into sectors
3. geometry-based division into sectors and a central zone

The method is illustrated by a full-core example, where the depletion zone division and domain decomposition is defined by input lines:

% --- Domain decomposition -----------------------------------------------------

% --- Divide fuel into depletion zones:

div fuel sep 1

% -- Domain decomposition (1 = simple, 2 = sector, 3 = sector + center)

set dd 3

% ------------------------------------------------------------------------------

When the calculation is run with 5 MPI tasks, it produces the following output:

sss2 -mpi 5 core

(...)

ividing materials into depletion zones...

Material fuel:

 - 63624 cells
 - 63624 depletion zones in total

Sorting lists (this may take a while)...
OK.

Counting cells...
OK.

Decomposing 63624 divided materials into 5 domains:

Domain 1: 12744 materials (20.0%)
Domain 2: 12720 materials (20.0%)
Domain 3: 12720 materials (20.0%)
Domain 4: 12720 materials (20.0%)
Domain 5: 12720 materials (20.0%)

(...)

and a geometry plot that shows the domains in different colors:

Changing the mode to 2 (sector-wise division) produces:

and the simple index-based division:

The methodology was implemented in version 2.1.31, and is still under development. Any bugs or problems should be reported at the Serpent discussion forum.