You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
hello-algo/en/docs/chapter_backtracking/permutations_problem.md

18 KiB

comments
true

13.2   Permutation problem

The permutation problem is a typical application of the backtracking algorithm. It is defined as finding all possible arrangements of elements from a given set (such as an array or string).

Table 13-2 lists several example data, including the input arrays and their corresponding permutations.

Table 13-2   Permutation examples

Input array Permutations
[1] [1]
[1, 2] [1, 2], [2, 1]
[1, 2, 3] [1, 2, 3], [1, 3, 2], [2, 1, 3], [2, 3, 1], [3, 1, 2], [3, 2, 1]

13.2.1   Cases without equal elements

!!! question

Enter an integer array without duplicate elements and return all possible permutations.

From the perspective of the backtracking algorithm, we can imagine the process of generating permutations as a series of choices. Suppose the input array is [1, 2, 3], if we first choose 1, then 3, and finally 2, we obtain the permutation [1, 3, 2]. Backtracking means undoing a choice and then continuing to try other choices.

From the code perspective, the candidate set choices contains all elements of the input array, and the state state contains elements that have been selected so far. Please note that each element can only be chosen once, thus all elements in state must be unique.

As shown in Figure 13-5, we can unfold the search process into a recursive tree, where each node represents the current state state. Starting from the root node, after three rounds of choices, we reach the leaf nodes, each corresponding to a permutation.

Permutation recursive tree{ class="animation-figure" }

Figure 13-5   Permutation recursive tree

1.   Pruning of repeated choices

To ensure that each element is selected only once, we consider introducing a boolean array selected, where selected[i] indicates whether choices[i] has been selected. We base our pruning operations on this array:

  • After making the choice choice[i], we set selected[i] to \text{True}, indicating it has been chosen.
  • When iterating through the choice list choices, skip all nodes that have already been selected, i.e., prune.

As shown in Figure 13-6, suppose we choose 1 in the first round, 3 in the second round, and 2 in the third round, we need to prune the branch of element 1 in the second round and elements 1 and 3 in the third round.

Permutation pruning example{ class="animation-figure" }

Figure 13-6   Permutation pruning example

Observing Figure 13-6, this pruning operation reduces the search space size from O(n^n) to O(n!).

2.   Code implementation

After understanding the above information, we can "fill in the blanks" in the framework code. To shorten the overall code, we do not implement individual functions within the framework code separately, but expand them in the backtrack() function:

=== "Python"

```python title="permutations_i.py"
def backtrack(
    state: list[int], choices: list[int], selected: list[bool], res: list[list[int]]
):
    """Backtracking algorithm: Permutation I"""
    # When the state length equals the number of elements, record the solution
    if len(state) == len(choices):
        res.append(list(state))
        return
    # Traverse all choices
    for i, choice in enumerate(choices):
        # Pruning: do not allow repeated selection of elements
        if not selected[i]:
            # Attempt: make a choice, update the state
            selected[i] = True
            state.append(choice)
            # Proceed to the next round of selection
            backtrack(state, choices, selected, res)
            # Retract: undo the choice, restore to the previous state
            selected[i] = False
            state.pop()

def permutations_i(nums: list[int]) -> list[list[int]]:
    """Permutation I"""
    res = []
    backtrack(state=[], choices=nums, selected=[False] * len(nums), res=res)
    return res
```

=== "C++"

```cpp title="permutations_i.cpp"
/* Backtracking algorithm: Permutation I */
void backtrack(vector<int> &state, const vector<int> &choices, vector<bool> &selected, vector<vector<int>> &res) {
    // When the state length equals the number of elements, record the solution
    if (state.size() == choices.size()) {
        res.push_back(state);
        return;
    }
    // Traverse all choices
    for (int i = 0; i < choices.size(); i++) {
        int choice = choices[i];
        // Pruning: do not allow repeated selection of elements
        if (!selected[i]) {
            // Attempt: make a choice, update the state
            selected[i] = true;
            state.push_back(choice);
            // Proceed to the next round of selection
            backtrack(state, choices, selected, res);
            // Retract: undo the choice, restore to the previous state
            selected[i] = false;
            state.pop_back();
        }
    }
}

/* Permutation I */
vector<vector<int>> permutationsI(vector<int> nums) {
    vector<int> state;
    vector<bool> selected(nums.size(), false);
    vector<vector<int>> res;
    backtrack(state, nums, selected, res);
    return res;
}
```

=== "Java"

```java title="permutations_i.java"
/* Backtracking algorithm: Permutation I */
void backtrack(List<Integer> state, int[] choices, boolean[] selected, List<List<Integer>> res) {
    // When the state length equals the number of elements, record the solution
    if (state.size() == choices.length) {
        res.add(new ArrayList<Integer>(state));
        return;
    }
    // Traverse all choices
    for (int i = 0; i < choices.length; i++) {
        int choice = choices[i];
        // Pruning: do not allow repeated selection of elements
        if (!selected[i]) {
            // Attempt: make a choice, update the state
            selected[i] = true;
            state.add(choice);
            // Proceed to the next round of selection
            backtrack(state, choices, selected, res);
            // Retract: undo the choice, restore to the previous state
            selected[i] = false;
            state.remove(state.size() - 1);
        }
    }
}

/* Permutation I */
List<List<Integer>> permutationsI(int[] nums) {
    List<List<Integer>> res = new ArrayList<List<Integer>>();
    backtrack(new ArrayList<Integer>(), nums, new boolean[nums.length], res);
    return res;
}
```

=== "C#"

```csharp title="permutations_i.cs"
[class]{permutations_i}-[func]{Backtrack}

[class]{permutations_i}-[func]{PermutationsI}
```

=== "Go"

```go title="permutations_i.go"
[class]{}-[func]{backtrackI}

[class]{}-[func]{permutationsI}
```

=== "Swift"

```swift title="permutations_i.swift"
[class]{}-[func]{backtrack}

[class]{}-[func]{permutationsI}
```

=== "JS"

```javascript title="permutations_i.js"
[class]{}-[func]{backtrack}

[class]{}-[func]{permutationsI}
```

=== "TS"

```typescript title="permutations_i.ts"
[class]{}-[func]{backtrack}

[class]{}-[func]{permutationsI}
```

=== "Dart"

```dart title="permutations_i.dart"
[class]{}-[func]{backtrack}

[class]{}-[func]{permutationsI}
```

=== "Rust"

```rust title="permutations_i.rs"
[class]{}-[func]{backtrack}

[class]{}-[func]{permutations_i}
```

=== "C"

```c title="permutations_i.c"
[class]{}-[func]{backtrack}

[class]{}-[func]{permutationsI}
```

=== "Kotlin"

```kotlin title="permutations_i.kt"
[class]{}-[func]{backtrack}

[class]{}-[func]{permutationsI}
```

=== "Ruby"

```ruby title="permutations_i.rb"
[class]{}-[func]{backtrack}

[class]{}-[func]{permutations_i}
```

=== "Zig"

```zig title="permutations_i.zig"
[class]{}-[func]{backtrack}

[class]{}-[func]{permutationsI}
```

13.2.2   Considering cases with equal elements

!!! question

Enter an integer array, **which may contain duplicate elements**, and return all unique permutations.

Suppose the input array is [1, 1, 2]. To differentiate the two duplicate elements 1, we mark the second 1 as \hat{1}.

As shown in Figure 13-7, half of the permutations generated by the above method are duplicates.

Duplicate permutations{ class="animation-figure" }

Figure 13-7   Duplicate permutations

So, how do we eliminate duplicate permutations? Most directly, consider using a hash set to deduplicate permutation results. However, this is not elegant, as branches generating duplicate permutations are unnecessary and should be identified and pruned in advance, which can further improve algorithm efficiency.

1.   Pruning of equal elements

Observing Figure 13-8, in the first round, choosing 1 or \hat{1} results in identical permutations under both choices, thus we should prune \hat{1}.

Similarly, after choosing 2 in the first round, choosing 1 and \hat{1} in the second round also produces duplicate branches, so we should also prune \hat{1} in the second round.

Essentially, our goal is to ensure that multiple equal elements are only selected once in each round of choices.

Duplicate permutations pruning{ class="animation-figure" }

Figure 13-8   Duplicate permutations pruning

2.   Code implementation

Based on the code from the previous problem, we consider initiating a hash set duplicated in each round of choices, used to record elements that have been tried in that round, and prune duplicate elements:

=== "Python"

```python title="permutations_ii.py"
def backtrack(
    state: list[int], choices: list[int], selected: list[bool], res: list[list[int]]
):
    """Backtracking algorithm: Permutation II"""
    # When the state length equals the number of elements, record the solution
    if len(state) == len(choices):
        res.append(list(state))
        return
    # Traverse all choices
    duplicated = set[int]()
    for i, choice in enumerate(choices):
        # Pruning: do not allow repeated selection of elements and do not allow repeated selection of equal elements
        if not selected[i] and choice not in duplicated:
            # Attempt: make a choice, update the state
            duplicated.add(choice)  # Record selected element values
            selected[i] = True
            state.append(choice)
            # Proceed to the next round of selection
            backtrack(state, choices, selected, res)
            # Retract: undo the choice, restore to the previous state
            selected[i] = False
            state.pop()

def permutations_ii(nums: list[int]) -> list[list[int]]:
    """Permutation II"""
    res = []
    backtrack(state=[], choices=nums, selected=[False] * len(nums), res=res)
    return res
```

=== "C++"

```cpp title="permutations_ii.cpp"
/* Backtracking algorithm: Permutation II */
void backtrack(vector<int> &state, const vector<int> &choices, vector<bool> &selected, vector<vector<int>> &res) {
    // When the state length equals the number of elements, record the solution
    if (state.size() == choices.size()) {
        res.push_back(state);
        return;
    }
    // Traverse all choices
    unordered_set<int> duplicated;
    for (int i = 0; i < choices.size(); i++) {
        int choice = choices[i];
        // Pruning: do not allow repeated selection of elements and do not allow repeated selection of equal elements
        if (!selected[i] && duplicated.find(choice) == duplicated.end()) {
            // Attempt: make a choice, update the state
            duplicated.emplace(choice); // Record selected element values
            selected[i] = true;
            state.push_back(choice);
            // Proceed to the next round of selection
            backtrack(state, choices, selected, res);
            // Retract: undo the choice, restore to the previous state
            selected[i] = false;
            state.pop_back();
        }
    }
}

/* Permutation II */
vector<vector<int>> permutationsII(vector<int> nums) {
    vector<int> state;
    vector<bool> selected(nums.size(), false);
    vector<vector<int>> res;
    backtrack(state, nums, selected, res);
    return res;
}
```

=== "Java"

```java title="permutations_ii.java"
/* Backtracking algorithm: Permutation II */
void backtrack(List<Integer> state, int[] choices, boolean[] selected, List<List<Integer>> res) {
    // When the state length equals the number of elements, record the solution
    if (state.size() == choices.length) {
        res.add(new ArrayList<Integer>(state));
        return;
    }
    // Traverse all choices
    Set<Integer> duplicated = new HashSet<Integer>();
    for (int i = 0; i < choices.length; i++) {
        int choice = choices[i];
        // Pruning: do not allow repeated selection of elements and do not allow repeated selection of equal elements
        if (!selected[i] && !duplicated.contains(choice)) {
            // Attempt: make a choice, update the state
            duplicated.add(choice); // Record selected element values
            selected[i] = true;
            state.add(choice);
            // Proceed to the next round of selection
            backtrack(state, choices, selected, res);
            // Retract: undo the choice, restore to the previous state
            selected[i] = false;
            state.remove(state.size() - 1);
        }
    }
}

/* Permutation II */
List<List<Integer>> permutationsII(int[] nums) {
    List<List<Integer>> res = new ArrayList<List<Integer>>();
    backtrack(new ArrayList<Integer>(), nums, new boolean[nums.length], res);
    return res;
}
```

=== "C#"

```csharp title="permutations_ii.cs"
[class]{permutations_ii}-[func]{Backtrack}

[class]{permutations_ii}-[func]{PermutationsII}
```

=== "Go"

```go title="permutations_ii.go"
[class]{}-[func]{backtrackII}

[class]{}-[func]{permutationsII}
```

=== "Swift"

```swift title="permutations_ii.swift"
[class]{}-[func]{backtrack}

[class]{}-[func]{permutationsII}
```

=== "JS"

```javascript title="permutations_ii.js"
[class]{}-[func]{backtrack}

[class]{}-[func]{permutationsII}
```

=== "TS"

```typescript title="permutations_ii.ts"
[class]{}-[func]{backtrack}

[class]{}-[func]{permutationsII}
```

=== "Dart"

```dart title="permutations_ii.dart"
[class]{}-[func]{backtrack}

[class]{}-[func]{permutationsII}
```

=== "Rust"

```rust title="permutations_ii.rs"
[class]{}-[func]{backtrack}

[class]{}-[func]{permutations_ii}
```

=== "C"

```c title="permutations_ii.c"
[class]{}-[func]{backtrack}

[class]{}-[func]{permutationsII}
```

=== "Kotlin"

```kotlin title="permutations_ii.kt"
[class]{}-[func]{backtrack}

[class]{}-[func]{permutationsII}
```

=== "Ruby"

```ruby title="permutations_ii.rb"
[class]{}-[func]{backtrack}

[class]{}-[func]{permutations_ii}
```

=== "Zig"

```zig title="permutations_ii.zig"
[class]{}-[func]{backtrack}

[class]{}-[func]{permutationsII}
```

Assuming all elements are distinct from each other, there are n! (factorial) permutations of n elements; when recording results, it is necessary to copy a list of length n, using O(n) time. Thus, the time complexity is O(n!n).

The maximum recursion depth is n, using O(n) frame space. Selected uses O(n) space. At any one time, there can be up to n duplicated, using O(n^2) space. Therefore, the space complexity is O(n^2).

3.   Comparison of the two pruning methods

Please note, although both selected and duplicated are used for pruning, their targets are different.

  • Repeated choice pruning: There is only one selected throughout the search process. It records which elements are currently in the state, aiming to prevent an element from appearing repeatedly in state.
  • Equal element pruning: Each round of choices (each call to the backtrack function) contains a duplicated. It records which elements have been chosen in the current traversal (for loop), aiming to ensure equal elements are selected only once.

Figure 13-9 shows the scope of the two pruning conditions. Note, each node in the tree represents a choice, and the nodes from the root to the leaf form a permutation.

Scope of the two pruning conditions{ class="animation-figure" }

Figure 13-9   Scope of the two pruning conditions