krahets
10 months ago
parent
545e15bc81
commit
84520801e2
File diff suppressed because one or more lines are too long
@ -0,0 +1,886 @@
|
|||||||
|
---
|
||||||
|
comments: true
|
||||||
|
---
|
||||||
|
|
||||||
|
# 6.3 Hash Algorithms
|
||||||
|
|
||||||
|
The previous two sections introduced the working principle of hash tables and the methods to handle hash collisions. However, both open addressing and chaining can **only ensure that the hash table functions normally when collisions occur, but cannot reduce the frequency of hash collisions**.
|
||||||
|
|
||||||
|
If hash collisions occur too frequently, the performance of the hash table will deteriorate drastically. As shown in the Figure 6-8 , for a chaining hash table, in the ideal case, the key-value pairs are evenly distributed across the buckets, achieving optimal query efficiency; in the worst case, all key-value pairs are stored in the same bucket, degrading the time complexity to $O(n)$.
|
||||||
|
|
||||||
|
{ class="animation-figure" }
|
||||||
|
|
||||||
|
<p align="center"> Figure 6-8 Ideal and Worst Cases of Hash Collisions </p>
|
||||||
|
|
||||||
|
**The distribution of key-value pairs is determined by the hash function**. Recalling the steps of calculating a hash function, first compute the hash value, then modulo it by the array length:
|
||||||
|
|
||||||
|
```shell
|
||||||
|
index = hash(key) % capacity
|
||||||
|
```
|
||||||
|
|
||||||
|
Observing the above formula, when the hash table capacity `capacity` is fixed, **the hash algorithm `hash()` determines the output value**, thereby determining the distribution of key-value pairs in the hash table.
|
||||||
|
|
||||||
|
This means that, to reduce the probability of hash collisions, we should focus on the design of the hash algorithm `hash()`.
|
||||||
|
|
||||||
|
## 6.3.1 Goals of Hash Algorithms
|
||||||
|
|
||||||
|
To achieve a "fast and stable" hash table data structure, hash algorithms should have the following characteristics:
|
||||||
|
|
||||||
|
- **Determinism**: For the same input, the hash algorithm should always produce the same output. Only then can the hash table be reliable.
|
||||||
|
- **High Efficiency**: The process of computing the hash value should be fast enough. The smaller the computational overhead, the more practical the hash table.
|
||||||
|
- **Uniform Distribution**: The hash algorithm should ensure that key-value pairs are evenly distributed in the hash table. The more uniform the distribution, the lower the probability of hash collisions.
|
||||||
|
|
||||||
|
In fact, hash algorithms are not only used to implement hash tables but are also widely applied in other fields.
|
||||||
|
|
||||||
|
- **Password Storage**: To protect the security of user passwords, systems usually do not store the plaintext passwords but rather the hash values of the passwords. When a user enters a password, the system calculates the hash value of the input and compares it with the stored hash value. If they match, the password is considered correct.
|
||||||
|
- **Data Integrity Check**: The data sender can calculate the hash value of the data and send it along; the receiver can recalculate the hash value of the received data and compare it with the received hash value. If they match, the data is considered intact.
|
||||||
|
|
||||||
|
For cryptographic applications, to prevent reverse engineering such as deducing the original password from the hash value, hash algorithms need higher-level security features.
|
||||||
|
|
||||||
|
- **Unidirectionality**: It should be impossible to deduce any information about the input data from the hash value.
|
||||||
|
- **Collision Resistance**: It should be extremely difficult to find two different inputs that produce the same hash value.
|
||||||
|
- **Avalanche Effect**: Minor changes in the input should lead to significant and unpredictable changes in the output.
|
||||||
|
|
||||||
|
Note that **"Uniform Distribution" and "Collision Resistance" are two separate concepts**. Satisfying uniform distribution does not necessarily mean collision resistance. For example, under random input `key`, the hash function `key % 100` can produce a uniformly distributed output. However, this hash algorithm is too simple, and all `key` with the same last two digits will have the same output, making it easy to deduce a usable `key` from the hash value, thereby cracking the password.
|
||||||
|
|
||||||
|
## 6.3.2 Design of Hash Algorithms
|
||||||
|
|
||||||
|
The design of hash algorithms is a complex issue that requires consideration of many factors. However, for some less demanding scenarios, we can also design some simple hash algorithms.
|
||||||
|
|
||||||
|
- **Additive Hash**: Add up the ASCII codes of each character in the input and use the total sum as the hash value.
|
||||||
|
- **Multiplicative Hash**: Utilize the non-correlation of multiplication, multiplying each round by a constant, accumulating the ASCII codes of each character into the hash value.
|
||||||
|
- **XOR Hash**: Accumulate the hash value by XORing each element of the input data.
|
||||||
|
- **Rotating Hash**: Accumulate the ASCII code of each character into a hash value, performing a rotation operation on the hash value before each accumulation.
|
||||||
|
|
||||||
|
=== "Python"
|
||||||
|
|
||||||
|
```python title="simple_hash.py"
|
||||||
|
def add_hash(key: str) -> int:
|
||||||
|
"""加法哈希"""
|
||||||
|
hash = 0
|
||||||
|
modulus = 1000000007
|
||||||
|
for c in key:
|
||||||
|
hash += ord(c)
|
||||||
|
return hash % modulus
|
||||||
|
|
||||||
|
def mul_hash(key: str) -> int:
|
||||||
|
"""乘法哈希"""
|
||||||
|
hash = 0
|
||||||
|
modulus = 1000000007
|
||||||
|
for c in key:
|
||||||
|
hash = 31 * hash + ord(c)
|
||||||
|
return hash % modulus
|
||||||
|
|
||||||
|
def xor_hash(key: str) -> int:
|
||||||
|
"""异或哈希"""
|
||||||
|
hash = 0
|
||||||
|
modulus = 1000000007
|
||||||
|
for c in key:
|
||||||
|
hash ^= ord(c)
|
||||||
|
return hash % modulus
|
||||||
|
|
||||||
|
def rot_hash(key: str) -> int:
|
||||||
|
"""旋转哈希"""
|
||||||
|
hash = 0
|
||||||
|
modulus = 1000000007
|
||||||
|
for c in key:
|
||||||
|
hash = (hash << 4) ^ (hash >> 28) ^ ord(c)
|
||||||
|
return hash % modulus
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "C++"
|
||||||
|
|
||||||
|
```cpp title="simple_hash.cpp"
|
||||||
|
/* 加法哈希 */
|
||||||
|
int addHash(string key) {
|
||||||
|
long long hash = 0;
|
||||||
|
const int MODULUS = 1000000007;
|
||||||
|
for (unsigned char c : key) {
|
||||||
|
hash = (hash + (int)c) % MODULUS;
|
||||||
|
}
|
||||||
|
return (int)hash;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 乘法哈希 */
|
||||||
|
int mulHash(string key) {
|
||||||
|
long long hash = 0;
|
||||||
|
const int MODULUS = 1000000007;
|
||||||
|
for (unsigned char c : key) {
|
||||||
|
hash = (31 * hash + (int)c) % MODULUS;
|
||||||
|
}
|
||||||
|
return (int)hash;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 异或哈希 */
|
||||||
|
int xorHash(string key) {
|
||||||
|
int hash = 0;
|
||||||
|
const int MODULUS = 1000000007;
|
||||||
|
for (unsigned char c : key) {
|
||||||
|
hash ^= (int)c;
|
||||||
|
}
|
||||||
|
return hash & MODULUS;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 旋转哈希 */
|
||||||
|
int rotHash(string key) {
|
||||||
|
long long hash = 0;
|
||||||
|
const int MODULUS = 1000000007;
|
||||||
|
for (unsigned char c : key) {
|
||||||
|
hash = ((hash << 4) ^ (hash >> 28) ^ (int)c) % MODULUS;
|
||||||
|
}
|
||||||
|
return (int)hash;
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "Java"
|
||||||
|
|
||||||
|
```java title="simple_hash.java"
|
||||||
|
/* 加法哈希 */
|
||||||
|
int addHash(String key) {
|
||||||
|
long hash = 0;
|
||||||
|
final int MODULUS = 1000000007;
|
||||||
|
for (char c : key.toCharArray()) {
|
||||||
|
hash = (hash + (int) c) % MODULUS;
|
||||||
|
}
|
||||||
|
return (int) hash;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 乘法哈希 */
|
||||||
|
int mulHash(String key) {
|
||||||
|
long hash = 0;
|
||||||
|
final int MODULUS = 1000000007;
|
||||||
|
for (char c : key.toCharArray()) {
|
||||||
|
hash = (31 * hash + (int) c) % MODULUS;
|
||||||
|
}
|
||||||
|
return (int) hash;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 异或哈希 */
|
||||||
|
int xorHash(String key) {
|
||||||
|
int hash = 0;
|
||||||
|
final int MODULUS = 1000000007;
|
||||||
|
for (char c : key.toCharArray()) {
|
||||||
|
hash ^= (int) c;
|
||||||
|
}
|
||||||
|
return hash & MODULUS;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 旋转哈希 */
|
||||||
|
int rotHash(String key) {
|
||||||
|
long hash = 0;
|
||||||
|
final int MODULUS = 1000000007;
|
||||||
|
for (char c : key.toCharArray()) {
|
||||||
|
hash = ((hash << 4) ^ (hash >> 28) ^ (int) c) % MODULUS;
|
||||||
|
}
|
||||||
|
return (int) hash;
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "C#"
|
||||||
|
|
||||||
|
```csharp title="simple_hash.cs"
|
||||||
|
/* 加法哈希 */
|
||||||
|
int AddHash(string key) {
|
||||||
|
long hash = 0;
|
||||||
|
const int MODULUS = 1000000007;
|
||||||
|
foreach (char c in key) {
|
||||||
|
hash = (hash + c) % MODULUS;
|
||||||
|
}
|
||||||
|
return (int)hash;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 乘法哈希 */
|
||||||
|
int MulHash(string key) {
|
||||||
|
long hash = 0;
|
||||||
|
const int MODULUS = 1000000007;
|
||||||
|
foreach (char c in key) {
|
||||||
|
hash = (31 * hash + c) % MODULUS;
|
||||||
|
}
|
||||||
|
return (int)hash;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 异或哈希 */
|
||||||
|
int XorHash(string key) {
|
||||||
|
int hash = 0;
|
||||||
|
const int MODULUS = 1000000007;
|
||||||
|
foreach (char c in key) {
|
||||||
|
hash ^= c;
|
||||||
|
}
|
||||||
|
return hash & MODULUS;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 旋转哈希 */
|
||||||
|
int RotHash(string key) {
|
||||||
|
long hash = 0;
|
||||||
|
const int MODULUS = 1000000007;
|
||||||
|
foreach (char c in key) {
|
||||||
|
hash = ((hash << 4) ^ (hash >> 28) ^ c) % MODULUS;
|
||||||
|
}
|
||||||
|
return (int)hash;
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "Go"
|
||||||
|
|
||||||
|
```go title="simple_hash.go"
|
||||||
|
/* 加法哈希 */
|
||||||
|
func addHash(key string) int {
|
||||||
|
var hash int64
|
||||||
|
var modulus int64
|
||||||
|
|
||||||
|
modulus = 1000000007
|
||||||
|
for _, b := range []byte(key) {
|
||||||
|
hash = (hash + int64(b)) % modulus
|
||||||
|
}
|
||||||
|
return int(hash)
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 乘法哈希 */
|
||||||
|
func mulHash(key string) int {
|
||||||
|
var hash int64
|
||||||
|
var modulus int64
|
||||||
|
|
||||||
|
modulus = 1000000007
|
||||||
|
for _, b := range []byte(key) {
|
||||||
|
hash = (31*hash + int64(b)) % modulus
|
||||||
|
}
|
||||||
|
return int(hash)
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 异或哈希 */
|
||||||
|
func xorHash(key string) int {
|
||||||
|
hash := 0
|
||||||
|
modulus := 1000000007
|
||||||
|
for _, b := range []byte(key) {
|
||||||
|
fmt.Println(int(b))
|
||||||
|
hash ^= int(b)
|
||||||
|
hash = (31*hash + int(b)) % modulus
|
||||||
|
}
|
||||||
|
return hash & modulus
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 旋转哈希 */
|
||||||
|
func rotHash(key string) int {
|
||||||
|
var hash int64
|
||||||
|
var modulus int64
|
||||||
|
|
||||||
|
modulus = 1000000007
|
||||||
|
for _, b := range []byte(key) {
|
||||||
|
hash = ((hash << 4) ^ (hash >> 28) ^ int64(b)) % modulus
|
||||||
|
}
|
||||||
|
return int(hash)
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "Swift"
|
||||||
|
|
||||||
|
```swift title="simple_hash.swift"
|
||||||
|
/* 加法哈希 */
|
||||||
|
func addHash(key: String) -> Int {
|
||||||
|
var hash = 0
|
||||||
|
let MODULUS = 1_000_000_007
|
||||||
|
for c in key {
|
||||||
|
for scalar in c.unicodeScalars {
|
||||||
|
hash = (hash + Int(scalar.value)) % MODULUS
|
||||||
|
}
|
||||||
|
}
|
||||||
|
return hash
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 乘法哈希 */
|
||||||
|
func mulHash(key: String) -> Int {
|
||||||
|
var hash = 0
|
||||||
|
let MODULUS = 1_000_000_007
|
||||||
|
for c in key {
|
||||||
|
for scalar in c.unicodeScalars {
|
||||||
|
hash = (31 * hash + Int(scalar.value)) % MODULUS
|
||||||
|
}
|
||||||
|
}
|
||||||
|
return hash
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 异或哈希 */
|
||||||
|
func xorHash(key: String) -> Int {
|
||||||
|
var hash = 0
|
||||||
|
let MODULUS = 1_000_000_007
|
||||||
|
for c in key {
|
||||||
|
for scalar in c.unicodeScalars {
|
||||||
|
hash ^= Int(scalar.value)
|
||||||
|
}
|
||||||
|
}
|
||||||
|
return hash & MODULUS
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 旋转哈希 */
|
||||||
|
func rotHash(key: String) -> Int {
|
||||||
|
var hash = 0
|
||||||
|
let MODULUS = 1_000_000_007
|
||||||
|
for c in key {
|
||||||
|
for scalar in c.unicodeScalars {
|
||||||
|
hash = ((hash << 4) ^ (hash >> 28) ^ Int(scalar.value)) % MODULUS
|
||||||
|
}
|
||||||
|
}
|
||||||
|
return hash
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "JS"
|
||||||
|
|
||||||
|
```javascript title="simple_hash.js"
|
||||||
|
/* 加法哈希 */
|
||||||
|
function addHash(key) {
|
||||||
|
let hash = 0;
|
||||||
|
const MODULUS = 1000000007;
|
||||||
|
for (const c of key) {
|
||||||
|
hash = (hash + c.charCodeAt(0)) % MODULUS;
|
||||||
|
}
|
||||||
|
return hash;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 乘法哈希 */
|
||||||
|
function mulHash(key) {
|
||||||
|
let hash = 0;
|
||||||
|
const MODULUS = 1000000007;
|
||||||
|
for (const c of key) {
|
||||||
|
hash = (31 * hash + c.charCodeAt(0)) % MODULUS;
|
||||||
|
}
|
||||||
|
return hash;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 异或哈希 */
|
||||||
|
function xorHash(key) {
|
||||||
|
let hash = 0;
|
||||||
|
const MODULUS = 1000000007;
|
||||||
|
for (const c of key) {
|
||||||
|
hash ^= c.charCodeAt(0);
|
||||||
|
}
|
||||||
|
return hash & MODULUS;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 旋转哈希 */
|
||||||
|
function rotHash(key) {
|
||||||
|
let hash = 0;
|
||||||
|
const MODULUS = 1000000007;
|
||||||
|
for (const c of key) {
|
||||||
|
hash = ((hash << 4) ^ (hash >> 28) ^ c.charCodeAt(0)) % MODULUS;
|
||||||
|
}
|
||||||
|
return hash;
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "TS"
|
||||||
|
|
||||||
|
```typescript title="simple_hash.ts"
|
||||||
|
/* 加法哈希 */
|
||||||
|
function addHash(key: string): number {
|
||||||
|
let hash = 0;
|
||||||
|
const MODULUS = 1000000007;
|
||||||
|
for (const c of key) {
|
||||||
|
hash = (hash + c.charCodeAt(0)) % MODULUS;
|
||||||
|
}
|
||||||
|
return hash;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 乘法哈希 */
|
||||||
|
function mulHash(key: string): number {
|
||||||
|
let hash = 0;
|
||||||
|
const MODULUS = 1000000007;
|
||||||
|
for (const c of key) {
|
||||||
|
hash = (31 * hash + c.charCodeAt(0)) % MODULUS;
|
||||||
|
}
|
||||||
|
return hash;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 异或哈希 */
|
||||||
|
function xorHash(key: string): number {
|
||||||
|
let hash = 0;
|
||||||
|
const MODULUS = 1000000007;
|
||||||
|
for (const c of key) {
|
||||||
|
hash ^= c.charCodeAt(0);
|
||||||
|
}
|
||||||
|
return hash & MODULUS;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 旋转哈希 */
|
||||||
|
function rotHash(key: string): number {
|
||||||
|
let hash = 0;
|
||||||
|
const MODULUS = 1000000007;
|
||||||
|
for (const c of key) {
|
||||||
|
hash = ((hash << 4) ^ (hash >> 28) ^ c.charCodeAt(0)) % MODULUS;
|
||||||
|
}
|
||||||
|
return hash;
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "Dart"
|
||||||
|
|
||||||
|
```dart title="simple_hash.dart"
|
||||||
|
/* 加法哈希 */
|
||||||
|
int addHash(String key) {
|
||||||
|
int hash = 0;
|
||||||
|
final int MODULUS = 1000000007;
|
||||||
|
for (int i = 0; i < key.length; i++) {
|
||||||
|
hash = (hash + key.codeUnitAt(i)) % MODULUS;
|
||||||
|
}
|
||||||
|
return hash;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 乘法哈希 */
|
||||||
|
int mulHash(String key) {
|
||||||
|
int hash = 0;
|
||||||
|
final int MODULUS = 1000000007;
|
||||||
|
for (int i = 0; i < key.length; i++) {
|
||||||
|
hash = (31 * hash + key.codeUnitAt(i)) % MODULUS;
|
||||||
|
}
|
||||||
|
return hash;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 异或哈希 */
|
||||||
|
int xorHash(String key) {
|
||||||
|
int hash = 0;
|
||||||
|
final int MODULUS = 1000000007;
|
||||||
|
for (int i = 0; i < key.length; i++) {
|
||||||
|
hash ^= key.codeUnitAt(i);
|
||||||
|
}
|
||||||
|
return hash & MODULUS;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 旋转哈希 */
|
||||||
|
int rotHash(String key) {
|
||||||
|
int hash = 0;
|
||||||
|
final int MODULUS = 1000000007;
|
||||||
|
for (int i = 0; i < key.length; i++) {
|
||||||
|
hash = ((hash << 4) ^ (hash >> 28) ^ key.codeUnitAt(i)) % MODULUS;
|
||||||
|
}
|
||||||
|
return hash;
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "Rust"
|
||||||
|
|
||||||
|
```rust title="simple_hash.rs"
|
||||||
|
/* 加法哈希 */
|
||||||
|
fn add_hash(key: &str) -> i32 {
|
||||||
|
let mut hash = 0_i64;
|
||||||
|
const MODULUS: i64 = 1000000007;
|
||||||
|
|
||||||
|
for c in key.chars() {
|
||||||
|
hash = (hash + c as i64) % MODULUS;
|
||||||
|
}
|
||||||
|
|
||||||
|
hash as i32
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 乘法哈希 */
|
||||||
|
fn mul_hash(key: &str) -> i32 {
|
||||||
|
let mut hash = 0_i64;
|
||||||
|
const MODULUS: i64 = 1000000007;
|
||||||
|
|
||||||
|
for c in key.chars() {
|
||||||
|
hash = (31 * hash + c as i64) % MODULUS;
|
||||||
|
}
|
||||||
|
|
||||||
|
hash as i32
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 异或哈希 */
|
||||||
|
fn xor_hash(key: &str) -> i32 {
|
||||||
|
let mut hash = 0_i64;
|
||||||
|
const MODULUS: i64 = 1000000007;
|
||||||
|
|
||||||
|
for c in key.chars() {
|
||||||
|
hash ^= c as i64;
|
||||||
|
}
|
||||||
|
|
||||||
|
(hash & MODULUS) as i32
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 旋转哈希 */
|
||||||
|
fn rot_hash(key: &str) -> i32 {
|
||||||
|
let mut hash = 0_i64;
|
||||||
|
const MODULUS: i64 = 1000000007;
|
||||||
|
|
||||||
|
for c in key.chars() {
|
||||||
|
hash = ((hash << 4) ^ (hash >> 28) ^ c as i64) % MODULUS;
|
||||||
|
}
|
||||||
|
|
||||||
|
hash as i32
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "C"
|
||||||
|
|
||||||
|
```c title="simple_hash.c"
|
||||||
|
/* 加法哈希 */
|
||||||
|
int addHash(char *key) {
|
||||||
|
long long hash = 0;
|
||||||
|
const int MODULUS = 1000000007;
|
||||||
|
for (int i = 0; i < strlen(key); i++) {
|
||||||
|
hash = (hash + (unsigned char)key[i]) % MODULUS;
|
||||||
|
}
|
||||||
|
return (int)hash;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 乘法哈希 */
|
||||||
|
int mulHash(char *key) {
|
||||||
|
long long hash = 0;
|
||||||
|
const int MODULUS = 1000000007;
|
||||||
|
for (int i = 0; i < strlen(key); i++) {
|
||||||
|
hash = (31 * hash + (unsigned char)key[i]) % MODULUS;
|
||||||
|
}
|
||||||
|
return (int)hash;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 异或哈希 */
|
||||||
|
int xorHash(char *key) {
|
||||||
|
int hash = 0;
|
||||||
|
const int MODULUS = 1000000007;
|
||||||
|
|
||||||
|
for (int i = 0; i < strlen(key); i++) {
|
||||||
|
hash ^= (unsigned char)key[i];
|
||||||
|
}
|
||||||
|
return hash & MODULUS;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 旋转哈希 */
|
||||||
|
int rotHash(char *key) {
|
||||||
|
long long hash = 0;
|
||||||
|
const int MODULUS = 1000000007;
|
||||||
|
for (int i = 0; i < strlen(key); i++) {
|
||||||
|
hash = ((hash << 4) ^ (hash >> 28) ^ (unsigned char)key[i]) % MODULUS;
|
||||||
|
}
|
||||||
|
|
||||||
|
return (int)hash;
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "Zig"
|
||||||
|
|
||||||
|
```zig title="simple_hash.zig"
|
||||||
|
[class]{}-[func]{addHash}
|
||||||
|
|
||||||
|
[class]{}-[func]{mulHash}
|
||||||
|
|
||||||
|
[class]{}-[func]{xorHash}
|
||||||
|
|
||||||
|
[class]{}-[func]{rotHash}
|
||||||
|
```
|
||||||
|
|
||||||
|
??? pythontutor "Code Visualization"
|
||||||
|
|
||||||
|
<div style="height: 549px; width: 100%;"><iframe class="pythontutor-iframe" src="https://pythontutor.com/iframe-embed.html#code=def%20add_hash%28key%3A%20str%29%20-%3E%20int%3A%0A%20%20%20%20%22%22%22%E5%8A%A0%E6%B3%95%E5%93%88%E5%B8%8C%22%22%22%0A%20%20%20%20hash%20%3D%200%0A%20%20%20%20modulus%20%3D%201000000007%0A%20%20%20%20for%20c%20in%20key%3A%0A%20%20%20%20%20%20%20%20hash%20%2B%3D%20ord%28c%29%0A%20%20%20%20return%20hash%20%25%20modulus%0A%0A%0Adef%20mul_hash%28key%3A%20str%29%20-%3E%20int%3A%0A%20%20%20%20%22%22%22%E4%B9%98%E6%B3%95%E5%93%88%E5%B8%8C%22%22%22%0A%20%20%20%20hash%20%3D%200%0A%20%20%20%20modulus%20%3D%201000000007%0A%20%20%20%20for%20c%20in%20key%3A%0A%20%20%20%20%20%20%20%20hash%20%3D%2031%20*%20hash%20%2B%20ord%28c%29%0A%20%20%20%20return%20hash%20%25%20modulus%0A%0A%0Adef%20xor_hash%28key%3A%20str%29%20-%3E%20int%3A%0A%20%20%20%20%22%22%22%E5%BC%82%E6%88%96%E5%93%88%E5%B8%8C%22%22%22%0A%20%20%20%20hash%20%3D%200%0A%20%20%20%20modulus%20%3D%201000000007%0A%20%20%20%20for%20c%20in%20key%3A%0A%20%20%20%20%20%20%20%20hash%20%5E%3D%20ord%28c%29%0A%20%20%20%20return%20hash%20%25%20modulus%0A%0A%0Adef%20rot_hash%28key%3A%20str%29%20-%3E%20int%3A%0A%20%20%20%20%22%22%22%E6%97%8B%E8%BD%AC%E5%93%88%E5%B8%8C%22%22%22%0A%20%20%20%20hash%20%3D%200%0A%20%20%20%20modulus%20%3D%201000000007%0A%20%20%20%20for%20c%20in%20key%3A%0A%20%20%20%20%20%20%20%20hash%20%3D%20%28hash%20%3C%3C%204%29%20%5E%20%28hash%20%3E%3E%2028%29%20%5E%20ord%28c%29%0A%20%20%20%20return%20hash%20%25%20modulus%0A%0A%0A%22%22%22Driver%20Code%22%22%22%0Aif%20__name__%20%3D%3D%20%22__main__%22%3A%0A%20%20%20%20key%20%3D%20%22Hello%20%E7%AE%97%E6%B3%95%22%0A%0A%20%20%20%20hash%20%3D%20add_hash%28key%29%0A%20%20%20%20print%28f%22%E5%8A%A0%E6%B3%95%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%20%7Bhash%7D%22%29%0A%0A%20%20%20%20hash%20%3D%20mul_hash%28key%29%0A%20%20%20%20print%28f%22%E4%B9%98%E6%B3%95%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%20%7Bhash%7D%22%29%0A%0A%20%20%20%20hash%20%3D%20xor_hash%28key%29%0A%20%20%20%20print%28f%22%E5%BC%82%E6%88%96%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%20%7Bhash%7D%22%29%0A%0A%20%20%20%20hash%20%3D%20rot_hash%28key%29%0A%20%20%20%20print%28f%22%E6%97%8B%E8%BD%AC%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%20%7Bhash%7D%22%29%0A&codeDivHeight=472&codeDivWidth=350&cumulative=false&curInstr=6&heapPrimitives=nevernest&origin=opt-frontend.js&py=311&rawInputLstJSON=%5B%5D&textReferences=false"> </iframe></div>
|
||||||
|
<div style="margin-top: 5px;"><a href="https://pythontutor.com/iframe-embed.html#code=def%20add_hash%28key%3A%20str%29%20-%3E%20int%3A%0A%20%20%20%20%22%22%22%E5%8A%A0%E6%B3%95%E5%93%88%E5%B8%8C%22%22%22%0A%20%20%20%20hash%20%3D%200%0A%20%20%20%20modulus%20%3D%201000000007%0A%20%20%20%20for%20c%20in%20key%3A%0A%20%20%20%20%20%20%20%20hash%20%2B%3D%20ord%28c%29%0A%20%20%20%20return%20hash%20%25%20modulus%0A%0A%0Adef%20mul_hash%28key%3A%20str%29%20-%3E%20int%3A%0A%20%20%20%20%22%22%22%E4%B9%98%E6%B3%95%E5%93%88%E5%B8%8C%22%22%22%0A%20%20%20%20hash%20%3D%200%0A%20%20%20%20modulus%20%3D%201000000007%0A%20%20%20%20for%20c%20in%20key%3A%0A%20%20%20%20%20%20%20%20hash%20%3D%2031%20*%20hash%20%2B%20ord%28c%29%0A%20%20%20%20return%20hash%20%25%20modulus%0A%0A%0Adef%20xor_hash%28key%3A%20str%29%20-%3E%20int%3A%0A%20%20%20%20%22%22%22%E5%BC%82%E6%88%96%E5%93%88%E5%B8%8C%22%22%22%0A%20%20%20%20hash%20%3D%200%0A%20%20%20%20modulus%20%3D%201000000007%0A%20%20%20%20for%20c%20in%20key%3A%0A%20%20%20%20%20%20%20%20hash%20%5E%3D%20ord%28c%29%0A%20%20%20%20return%20hash%20%25%20modulus%0A%0A%0Adef%20rot_hash%28key%3A%20str%29%20-%3E%20int%3A%0A%20%20%20%20%22%22%22%E6%97%8B%E8%BD%AC%E5%93%88%E5%B8%8C%22%22%22%0A%20%20%20%20hash%20%3D%200%0A%20%20%20%20modulus%20%3D%201000000007%0A%20%20%20%20for%20c%20in%20key%3A%0A%20%20%20%20%20%20%20%20hash%20%3D%20%28hash%20%3C%3C%204%29%20%5E%20%28hash%20%3E%3E%2028%29%20%5E%20ord%28c%29%0A%20%20%20%20return%20hash%20%25%20modulus%0A%0A%0A%22%22%22Driver%20Code%22%22%22%0Aif%20__name__%20%3D%3D%20%22__main__%22%3A%0A%20%20%20%20key%20%3D%20%22Hello%20%E7%AE%97%E6%B3%95%22%0A%0A%20%20%20%20hash%20%3D%20add_hash%28key%29%0A%20%20%20%20print%28f%22%E5%8A%A0%E6%B3%95%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%20%7Bhash%7D%22%29%0A%0A%20%20%20%20hash%20%3D%20mul_hash%28key%29%0A%20%20%20%20print%28f%22%E4%B9%98%E6%B3%95%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%20%7Bhash%7D%22%29%0A%0A%20%20%20%20hash%20%3D%20xor_hash%28key%29%0A%20%20%20%20print%28f%22%E5%BC%82%E6%88%96%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%20%7Bhash%7D%22%29%0A%0A%20%20%20%20hash%20%3D%20rot_hash%28key%29%0A%20%20%20%20print%28f%22%E6%97%8B%E8%BD%AC%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%20%7Bhash%7D%22%29%0A&codeDivHeight=800&codeDivWidth=600&cumulative=false&curInstr=6&heapPrimitives=nevernest&origin=opt-frontend.js&py=311&rawInputLstJSON=%5B%5D&textReferences=false" target="_blank" rel="noopener noreferrer">Full Screen ></a></div>
|
||||||
|
|
||||||
|
It is observed that the last step of each hash algorithm is to take the modulus of the large prime number $1000000007$ to ensure that the hash value is within an appropriate range. It is worth pondering why emphasis is placed on modulo a prime number, or what are the disadvantages of modulo a composite number? This is an interesting question.
|
||||||
|
|
||||||
|
To conclude: **Using a large prime number as the modulus can maximize the uniform distribution of hash values**. Since a prime number does not share common factors with other numbers, it can reduce the periodic patterns caused by the modulo operation, thus avoiding hash collisions.
|
||||||
|
|
||||||
|
For example, suppose we choose the composite number $9$ as the modulus, which can be divided by $3$, then all `key` divisible by $3$ will be mapped to hash values $0$, $3$, $6$.
|
||||||
|
|
||||||
|
$$
|
||||||
|
\begin{aligned}
|
||||||
|
\text{modulus} & = 9 \newline
|
||||||
|
\text{key} & = \{ 0, 3, 6, 9, 12, 15, 18, 21, 24, 27, 30, 33, \dots \} \newline
|
||||||
|
\text{hash} & = \{ 0, 3, 6, 0, 3, 6, 0, 3, 6, 0, 3, 6,\dots \}
|
||||||
|
\end{aligned}
|
||||||
|
$$
|
||||||
|
|
||||||
|
If the input `key` happens to have this kind of arithmetic sequence distribution, then the hash values will cluster, thereby exacerbating hash collisions. Now, suppose we replace `modulus` with the prime number $13$, since there are no common factors between `key` and `modulus`, the uniformity of the output hash values will be significantly improved.
|
||||||
|
|
||||||
|
$$
|
||||||
|
\begin{aligned}
|
||||||
|
\text{modulus} & = 13 \newline
|
||||||
|
\text{key} & = \{ 0, 3, 6, 9, 12, 15, 18, 21, 24, 27, 30, 33, \dots \} \newline
|
||||||
|
\text{hash} & = \{ 0, 3, 6, 9, 12, 2, 5, 8, 11, 1, 4, 7, \dots \}
|
||||||
|
\end{aligned}
|
||||||
|
$$
|
||||||
|
|
||||||
|
It is worth noting that if the `key` is guaranteed to be randomly and uniformly distributed, then choosing a prime number or a composite number as the modulus can both produce uniformly distributed hash values. However, when the distribution of `key` has some periodicity, modulo a composite number is more likely to result in clustering.
|
||||||
|
|
||||||
|
In summary, we usually choose a prime number as the modulus, and this prime number should be large enough to eliminate periodic patterns as much as possible, enhancing the robustness of the hash algorithm.
|
||||||
|
|
||||||
|
## 6.3.3 Common Hash Algorithms
|
||||||
|
|
||||||
|
It is not hard to see that the simple hash algorithms mentioned above are quite "fragile" and far from reaching the design goals of hash algorithms. For example, since addition and XOR obey the commutative law, additive hash and XOR hash cannot distinguish strings with the same content but in different order, which may exacerbate hash collisions and cause security issues.
|
||||||
|
|
||||||
|
In practice, we usually use some standard hash algorithms, such as MD5, SHA-1, SHA-2, and SHA-3. They can map input data of any length to a fixed-length hash value.
|
||||||
|
|
||||||
|
Over the past century, hash algorithms have been in a continuous process of upgrading and optimization. Some researchers strive to improve the performance of hash algorithms, while others, including hackers, are dedicated to finding security issues in hash algorithms. The Table 6-2 shows hash algorithms commonly used in practical applications.
|
||||||
|
|
||||||
|
- MD5 and SHA-1 have been successfully attacked multiple times and are thus abandoned in various security applications.
|
||||||
|
- SHA-2 series, especially SHA-256, is one of the most secure hash algorithms to date, with no successful attacks reported, hence commonly used in various security applications and protocols.
|
||||||
|
- SHA-3 has lower implementation costs and higher computational efficiency compared to SHA-2, but its current usage coverage is not as extensive as the SHA-2 series.
|
||||||
|
|
||||||
|
<p align="center"> Table 6-2 Common Hash Algorithms </p>
|
||||||
|
|
||||||
|
<div class="center-table" markdown>
|
||||||
|
|
||||||
|
| | MD5 | SHA-1 | SHA-2 | SHA-3 |
|
||||||
|
| --------------- | ----------------------------------------------- | ----------------------------------- | ----------------------------------------------------------------- | ---------------------------- |
|
||||||
|
| Release Year | 1992 | 1995 | 2002 | 2008 |
|
||||||
|
| Output Length | 128 bit | 160 bit | 256/512 bit | 224/256/384/512 bit |
|
||||||
|
| Hash Collisions | Frequent | Frequent | Rare | Rare |
|
||||||
|
| Security Level | Low, has been successfully attacked | Low, has been successfully attacked | High | High |
|
||||||
|
| Applications | Abandoned, still used for data integrity checks | Abandoned | Cryptocurrency transaction verification, digital signatures, etc. | Can be used to replace SHA-2 |
|
||||||
|
|
||||||
|
</div>
|
||||||
|
|
||||||
|
# Hash Values in Data Structures
|
||||||
|
|
||||||
|
We know that the keys in a hash table can be of various data types such as integers, decimals, or strings. Programming languages usually provide built-in hash algorithms for these data types to calculate the bucket indices in the hash table. Taking Python as an example, we can use the `hash()` function to compute the hash values for various data types.
|
||||||
|
|
||||||
|
- The hash values of integers and booleans are their own values.
|
||||||
|
- The calculation of hash values for floating-point numbers and strings is more complex, and interested readers are encouraged to study this on their own.
|
||||||
|
- The hash value of a tuple is a combination of the hash values of each of its elements, resulting in a single hash value.
|
||||||
|
- The hash value of an object is generated based on its memory address. By overriding the hash method of an object, hash values can be generated based on content.
|
||||||
|
|
||||||
|
!!! tip
|
||||||
|
|
||||||
|
Be aware that the definition and methods of the built-in hash value calculation functions in different programming languages vary.
|
||||||
|
|
||||||
|
=== "Python"
|
||||||
|
|
||||||
|
```python title="built_in_hash.py"
|
||||||
|
num = 3
|
||||||
|
hash_num = hash(num)
|
||||||
|
# Hash value of integer 3 is 3
|
||||||
|
|
||||||
|
bol = True
|
||||||
|
hash_bol = hash(bol)
|
||||||
|
# Hash value of boolean True is 1
|
||||||
|
|
||||||
|
dec = 3.14159
|
||||||
|
hash_dec = hash(dec)
|
||||||
|
# Hash value of decimal 3.14159 is 326484311674566659
|
||||||
|
|
||||||
|
str = "Hello 算法"
|
||||||
|
hash_str = hash(str)
|
||||||
|
# Hash value of string "Hello 算法" is 4617003410720528961
|
||||||
|
|
||||||
|
tup = (12836, "小哈")
|
||||||
|
hash_tup = hash(tup)
|
||||||
|
# Hash value of tuple (12836, '小哈') is 1029005403108185979
|
||||||
|
|
||||||
|
obj = ListNode(0)
|
||||||
|
hash_obj = hash(obj)
|
||||||
|
# Hash value of ListNode object at 0x1058fd810 is 274267521
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "C++"
|
||||||
|
|
||||||
|
```cpp title="built_in_hash.cpp"
|
||||||
|
int num = 3;
|
||||||
|
size_t hashNum = hash<int>()(num);
|
||||||
|
// Hash value of integer 3 is 3
|
||||||
|
|
||||||
|
bool bol = true;
|
||||||
|
size_t hashBol = hash<bool>()(bol);
|
||||||
|
// Hash value of boolean 1 is 1
|
||||||
|
|
||||||
|
double dec = 3.14159;
|
||||||
|
size_t hashDec = hash<double>()(dec);
|
||||||
|
// Hash value of decimal 3.14159 is 4614256650576692846
|
||||||
|
|
||||||
|
string str = "Hello 算法";
|
||||||
|
size_t hashStr = hash<string>()(str);
|
||||||
|
// Hash value of string "Hello 算法" is 15466937326284535026
|
||||||
|
|
||||||
|
// In C++, built-in std::hash() only provides hash values for basic data types
|
||||||
|
// Hash values for arrays and objects need to be implemented separately
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "Java"
|
||||||
|
|
||||||
|
```java title="built_in_hash.java"
|
||||||
|
int num = 3;
|
||||||
|
int hashNum = Integer.hashCode(num);
|
||||||
|
// Hash value of integer 3 is 3
|
||||||
|
|
||||||
|
boolean bol = true;
|
||||||
|
int hashBol = Boolean.hashCode(bol);
|
||||||
|
// Hash value of boolean true is 1231
|
||||||
|
|
||||||
|
double dec = 3.14159;
|
||||||
|
int hashDec = Double.hashCode(dec);
|
||||||
|
// Hash value of decimal 3.14159 is -1340954729
|
||||||
|
|
||||||
|
String str = "Hello 算法";
|
||||||
|
int hashStr = str.hashCode();
|
||||||
|
// Hash value of string "Hello 算法" is -727081396
|
||||||
|
|
||||||
|
Object[] arr = { 12836, "小哈" };
|
||||||
|
int hashTup = Arrays.hashCode(arr);
|
||||||
|
// Hash value of array [12836, 小哈] is 1151158
|
||||||
|
|
||||||
|
ListNode obj = new ListNode(0);
|
||||||
|
int hashObj = obj.hashCode();
|
||||||
|
// Hash value of ListNode object utils.ListNode@7dc5e7b4 is 2110121908
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "C#"
|
||||||
|
|
||||||
|
```csharp title="built_in_hash.cs"
|
||||||
|
int num = 3;
|
||||||
|
int hashNum = num.GetHashCode();
|
||||||
|
// Hash value of integer 3 is 3;
|
||||||
|
|
||||||
|
bool bol = true;
|
||||||
|
int hashBol = bol.GetHashCode();
|
||||||
|
// Hash value of boolean true is 1;
|
||||||
|
|
||||||
|
double dec = 3.14159;
|
||||||
|
int hashDec = dec.GetHashCode();
|
||||||
|
// Hash value of decimal 3.14159 is -1340954729;
|
||||||
|
|
||||||
|
string str = "Hello 算法";
|
||||||
|
int hashStr = str.GetHashCode();
|
||||||
|
// Hash value of string "Hello 算法" is -586107568;
|
||||||
|
|
||||||
|
object[] arr = [12836, "小哈"];
|
||||||
|
int hashTup = arr.GetHashCode();
|
||||||
|
// Hash value of array [12836, 小哈] is 42931033;
|
||||||
|
|
||||||
|
ListNode obj = new(0);
|
||||||
|
int hashObj = obj.GetHashCode();
|
||||||
|
// Hash value of ListNode object 0 is 39053774;
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "Go"
|
||||||
|
|
||||||
|
```go title="built_in_hash.go"
|
||||||
|
// Go does not provide built-in hash code functions
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "Swift"
|
||||||
|
|
||||||
|
```swift title="built_in_hash.swift"
|
||||||
|
let num = 3
|
||||||
|
let hashNum = num.hashValue
|
||||||
|
// Hash value of integer 3 is 9047044699613009734
|
||||||
|
|
||||||
|
let bol = true
|
||||||
|
let hashBol = bol.hashValue
|
||||||
|
// Hash value of boolean true is -4431640247352757451
|
||||||
|
|
||||||
|
let dec = 3.14159
|
||||||
|
let hashDec = dec.hashValue
|
||||||
|
// Hash value of decimal 3.14159 is -2465384235396674631
|
||||||
|
|
||||||
|
let str = "Hello 算法"
|
||||||
|
let hashStr = str.hashValue
|
||||||
|
// Hash value of string "Hello 算法" is -7850626797806988787
|
||||||
|
|
||||||
|
let arr = [AnyHashable(12836), AnyHashable("小哈")]
|
||||||
|
let hashTup = arr.hashValue
|
||||||
|
// Hash value of array [AnyHashable(12836), AnyHashable("小哈")] is -2308633508154532996
|
||||||
|
|
||||||
|
let obj = ListNode(x: 0)
|
||||||
|
let hashObj = obj.hashValue
|
||||||
|
// Hash value of ListNode object utils.ListNode is -2434780518035996159
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "JS"
|
||||||
|
|
||||||
|
```javascript title="built_in_hash.js"
|
||||||
|
// JavaScript does not provide built-in hash code functions
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "TS"
|
||||||
|
|
||||||
|
```typescript title="built_in_hash.ts"
|
||||||
|
// TypeScript does not provide built-in hash code functions
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "Dart"
|
||||||
|
|
||||||
|
```dart title="built_in_hash.dart"
|
||||||
|
int num = 3;
|
||||||
|
int hashNum = num.hashCode;
|
||||||
|
// Hash value of integer 3 is 34803
|
||||||
|
|
||||||
|
bool bol = true;
|
||||||
|
int hashBol = bol.hashCode;
|
||||||
|
// Hash value of boolean true is 1231
|
||||||
|
|
||||||
|
double dec = 3.14159;
|
||||||
|
int hashDec = dec.hashCode;
|
||||||
|
// Hash value of decimal 3.14159 is 2570631074981783
|
||||||
|
|
||||||
|
String str = "Hello 算法";
|
||||||
|
int hashStr = str.hashCode;
|
||||||
|
// Hash value of string "Hello 算法" is 468167534
|
||||||
|
|
||||||
|
List arr = [12836, "小哈"];
|
||||||
|
int hashArr = arr.hashCode;
|
||||||
|
// Hash value of array [12836, 小哈] is 976512528
|
||||||
|
|
||||||
|
ListNode obj = new ListNode(0);
|
||||||
|
int hashObj = obj.hashCode;
|
||||||
|
// Hash value of ListNode object Instance of 'ListNode' is 1033450432
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "Rust"
|
||||||
|
|
||||||
|
```rust title="built_in_hash.rs"
|
||||||
|
use std::collections::hash_map::DefaultHasher;
|
||||||
|
use std::hash::{Hash, Hasher};
|
||||||
|
|
||||||
|
let num = 3;
|
||||||
|
let mut num_hasher = DefaultHasher::new();
|
||||||
|
num.hash(&mut num_hasher);
|
||||||
|
let hash_num = num_hasher.finish();
|
||||||
|
// Hash value of integer 3 is 568126464209439262
|
||||||
|
|
||||||
|
let bol = true;
|
||||||
|
let mut bol_hasher = DefaultHasher::new();
|
||||||
|
bol.hash(&mut bol_hasher);
|
||||||
|
let hash_bol = bol_hasher.finish();
|
||||||
|
// Hash value of boolean true is 4952851536318644461
|
||||||
|
|
||||||
|
let dec: f32 = 3.14159;
|
||||||
|
let mut dec_hasher = DefaultHasher::new();
|
||||||
|
dec.to_bits().hash(&mut dec_hasher);
|
||||||
|
let hash_dec = dec_hasher.finish();
|
||||||
|
// Hash value of decimal 3.14159 is 2566941990314602357
|
||||||
|
|
||||||
|
let str = "Hello 算法";
|
||||||
|
let mut str_hasher = DefaultHasher::new();
|
||||||
|
str.hash(&mut str_hasher);
|
||||||
|
let hash_str = str_hasher.finish();
|
||||||
|
// Hash value of string "Hello 算法" is 16092673739211250988
|
||||||
|
|
||||||
|
let arr = (&12836, &"小哈");
|
||||||
|
let mut tup_hasher = DefaultHasher::new();
|
||||||
|
arr.hash(&mut tup_hasher);
|
||||||
|
let hash_tup = tup_hasher.finish();
|
||||||
|
// Hash value of tuple (12836, "小哈") is 1885128010422702749
|
||||||
|
|
||||||
|
let node = ListNode::new(42);
|
||||||
|
let mut hasher = DefaultHasher::new();
|
||||||
|
node.borrow().val.hash(&mut hasher);
|
||||||
|
let hash = hasher.finish();
|
||||||
|
// Hash value of ListNode object RefCell { value: ListNode { val: 42, next: None } } is 15387811073369036852
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "C"
|
||||||
|
|
||||||
|
```c title="built_in_hash.c"
|
||||||
|
// C does not provide built-in hash code functions
|
||||||
|
```
|
||||||
|
|
||||||
|
=== "Zig"
|
||||||
|
|
||||||
|
```zig title="built_in_hash.zig"
|
||||||
|
|
||||||
|
```
|
||||||
|
|
||||||
|
??? pythontutor "Code Visualization"
|
||||||
|
|
||||||
|
<div style="height: 549px; width: 100%;"><iframe class="pythontutor-iframe" src="https://pythontutor.com/iframe-embed.html#code=class%20ListNode%3A%0A%20%20%20%20%22%22%22%E9%93%BE%E8%A1%A8%E8%8A%82%E7%82%B9%E7%B1%BB%22%22%22%0A%20%20%20%20def%20__init__%28self,%20val%3A%20int%29%3A%0A%20%20%20%20%20%20%20%20self.val%3A%20int%20%3D%20val%20%20%23%20%E8%8A%82%E7%82%B9%E5%80%BC%0A%20%20%20%20%20%20%20%20self.next%3A%20ListNode%20%7C%20None%20%3D%20None%20%20%23%20%E5%90%8E%E7%BB%A7%E8%8A%82%E7%82%B9%E5%BC%95%E7%94%A8%0A%0A%22%22%22Driver%20Code%22%22%22%0Aif%20__name__%20%3D%3D%20%22__main__%22%3A%0A%20%20%20%20num%20%3D%203%0A%20%20%20%20hash_num%20%3D%20hash%28num%29%0A%20%20%20%20%23%20%E6%95%B4%E6%95%B0%203%20%E7%9A%84%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%203%0A%0A%20%20%20%20bol%20%3D%20True%0A%20%20%20%20hash_bol%20%3D%20hash%28bol%29%0A%20%20%20%20%23%20%E5%B8%83%E5%B0%94%E9%87%8F%20True%20%E7%9A%84%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%201%0A%0A%20%20%20%20dec%20%3D%203.14159%0A%20%20%20%20hash_dec%20%3D%20hash%28dec%29%0A%20%20%20%20%23%20%E5%B0%8F%E6%95%B0%203.14159%20%E7%9A%84%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%20326484311674566659%0A%0A%20%20%20%20str%20%3D%20%22Hello%20%E7%AE%97%E6%B3%95%22%0A%20%20%20%20hash_str%20%3D%20hash%28str%29%0A%20%20%20%20%23%20%E5%AD%97%E7%AC%A6%E4%B8%B2%E2%80%9CHello%20%E7%AE%97%E6%B3%95%E2%80%9D%E7%9A%84%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%204617003410720528961%0A%0A%20%20%20%20tup%20%3D%20%2812836,%20%22%E5%B0%8F%E5%93%88%22%29%0A%20%20%20%20hash_tup%20%3D%20hash%28tup%29%0A%20%20%20%20%23%20%E5%85%83%E7%BB%84%20%2812836,%20'%E5%B0%8F%E5%93%88'%29%20%E7%9A%84%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%201029005403108185979%0A%0A%20%20%20%20obj%20%3D%20ListNode%280%29%0A%20%20%20%20hash_obj%20%3D%20hash%28obj%29%0A%20%20%20%20%23%20%E8%8A%82%E7%82%B9%E5%AF%B9%E8%B1%A1%20%3CListNode%20object%20at%200x1058fd810%3E%20%E7%9A%84%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%20274267521&codeDivHeight=472&codeDivWidth=350&cumulative=false&curInstr=19&heapPrimitives=nevernest&origin=opt-frontend.js&py=311&rawInputLstJSON=%5B%5D&textReferences=false"> </iframe></div>
|
||||||
|
<div style="margin-top: 5px;"><a href="https://pythontutor.com/iframe-embed.html#code=class%20ListNode%3A%0A%20%20%20%20%22%22%22%E9%93%BE%E8%A1%A8%E8%8A%82%E7%82%B9%E7%B1%BB%22%22%22%0A%20%20%20%20def%20__init__%28self,%20val%3A%20int%29%3A%0A%20%20%20%20%20%20%20%20self.val%3A%20int%20%3D%20val%20%20%23%20%E8%8A%82%E7%82%B9%E5%80%BC%0A%20%20%20%20%20%20%20%20self.next%3A%20ListNode%20%7C%20None%20%3D%20None%20%20%23%20%E5%90%8E%E7%BB%A7%E8%8A%82%E7%82%B9%E5%BC%95%E7%94%A8%0A%0A%22%22%22Driver%20Code%22%22%22%0Aif%20__name__%20%3D%3D%20%22__main__%22%3A%0A%20%20%20%20num%20%3D%203%0A%20%20%20%20hash_num%20%3D%20hash%28num%29%0A%20%20%20%20%23%20%E6%95%B4%E6%95%B0%203%20%E7%9A%84%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%203%0A%0A%20%20%20%20bol%20%3D%20True%0A%20%20%20%20hash_bol%20%3D%20hash%28bol%29%0A%20%20%20%20%23%20%E5%B8%83%E5%B0%94%E9%87%8F%20True%20%E7%9A%84%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%201%0A%0A%20%20%20%20dec%20%3D%203.14159%0A%20%20%20%20hash_dec%20%3D%20hash%28dec%29%0A%20%20%20%20%23%20%E5%B0%8F%E6%95%B0%203.14159%20%E7%9A%84%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%20326484311674566659%0A%0A%20%20%20%20str%20%3D%20%22Hello%20%E7%AE%97%E6%B3%95%22%0A%20%20%20%20hash_str%20%3D%20hash%28str%29%0A%20%20%20%20%23%20%E5%AD%97%E7%AC%A6%E4%B8%B2%E2%80%9CHello%20%E7%AE%97%E6%B3%95%E2%80%9D%E7%9A%84%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%204617003410720528961%0A%0A%20%20%20%20tup%20%3D%20%2812836,%20%22%E5%B0%8F%E5%93%88%22%29%0A%20%20%20%20hash_tup%20%3D%20hash%28tup%29%0A%20%20%20%20%23%20%E5%85%83%E7%BB%84%20%2812836,%20'%E5%B0%8F%E5%93%88'%29%20%E7%9A%84%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%201029005403108185979%0A%0A%20%20%20%20obj%20%3D%20ListNode%280%29%0A%20%20%20%20hash_obj%20%3D%20hash%28obj%29%0A%20%20%20%20%23%20%E8%8A%82%E7%82%B9%E5%AF%B9%E8%B1%A1%20%3CListNode%20object%20at%200x1058fd810%3E%20%E7%9A%84%E5%93%88%E5%B8%8C%E5%80%BC%E4%B8%BA%20274267521&codeDivHeight=800&codeDivWidth=600&cumulative=false&curInstr=19&heapPrimitives=nevernest&origin=opt-frontend.js&py=311&rawInputLstJSON=%5B%5D&textReferences=false" target="_blank" rel="noopener noreferrer">Full Screen ></a></div>
|
||||||
|
|
||||||
|
In many programming languages, **only immutable objects can serve as the `key` in a hash table**. If we use a list (dynamic array) as a `key`, when the contents of the list change, its hash value also changes, and we would no longer be able to find the original `value` in the hash table.
|
||||||
|
|
||||||
|
Although the member variables of a custom object (such as a linked list node) are mutable, it is hashable. **This is because the hash value of an object is usually generated based on its memory address**, and even if the contents of the object change, the memory address remains the same, so the hash value remains unchanged.
|
||||||
|
|
||||||
|
You might have noticed that the hash values output in different consoles are different. **This is because the Python interpreter adds a random salt to the string hash function each time it starts up**. This approach effectively prevents HashDoS attacks and enhances the security of the hash algorithm.
|
||||||
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
@ -0,0 +1,25 @@
|
|||||||
|
---
|
||||||
|
comments: true
|
||||||
|
icon: material/table-search
|
||||||
|
---
|
||||||
|
|
||||||
|
# Chapter 6. Hash Table
|
||||||
|
|
||||||
|
<div class="center-table" markdown>
|
||||||
|
|
||||||
|
{ class="cover-image" }
|
||||||
|
|
||||||
|
</div>
|
||||||
|
|
||||||
|
!!! abstract
|
||||||
|
|
||||||
|
In the world of computing, a hash table is like a wise librarian.
|
||||||
|
|
||||||
|
He knows how to calculate index numbers, allowing it to quickly locate the target book.
|
||||||
|
|
||||||
|
## Chapter Contents
|
||||||
|
|
||||||
|
- [6.1 Hash Table](https://www.hello-algo.com/en/chapter_hashing/hash_map/)
|
||||||
|
- [6.2 Hash Collision](https://www.hello-algo.com/en/chapter_hashing/hash_collision/)
|
||||||
|
- [6.3 Hash Algorithm](https://www.hello-algo.com/en/chapter_hashing/hash_algorithm/)
|
||||||
|
- [6.4 Summary](https://www.hello-algo.com/en/chapter_hashing/summary/)
|
||||||
@ -0,0 +1,51 @@
|
|||||||
|
---
|
||||||
|
comments: true
|
||||||
|
---
|
||||||
|
|
||||||
|
# 6.4 Summary
|
||||||
|
|
||||||
|
### 1. Key Review
|
||||||
|
|
||||||
|
- Given an input `key`, a hash table can retrieve the corresponding `value` in $O(1)$ time, which is highly efficient.
|
||||||
|
- Common hash table operations include querying, adding key-value pairs, deleting key-value pairs, and traversing the hash table.
|
||||||
|
- The hash function maps a `key` to an array index, allowing access to the corresponding bucket to retrieve the `value`.
|
||||||
|
- Two different keys may end up with the same array index after hashing, leading to erroneous query results. This phenomenon is known as hash collision.
|
||||||
|
- The larger the capacity of the hash table, the lower the probability of hash collisions. Therefore, hash table resizing can mitigate hash collisions. Similar to array resizing, hash table resizing is costly.
|
||||||
|
- Load factor, defined as the ratio of the number of elements to the number of buckets in the hash table, reflects the severity of hash collisions and is often used as a trigger for resizing the hash table.
|
||||||
|
- Chaining addresses hash collisions by converting each element into a linked list, storing all colliding elements in the same list. However, excessively long lists can reduce query efficiency, which can be improved by converting the lists into red-black trees.
|
||||||
|
- Open addressing handles hash collisions through multiple probes. Linear probing uses a fixed step size but cannot delete elements and is prone to clustering. Multiple hashing uses several hash functions for probing, making it less susceptible to clustering but increasing computational load.
|
||||||
|
- Different programming languages adopt various hash table implementations. For example, Java's `HashMap` uses chaining, while Python's `dict` employs open addressing.
|
||||||
|
- In hash tables, we desire hash algorithms with determinism, high efficiency, and uniform distribution. In cryptography, hash algorithms should also possess collision resistance and the avalanche effect.
|
||||||
|
- Hash algorithms typically use large prime numbers as moduli to ensure uniform distribution of hash values and reduce hash collisions.
|
||||||
|
- Common hash algorithms include MD5, SHA-1, SHA-2, and SHA-3. MD5 is often used for file integrity checks, while SHA-2 is commonly used in secure applications and protocols.
|
||||||
|
- Programming languages usually provide built-in hash algorithms for data types to calculate bucket indices in hash tables. Generally, only immutable objects are hashable.
|
||||||
|
|
||||||
|
### 2. Q & A
|
||||||
|
|
||||||
|
**Q**: When does the time complexity of a hash table degrade to $O(n)$?
|
||||||
|
|
||||||
|
The time complexity of a hash table can degrade to $O(n)$ when hash collisions are severe. When the hash function is well-designed, the capacity is set appropriately, and collisions are evenly distributed, the time complexity is $O(1)$. We usually consider the time complexity to be $O(1)$ when using built-in hash tables in programming languages.
|
||||||
|
|
||||||
|
**Q**: Why not use the hash function $f(x) = x$? This would eliminate collisions.
|
||||||
|
|
||||||
|
Under the hash function $f(x) = x$, each element corresponds to a unique bucket index, which is equivalent to an array. However, the input space is usually much larger than the output space (array length), so the last step of a hash function is often to take the modulo of the array length. In other words, the goal of a hash table is to map a larger state space to a smaller one while providing $O(1)$ query efficiency.
|
||||||
|
|
||||||
|
**Q**: Why can hash tables be more efficient than arrays, linked lists, or binary trees, even though they are implemented using these structures?
|
||||||
|
|
||||||
|
Firstly, hash tables have higher time efficiency but lower space efficiency. A significant portion of memory in hash tables remains unused.
|
||||||
|
|
||||||
|
Secondly, they are only more efficient in specific use cases. If a feature can be implemented with the same time complexity using an array or a linked list, it's usually faster than using a hash table. This is because the computation of the hash function incurs overhead, making the constant factor in the time complexity larger.
|
||||||
|
|
||||||
|
Lastly, the time complexity of hash tables can degrade. For example, in chaining, we perform search operations in a linked list or red-black tree, which still risks degrading to $O(n)$ time.
|
||||||
|
|
||||||
|
**Q**: Does multiple hashing also have the flaw of not being able to delete elements directly? Can space marked as deleted be reused?
|
||||||
|
|
||||||
|
Multiple hashing is a form of open addressing, and all open addressing methods have the drawback of not being able to delete elements directly; they require marking elements as deleted. Marked spaces can be reused. When inserting new elements into the hash table, and the hash function points to a position marked as deleted, that position can be used by the new element. This maintains the probing sequence of the hash table while ensuring efficient use of space.
|
||||||
|
|
||||||
|
**Q**: Why do hash collisions occur during the search process in linear probing?
|
||||||
|
|
||||||
|
During the search process, the hash function points to the corresponding bucket and key-value pair. If the `key` doesn't match, it indicates a hash collision. Therefore, linear probing will search downwards at a predetermined step size until the correct key-value pair is found or the search fails.
|
||||||
|
|
||||||
|
**Q**: Why can resizing a hash table alleviate hash collisions?
|
||||||
|
|
||||||
|
The last step of a hash function often involves taking the modulo of the array length $n$, to keep the output within the array index range. When resizing, the array length $n$ changes, and the indices corresponding to the keys may also change. Keys that were previously mapped to the same bucket might be distributed across multiple buckets after resizing, thereby mitigating hash collisions.
|
||||||
File diff suppressed because one or more lines are too long
Loading…
Reference in new issue