6 · Asymptotic notation: O, Ω, Θ
Big-O, Omega and Theta: choosing c and n0 and writing the proof.
In one sentence
, and compare how fast functions grow for large , ignoring constant factors and small inputs. is "at most", is "at least", and is "exactly, up to constants".
Everyday analogy
Speed limits on a motorway. "" is like "this car never goes faster than the speed limit , once it's on the motorway (after )". "" is a minimum speed. "" means the car stays between a minimum and a maximum, so it is "in the same lane" as . What happens in the car park before the motorway (small ) doesn't count.
Definitions
| Notation | Means | Formal definition: there exist positive constants… |
|---|---|---|
| grows no faster than | with for all | |
| grows at least as fast as | with for all | |
| same growth rate | with for all | |
| strictly slower (an upper bound that is not tight) | for every there is an … | |
| strictly faster | for every … |
Careful with little-o
The Lecture07 notation slide (Slide 6) calls a "tight upper bound". CLRS defines as an upper bound that is not tight (, but ). Use the CLRS meaning, and check with your instructor if an exam question depends on it.
Growth ladder (each grows strictly slower than the next):
Limit shortcut (for intuition and checking, not a replacement for a c/n₀ proof when one is asked): if is , then ; if it is a constant , then ; if it is , then .
Watch the ladder pull apart
| 10 | 3.3 | 10 | 33 | 100 | 1 024 |
| 100 | 6.6 | 100 | 664 | 10 000 | |
| 1 000 | 10 | 1 000 | 9 966 | 1 000 000 |
What looks like: take and .
| 1 | 3 | 5 | 6 | 7 | 8 | 10 | 100 | |
|---|---|---|---|---|---|---|---|---|
| 10 | 16 | 22 | 25 | 28 | 31 | 37 | 307 | |
| 4 | 12 | 20 | 24 | 28 | 32 | 40 | 400 | |
| ? | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ |
Before , is bigger, and that's allowed. From on, stays under forever, so .
= sandwich: . is trapped between two scaled copies of .
Common mistakes
- Picking first, then a that only works for a different . State both and check them.
- Thinking means "tight". is true, just not useful. Use when you mean tight.
- Dropping a negative term in a lower bound, which makes bigger, not smaller.
- Writing . Simplify to .
- The little-o slide wording (see the warning above).
Mastery check
Solve without hints, then explain
(a) Prove with explicit .
(b) Prove .
(a) Lower: for all , so . Upper: and for , so and . .
(b) Suppose for . For , , so , i.e. for all large , a contradiction ∎
Status
Tick all six steps to unlock “Mastered”.
Which study mode worked for you?
See it move
- Desmos: plot and and see them cross at .
References
- Lecture07 Asymptotic Analysis: Slides 2–4 (growth classes), 6 (notation overview), 7–13 (Big-O and examples), 14–18 (Ω), 19–24 (Θ), 25 (when Θ isn't possible).
- CLRS 4e Ch 3: §3.1 (O, Ω, Θ intuition), §3.2 (formal definitions, o and ω), §3.3 (standard functions).