Recreational Mathematics Club

Discussion #5
  
Matroids
  

Speaker: Mahek Shamsukha

Indian Institute of Science

1 Examples and Motivation

We begin with three different notions of independence arising from linear algebra, graph theory, and matching theory. Remarkably, all three examples give rise to exactly the same collection of independent sets.

Example 1.
Linear Independence.

Consider the vectors a,b,c,d,e,f 3 shown below.

abcdef

A subset of E = {a,b,c,d,e,f} is called independent if the corresponding vectors are linearly independent. The maximal independent sets are

{a,b,c},  {a,b,d},  {a,b,e},  {a,c,d},  {a,c,e}.

Hence the independent sets are exactly all subsets of these five sets. For example, {a,b,d} is independent, while {b,c,d,e} is dependent. Any set containing f together with three nonzero vectors is dependent since f = 0.

Example 2.
Acyclic Edge Sets.

Consider the graph below with edge set E = {a,b,c,d,e,f}.

abcdef

A subset of edges is independent if it contains no cycle. The maximal independent sets are again

{a,b,c},  {a,b,d},  {a,b,e},  {a,c,d},  {a,c,e}.

These are precisely the spanning trees of the graph. For example, {a,b,d} is independent, while {b,c,d} is dependent since it forms a cycle. Any set containing the loop f is dependent.

Example 3.
Matchings / Systems of Distinct Representatives.

Consider the bipartite graph below.

123abcdef

Define

A1 = {a},    A2  = {a,b,c},     A3 = {a,b,c,d,e}.

A subset of E = {a,b,c,d,e,f} is called independent if it admits a system of distinct representatives, or equivalently, if it can be saturated by a matching. The maximal independent sets are once again

{a,b,c},  {a,b,d},  {a,b,e},  {a,c,d},  {a,c,e}.

For example, {a,c,d} is independent since we can match a 1, c 2, d 3. However, {b,c,d} is dependent because all three sets are contained in {2,3}, so Hall’s condition fails. The element f is dependent by itself since it has no neighbour.

Thus, although the three examples come from very different areas of mathematics, they define exactly the same family of independent subsets of E = {a,b,c,d,e,f}. This common abstract structure is called a matroid.

2 Hereditary Set Systems

Definition 2.1. Let E be a finite set and let ℱ ⊆ 2E. The pair (E,) is a hereditary set system if

            ′           ′
∀A  ∈ ℱ , ∀A ⊆ A  =⇒  A  ∈ ℱ .

Example 2.2. The following are hereditary set systems.

1.
Let G = (V,E) be a graph and = {F E : F contains no cycle}.
2.
Let G = (V,E) be a graph and = {M E : M is a matching}.
3.
Let G = (V,E) be a graph and = {S V : S induces a clique}.
4.
Let G = (V,E) be a graph and = {S V : S is an independent set}.
5.
Let E = {1,…,n} and fix an integer k. Define = {S E : |S|≤ k}.
6.
Let E = {1,…,n} and define = {S E : iSi 10}.

However, this need not be a matroid. For example, {10},{4,5}∈ℱ with |{10}| < |{4,5}|, yet neither {10,4} nor {10,5} belongs to , so the exchange property fails.

3 Matroids

Definition 3.1. A matroid is a pair M = (E,), where E is a finite set and ℐ⊆ 2E is a collection of independent sets, satisfying:

(i)
∅∈ℐ.
(ii)
If I ∈ℐ and I′⊆ I, then I′∈ℐ.
(iii)
(Exchange axiom) If I1,I2 ∈ ℐ and |I1| < |I2|, then there exists e I2 I1 such that I1 ∪{e}∈ℐ.

Example 3.2. Let

    (          )
A =  1  0  1  1  ,
     0  1  1  2

and let E = {1,2,3,4}, where element i corresponds to the i-th column of A. Define to consist of those S E for which the columns indexed by S are linearly independent.

Then (E,) is a matroid. For example, {1,2}, {1,4}, and {2,3} are independent, while {1,2,3} is dependent. For instance:

( )    ( )   (  )
 1  =   1  +   0
 1      0      1

Proposition 3.3. Let A be a matrix with column set E, and let = {S E : S is linearly independent}. Then (E,) is a matroid.

Proof. We verify the matroid axioms.

(i)
∅∈ℐ.
(ii)
Every subset of a linearly independent set is linearly independent.
(iii)
Let I1,I2 ∈ ℐ with |I1| < |I2|. If every e I2 I1 satisfies I1 ∪{e}∈∕, then every column in I2 I1 lies in span(I1), so span(I2) span(I1), giving |I2| = dim(span(I2)) dim(span(I1)) = |I1|, a contradiction. □

4 Bases

Definition 4.1. A set B ∈ℐ is a basis of a matroid M = (E,) if it is maximal with respect to inclusion, i.e. B ∪{e}∕∈for all e E B.

Proposition 4.2. All bases of a matroid have the same cardinality.

Proof. Let B1,B2 be bases with |B1| < |B2|. By the exchange axiom there exists e B2 B1 such that B1 ∪{e}∈ℐ, contradicting the maximality of B1. □

Theorem 4.3. Let ℬ⊆ 2E be a nonempty collection of subsets of E. Then is the collection of bases of a matroid if and only if:

(i)
|B1| = |B2| for all B1,B2 ∈ℬ.
(ii)
For all B1,B2 ∈ℬ and e B1 B2, there exists f B2 B1 such that (B1 ∖{e}) ∪{f}∈ℬ.

Proof. () If is the collection of bases of a matroid, all bases have the same size by the preceding proposition, and the exchange property follows from the matroid axioms.

() Define

ℐ = {I ⊆ E  : I ⊆ B for some B ∈ ℬ}.

Clearly is hereditary. We verify the exchange axiom. Let I1,I2 ∈ ℐ with |I1| < |I2|, and suppose for contradiction that I1 ∪{e}∈∕for every e I2 I1.

Choose B1 I1 and B2 I2 in . Applying the basis exchange property repeatedly, we replace elements of B2 (B1 I2) by elements of B1 B2, obtaining a new basis B2 with B2 B1 = I2 B1. Our assumption implies I2 B1 = I2 I1 (if there existed e (I2 B1) I1 then I1 ∪{e}⊆ B1 would give I1 ∪{e}∈ℐ, a contradiction). Hence

|B2 ∖B1 | = |I2 ∖I1| > |I1 ∖I2| ≥ |B1 ∖B2 |,

contradicting |B1| = |B2|. □

Example 4.4. Let G = (V,E) be a graph and be the collection of spanning forests of G.

(i)
All spanning forests have the same size |V |−c(G), where c(G) denotes the number of connected components.
(ii)
Let F1,F2 ∈ℬ and e F1 F2. Removing e from F1 splits one tree into two components A and B. Since F2 is a spanning forest, there must exist f F2 F1 with one endpoint in A and the other in B; then (F1 ∖{e}) ∪{f} is again a spanning forest.

Hence the spanning forests of G form the bases of a matroid whose independent sets are exactly the acyclic edge subsets of G.

Example 4.5 (Uniform Matroids). Let E be a finite set and k a nonnegative integer. The pair

(E, ℐ )  with   ℐ = {S ⊆ E : |S| ≤ k}

is a matroid, called the uniform matroid Uk,E.

Example 4.6 (Transversal Matroids). Let A1,…,Am E. A subset S E is independent if it admits a system of distinct representatives from A1,…,Am. The resulting matroid is called a transversal matroid.

5 Greedy Algorithm

Let (E,) be a hereditary set system and w : E a weight function. We assume access to an independence oracle: given S E, we can determine whether S ∈ℐ.

Algorithm 1: Greedy(E,w,)
1:   Input: Finite set E, weight function w : E , independence oracle for
2:   Output: A maximum-weight maximal independent set S ∈ℐ
3:   Sort E = {e1,…,en} so that w(e1) w(e2) ⋅⋅⋅w(en)
4:   S ←∅
5:   for i 1 to n do
6:    if S ∪{ei}∈ℐ then
7:    S S ∪{ei}
8:    end if
9:   end for
10:   return S

Theorem 5.1. Let (E,) be a hereditary set system with . Then

(E,ℐ) is a matroid ⇐ ⇒ ∀ w : E → ℝ,   w(Greedy  (E,w, ℐ)) = max {w(I) : I ∈ ℐ, I maximal }.

Proof. () Assume (E,) is a matroid. Call Y ∈ℐ good if it is contained in some maximum-weight basis. We show that if Y is good and the greedy algorithm next selects x E Y , then Y ∪{x} is also good.

Let B be a maximum-weight basis with Y B. If x B, then Y ∪{x}⊆ B and we are done. Suppose x∕∈B.

Case 1: |B| = |Y ∪{x}|, so Y ∪{x} is itself a basis. Since greedy chose x as the heaviest element extendable from Y , w(x) w(e) for all e B Y , hence w(Y ∪{x}) w(B). As B is maximum-weight, Y ∪{x} is also a maximum-weight basis.

Case 2: |B| > |Y ∪{x}|. Extend Y ∪{x} to a basis Busing elements of B; then Y ∪{x} ⊆ B′ ⊆ B ∪{x}. Since |B′| = |B|, we have B= (B ∪{x}) ∖{x′} for some x′ ∈ B Y . Because greedy selected x before x, w(x) w(x), so w(B) = w(B) w(x) + w(x) w(B). Hence Bis a maximum-weight basis containing Y ∪{x}.

() Suppose the greedy algorithm is optimal for every weight function w : E . Assume for contradiction that there exist I1,I2 ∈ℐ with |I1| < |I2| and I1 ∪{e}∕∈for all e I2 I1.

Choose 𝜀 satisfying

|I1|−-|I2-∩I1| < 𝜀 < 1,
|I2|− |I2 ∩I1|

and define w : E by

       (
       |{1   e ∈ I1,
w(e) =  𝜀   e ∈ I2 ∖ I1,
       |(0   otherwise.

The greedy algorithm selects all of I1 first and, by assumption, cannot add any element of I2 I1, so w(SG) = |I1|. Extending I2 to a maximal independent set I2gives

w(I′) ≥ |I ∩ I |+ 𝜀|I ∖I | > |I | = w (S ),
   2     1   2     2   1     1       G

contradicting optimality. Hence the exchange axiom holds and (E,) is a matroid. □

6 Representable and Graphic Matroids

Definition 6.1. A matroid M = (E,) is representable over a field 𝔽 if there exists a matrix A over 𝔽 with columns indexed by E such that S E is independent in M if and only if the corresponding columns of A are linearly independent.

Definition 6.2. Let G = (V,E) be a graph. The graphic matroid of G is the matroid whose independent sets are the acyclic subsets of E.

Theorem 6.3. Every graphic matroid is representable over .

Proof. Let V = {v1,…,vn}. Orient each edge of G arbitrarily, and construct A V ×E by setting, for each edge e = (u,v) directed from u to v, the column ce to have +1 in row u, 1 in row v, and 0 elsewhere.

We claim that a set of edges is linearly independent if and only if it is acyclic. If e1,…,ek form a cycle, orienting it cyclically yields ce1 + ⋅⋅⋅ + cek = 0, so the columns are dependent. Conversely, if the edge set contains no cycle then each component is a tree; repeatedly removing a leaf shows inductively that all columns are linearly independent. □

Definition 6.4. A matroid is regular if it is representable over every field.

Remark 6.5. The proof above works over any field (replace 1 by the additive inverse of 1), so every graphic matroid is regular.

Example 6.6 (Uniform Matroids). The uniform matroid Uk,n is representable over sufficiently large fields. For instance, U2,4 is represented over by

(          )
 1  0  1  1
 0  1  1  2  ,

since every pair of columns is linearly independent. More generally, over an infinite field, choose n distinct points on the moment curve (1,t,t2,…,tk1); any k corresponding columns are linearly independent.

Example 6.7. Uniform matroids need not be regular. U2,4 would require four nonzero vectors in 𝔽22 such that every pair is linearly independent, but 𝔽22 contains only three nonzero vectors: (1,0), (0,1), (1,1). Hence U2,4 is not representable over 𝔽2.

7 Restriction and Union of Matroids

7.1 Restriction

Let M = (E,) be a matroid and A E. The restriction of M to A is

M |A = (A, ℐ|A),    ℐ |A =  {I ∈ ℐ : I ⊆ A }.

Theorem 7.1. M|A is a matroid on ground set A.

Proof. Non-emptiness: ∅∈ℐ and ∅⊆ A, so ∅∈ℐ|A. Hereditary property: If I ∈ℐ|A and J I, then J ∈ℐ and J A, so J ∈ℐ|A. Exchange property: Let I,J ∈ℐ|A with |I| < |J|. Since is a matroid, there exists e J I with I ∪{e}∈ℐ. As I,J A we have e A, so I ∪{e}∈ℐ|A. □

7.2 Union

Let M1 = (E,1) and M2 = (E,2) be matroids on the same ground set E, and define

ℐ = {I1 ∪I2 : I1 ∈ ℐ1, I2 ∈ ℐ2}.

Theorem 7.2 (Edmonds’ Matroid Union Theorem). (E,) is a matroid. More generally, the union of finitely many matroids on E is a matroid.

Remark 7.3. The set-theoretic union 1 ∪ℐ2 of two independence families is not necessarily a matroid; the correct construction is the family of unions of independent sets as defined above.

Example 7.4 (Partition Matroid). Let E = E1 E2 ⋅⋅⋅Ek and fix integers 0 ri ≤|Ei|. Call I E independent if |I Ei|≤ ri for all i. The resulting matroid is called a partition matroid.

For example, let E = {a,b,c,d,e,f}, E1 = {a,b}, E2 = {c,d,e,f}, r1 = 1, r2 = 2. Then {a,c,d} is independent, while {a,b,c} is not.

A partition matroid arises by taking the uniform matroid Uri,E for each block, restricting it to Ei, and forming the union of these restricted matroids — so it is indeed a matroid by the preceding results.

References

[1]   J. G. Oxley, Matroid Theory, 2nd ed. Oxford University Press, 2011. Available at https://www.math.ens.psl.eu/~benoist/refs/Oxley.pdf.

[2]   M. X. Goemans (lecturer), B. E. Tenner (scribe), 18.997 Topics in Combinatorial Optimization, Lecture 9: Matroids. MIT OpenCourseWare, Spring 2004. https://ocw.mit.edu/courses/18-997-topics-in-combinatorial-optimization-spring-2004/e93e0010583c4d9de9ee306b4cfee4e4_co_lec9.pdf.

[3]   M. X. Goemans (lecturer), N. Immorlica (scribe), 18.997 Topics in Combinatorial Optimization, Lecture 10: Matroid Representation and Optimization. MIT OpenCourseWare, Spring 2004. https://ocw.mit.edu/courses/18-997-topics-in-combinatorial-optimization-spring-2004/6faef8afbcaec34e49dd0dab12611e0f_co_lec10.pdf.

[4]   A. Rai, Lecture 13: Matroids. IIT Delhi, Course Lecture Notes. https://web.iitd.ac.in/~raiashutosh/Courses/lectures/lec13.pdf.

[5]   F. Ardila, Lecture 1 – Matroids [video lecture]. San Francisco State University / Universidad de Los Andes, 2007. https://www.youtube.com/watch?v=pe5MaEugAwg.

[6]   F. Ardila, Lecture 4 – Matroids: Greedy Algorithm [video lecture]. San Francisco State University / Universidad de Los Andes, 2007. https://www.youtube.com/watch?v=H4DoReLpGQk.

[7]   Lecture 15 – Paraterized Complexity: Introduction to Matroids [video lecture]. July 2020. https://www.youtube.com/watch?v=H4DoReLpGQk.

[8]   L. Fajardo Gomez, Introduction to Matroids [video lecture]. July 2020. https://www.youtube.com/watch?v=SljIEkfzloA.