An exposition of Vassiliev invariants is given in terms of the simplest approach to the functional integral construction of link invariants from Chern-Simons theory. This approach gives the top row evaluations of Vassiliev invariants for the classical Lie algebras, and a neat point of view on the results of Bar-Natan. It also clarifies the relation between Vassiliev invariants and the extension of the bracket invariant to links with transverse double points that appears in the work of Bruegmann, Gambini and Pullin on the loop representation of quantum gravity. We see that the Vassiliev vertex is not just a transversal intersection of Wilson loops, but rather has the structure of Casimir insertion (up to first order of approximation) coming from the difference formula in the functional integral. (Figures are available from the author.)