We show that the equilibrium of a matching and bargaining model of a market in which there is a finite number of agents at each date need not be near the equilibrium of a market with a continuum of agents, although matching probabilities are the same in both markets. Holding the matching process fixed, as the finite market becomes large its equilibrium approaches the equilibrium of its continuum limit.