The geometric phase of a bi-particle model is discussed. One can drive the system to evolve by applying an external magnetic field, thereby controlling the geometric phase. The model has degenerate lowest-energy eigenvectors. The initial state is assumed to be the linear superposition or mixture of the eigenvectors. The relationship between the geometric phase and the structures of the initial state is considered, and the results are extended to a more general model.