Increasing evidence suggests that the gut may influence the host's metabolism and ultimately change the outcomes of type 2 diabetes mellitus (T2DM). We review the evidence on the relationship between the gut and T2DM remission after gastric bypass surgery, and discuss the potential mechanisms underlying the above relationship: gut anatomical rearrangement, microbial composition changes, altered gut cells, and gut hormone modulation. However, the exact changes and their relative importance in the metabolic improvements after gastric bypass surgery remain to be further clarified. Elucidating the precise metabolic mechanisms of T2DM resolution after bypass surgery will help to reveal the molecular mechanisms of pathogenesis, and facilitate the development of novel diagnoses and preventative interventions for this common disease.