Obesity and its related metabolic disorders have become prevalent and fatal, which are faced by the entire human beings since decades. An energy equilibrium is urgently important for human metabolic health, which requires the participation of multiple organs, such as adipose tissues, liver and skeletal muscles. It seems that both sex and age play a role in the above processes. In this review, we focus on the sexual dimorphism in energy metabolism mediated by adipose tissues, including white and thermogenic (brown/beige) adipose tissues. Remarkably, past investigations have focused on targeting brown/beige adipose tissues to combat obesity because of their contributions to non-shivering thermogenesis. However, sex differences in the regulation of adipose tissue metabolism are likely overlooked. Particularly, increasing data show that males display more visceral fat than females, and females show increased visceral fat after menopause. Visceral adiposity is more deleterious and closely related to metabolic disorders, such as cardiovascular diseases. In this review, we discuss current findings on sexual dimorphism in WAT and BAT biology for a better metabolic balance in humans.