A battery module cooling structure includes: a battery module fixed to a vehicle body; and a cooling block disposed under the battery module and configured to reduce heat generated by the battery module. The cooling block includes: an upper panel closing an upper portion of the cooling block, the upper panel having corner regions including an inlet hole configured to take in cooling water and an outlet hole configured to discharge the cooling water; a lower panel spaced downward from the upper panel and closing a lower portion of the cooling block; an inlet pipe coupled to an upper portion of the upper panel, and configured to take in the cooling water; and an outlet pipe coupled to the upper portion of the upper panel at a position spaced apart from the inlet pipe, and configured to discharge the cooling water.