Gas bubbles generated by the hydrogen evolution reaction and oxygen evolution reaction during water electrolysis influence the energy conversion efficiency of hydrogen production. Here, we survey what is known about the interaction of gas bubbles and electrode surfaces and the influence of gas evolution on practicable devices used for water electrolysis. We outline the physical processes occurring during the life cycle of a bubble, summarize techniques used to characterize gas evolution phenomena in situ and in practical device environments, and discuss ways that electrodes can be tailored to facilitate gas removal at high current densities. Lastly, we review efforts to model the behavior of individual gas bubbles and multiphase flows produced at gas-evolving electrodes. We conclude our review with a short summary of outstanding questions that could be answered by future efforts to characterize gas evolution in electrochemical device environments or by improved simulations of multiphase flows.