The structure of the complex zeolite IM-5 (Cmcm, a = 14.33(4) Å, b = 56.9(2) Å, c = 20.32(7) Å) was determined by combining selected area electron diffraction (SAED), 3D reconstruction of high resolution transmission electron microscopy (HRTEM) images from different zone axes and distance least squares (DLS) refinement. The unit cell parameters were determined from SAED. The space group was determined from extinctions in the SAED patterns and projection symmetries of HRTEM images. Using the structure factor amplitudes and phases of 144 independent reflections obtained from HRTEM images along the ,  and  directions, a 3D electrostatic potential map was calculated by inverse Fourier transformation. From this 3D potential map, all 24 unique Si positions could be determined. Oxygen atoms were added between each Si–Si pair and further refined together with the Si positions by distance-least-squares. The final structure model deviates on average 0.16 Å for Si and 0.31 Å for O from the structure refined using X-ray powder diffraction data. This method is general and offers a new possibility for determining the structures of zeolites and other materials with complex structures.