This paper highlights the significance of labor market distortions in explaining cross-country income differences using a two-sector general equilibrium model that incorporates modern intermediate inputs used in agriculture together with sector-specific human and physical capital. Using the best available information, I construct new sectoral data on quality-adjusted human capital and PPP-adjusted physical capital. Although both types of capital - physical capital in particular - play important roles, using a sample of 43 countries, I find that in terms of capturing the observed disparities, either in relative labor productivity in agriculture or aggregate output per worker between the rich and the poor countries, the role of labor market distortions outweighs the role of either sectoral human or physical capital.