Understanding electron-phonon coupling in bismuth-based semiconductors