Permit 'listen =' directive to either be specified multiple times, adding its effects to permit multiple addresses, specifically 'listen = *' and 'listen = []' or perhaps to permit multiple space separated arguments, to permit 'listen = * []'.
Also, allow different configurations for each IP so that multiple SSL certificates can be used.