[input-output-hk/cardano-sl] [CBR-389] Don’t construct WalletAddress IxSet (#3439)

Will take a look at this test failure.