pastry cream (rather like a custard) has to be flavoured with pairings that are strong in flavour (chocolate, coffee?) and/or heavy in volume (fruits), or use a flavour that enhances the original custardly taste (ie. liquour)
adding a bit of whipped cream made from heavy cream should lighten the pastry cream and make it less voluminous.
consequently, lighter creams go well with softer flavours, often more tangy, light, and refreshing (citrus, tea, herbs/flowers)
perhaps,
the weight (physical and taste) of the flavouring has to match that of the cream base