How about using fruits to infuse the water? Can try using citrus fruits like orange and lemon, might improve the taste and make it more palatable. I craved for sour stuff early in first tri.
Nothing to do with taste of the water but I also drank more using a tumbler with a straw, as compared to using a bottle.