I started the novel on the day the drama released, and completed it before starting the drama. And today I completed the drama, and my conclusion is that it is very different from the book. At first I was disconcerted by the differences but I eventually changed my mindset to see the drama as simply being 'inspired' by the novel. That way, I got to enjoy them both without constantly distracting myself with the gaping differences. I'm now eagerly looking forward to part two of the drama.
A spoiler on whether novel JCY had a concubine:
Jiang Changyang did take a concubine in the book but it was in name only. You could say, technically, Mudan got a concubine on his behalf, lol. Mudan was going through some difficulty (all instigated by that rotten Liu Chang) at a time when both her father (and a couple of her brothers) and JCY were out of town, and this woman helped her in some way and wanted the favor returned. She worked in a high-profile brothel (or a gambling house or some such place, can't remember the exact details) and wanted to be redeemed, and insisted that JCY should be the one to do it. Mudan agreed to the favor, and JCY redeemed the woman when he returned. It was all lowkey (but the Emperor did find out, IIRC). She never lived with them but relocated to the hometown of JCY's mother and stepfather.