So we got up at 4.30 and our tour group was taken to the site. It was completely packed out - thousands of people liking the lake to get a photo of the temple with the sunrise. Then there were heaps of people trying to sell us all sorts of junk and they were relentless.
Honestly, it was gorgeous but the sunrise part was a bit overrated. Get those few extra hours of sleep and enjoy the temple early in the morning when the sun is already up.