Disclamer my advice is based purely on my subjective opinion of what I like in a sunset photo, and the experiences in solving a similar problem I had in my sunset photos.
TL;DR version
For a more dramatic sunset image out of the two: the darker one is more dramatic, you can also warm up the color temperature for more brilliant red, and maybe add some Clarity/Contrast. If you're serious about getting really good sunset photos, exposing to the right and more nuanced post-processing may be needed (read on).
Full answer
I think that there are two separate aspects to exposure that have been conflated:
1) exposing in camera
Regarding in camera exposure, if you aim to post-process your images you should almost always try to expose to the right in digital photography (see StephanG or Itai's answers) and use RAW for high contrast scenes (like sunsets), because this will give you the most post-processing flexibility. If you do not want to post-process your sunset images, than what I usually do is underexpose by about 1.5-2.5 stops (this increases perceived saturation and stops highlights from overly blowing out) and setting white balance to cloudy or shade- this will give you a more intense red instead of the quite pale yellow-orange-blue sky. The white balance in sunset photos, usually gives more of a dramatic effect than the exposure.
2) "exposure" adjustment in an image processing software
If you are only going to play around with the exposure adjustment, it's probably OK just to expose in camera and skip this step. If, however, you want a more polished look: visible details in silhouettes/shadows, more "dramatic" contrast, selective color saturation, increased local or micro-contrast etc. you should expose to the right, shoot raw and use some kind of post processing software. Learning a couple post processing tools (adjusting hue/saturation/value/contrast or better: manipulating color curves) and strategies (for example learning about the Ansel Adam's zone system, and/or Munsell Color System) will allow you to achieve the look you are after more easily and consistently, but the latter can be a bit time intensive.
General tips for sunset photography Sunset colors are more brilliant when there are large particles in the air (in high humidity, after a storm, during high air pollution). Capturing the "second sunset" (around 10-15 minutes after the regular sunset) can give more even illumination to the sky (this reduces blown out highlights, and makes the whole sky look wonderfully colorful), and gives more color to the clouds. High altitude clouds can give a more dramatic effect especially when patterned, because of the way they scatter and reflect the sunlight.