Using a variable resistor to dim an LED

My question is this: Can I use a variable resistor to control the brightness of an LED?

I was originally planning on using a potentiometer and an MCU to control the brightness with PWM, but that'd be a bit more difficult :). So, could I just connect the LED straight to my batteries through a variable resistor to control the brightness?