Options are good.
When I want to sit down and write without distractions, I use a dumb terminal.
The computer I'm typing this on right now is a nearly 17 year old HP Pavillion laptop running Slackware-stable. Alongside its stock screen, it has a much larger display (usually in portrait), and an IBM 3151 + Model M keyboard plugged into a serial port. I simply login to the 3151 as "writer", and instead of a friendly shell prompt I'm greeted with an empty vi document. All I need to do is start typing. It's the fastest way I know to get my thoughts into a computer ... and with zero distractions. If needs be, I can save the text & re-open it later in a word processor to make it look pretty.
I have the GUI right next to the dumb terminal ... but there is nothing stopping me running a wire to the next available space to remove the distraction. Or even into the next room, for that matter (and I do, sometimes). Obviously email, Usenet, FTP, etc. are still available on a dumb terminal, and I can shell out of vi and run links or lynx for text-only WWW browsing, so a little self-discipline is needed to ignore the distractions ... but honestly, once I start typing I don't think about the outside world.
I'm not suggesting this solution is right for everybody, but try it, you might like it. vi is not for everybody, either ... so use your text editor of choice as your shell instead ... or simply login to a more standard shell and then fire up your editor of choice.