I would perhaps add to Joe's answer in suggesting that although in theory you may not need to know HTML to use a 'What you see is what you get editor' it can make life a lot easier if you have some idea of how it works. Although I use Expression Web I did trial a freebie known as Sea Monkey which was quite hopeless in comparison, others may be better but I haven't tried them. If you use a hosting company that offers cPanel as its site management software then that comes with it's own HTML and plain text editor, however, the former is no better than Sea Monkey and you can end up with pages on the site that differ from those on your PC which can get confusing and drain the enthusiasm to put it politely. Another problem with HTML is that it is only just the start, there are Frames, Tables and of course CSS which is now regarded as the proper way of doing things but Tables can be so quick to put together once the idea for the layout has gelled.
However you create the pages it is still only part of the job for you will then need to upload them to the server and check them over various browser and operating systems to ensure they work as intended. Using a CMS application as you already do is much the easier method although it is limited in flexibility. I don't know about your version of PS but CS does have a facility for creating a web gallery automatically although again you are faced with getting onto onto the net once built, and they look a bit dated to be honest. Example here - 57th Chapter
There are other CMS gallery options like Coppermine but you still need a hosting package, domain name and then install by creating a database, unzipping the download file and so on and on. I use Coppermine for snapshots but I don't consider it ideal for art orientated photography at all. Here's what I mean www.tipperarymotorspeedway.ie gallery/
. Wordpress, Joomla, Drupal also have gallery plug ins but to be honest these can be as demanding as a bit of simple HTML and you still need a hosting package.
Putting a website together can be a big step, I was messed about by three so called 'professional designers' (one of whom is known to us both) so sat down and taught myself. I'm now upping my skills with a course and will probably take it further still as it does attract an odd Euro or two, unlike the photography!