Hi,
Well done for wanting to give it a go yourself. It's the way I first learnt... but I didn't have any money so downloaded a 30-day trial version of Claris Homepage (not sure they even make it now) and learnt on that.
One thing I would suggest is to use software which, like Dreamweaver (which I, personally think is simple to use), shows you the preview and the html code in the same view - this is how I learnt to recognise what the individual HTML tags were doing at each stage.
Another thing you need to be aware of is the issue of browser compatibility and your site's 'usability' (ease of use), ie. will your site work on visitors using MS Internet Explorer, Firefox, Opera, Konqueror, Netscape, etc, etc. Then will it work on MS IE on Mac and PC, on Firefox on Mac and PC... and so.
With regard to 'useability', it's about where people are used to finding things on a website and how easy it is to find the information they want from your site, without having to press 5 links to get there.
It's about the contrast of your text (foreground) colour on the background - can people read it easily? Is your site accessible to people with poor visibility: ie, are your fonts given in % or ems, so that your visitors can easily resize the text. Have you used standard fonts that your visitors will have loaded on their pcs/Macs - there are standard fonts web designers use, such as Verdana, Arial, "Trebuchet MS", etc, as these are loaded on most computers today. Will people be able to browse your site using their keyboard keys...
Then, of course, as someone else mentioned, there's the SEO aspect. Making sure you have your meta tags, entering alt descriptions for images (also necessary for people who have images turned off in their browers) is another... and all the tricks that go with getting your site higher up on search engine results.
... there's a lot involved, but there's no harm in learning yourself if you're willing to do some research first.
Haven't tried it myself, but you could try something like nvu(dot)com for PC - it's free (I think) and runs on Windows, Linux, and Mac.
Have fun.
Cheers,
Tracy
Freelancealot.co.uk