Yes, before you do anything make sure you have your plan and identity secured. So presuming you have a strategy, idea of the service you want to provide, and what you're looking to achieve, and have a name for your business - secure that name and get started by registering the relevant domain name and getting some hosting. Many hosts provide a free domain with their hosting packages, and for now you can just start with a basic package.
A good medium sized host should be able to advise you on the various options, and probably know a number of developers.
The less involved you want to be, generally the more you're going to need to spend if you want a quality result.
If it's an information website (e.g. not ecommerce), based on the little information we have you may want to opt for a CMS based website, such as Wordpress or Drupal. Wordpress is great for brochure websites, information and perhaps a blog. Drupal is good for something larger, and community sites, although can be used for small sites too.
You have various options. You can search in Google for web developers, for developers that specialise in the CMS you want to use (e.g. if you plan to edit the Wordpress pages in the future), or designers in your area. You can also post tenders once you've secured your name etc. in forums such as this one. There are plenty of designers and developers on this forum that would be happy to help.
The main offerings you will often see are templates installed on a CMS and then customised a little or a lot to your needs, or a completely bespoke solution. A low cost solution that seems to be offered a lot is buying a premium theme from the likes of ThemeForest, and having it installed for you on a CMS, and customised, with some content added. That's not really web design, or web development either really, but just putting a few pieces together and adding content. But if you don't need anything particularly specific or special, it can be a cost effective solution provided the content is up to scratch.
I hope that helps.
Good luck!
(Let us know know how you get on, and welcome to the forum).