Best way to make header [banner]

I want to create a header that will appear on the top of each of my webpages that shows our company logo and location addresses. I first created a jpeg image that appears on the top of each page but it doesn't appear crisp enough. I'm thinking of just creating the logo and addresses in a different div section using xhtml and css that will appear on the top of each page. Is this a good approach?