This is mostly due to caching, either in your browser or via your
ISP`s caching server.

Your can try following workarounds:

Step 1: Clear your browser cache.

Step 2: Hold in CTRL + SHIFT and press the Refresh button after browsing
to the site. (This will initiate an attempt to bypass your ISP's cache
server)

Step 3: Failing this, try to access this site with and without the 'www'
alias, for example:
http://www.kalkbay.co.za
http://kalkbay.co.za

Step 4: If you have accessed your site within the last few days under
either of the above url's, both may be cached. In this case, try the
following url:
http://dedi204.your-server.de/kalkbay

If any of the above url's return the correct site in the browser, the error
you are experiencing will be due to caching. Caching is usually specific to
a client or the immediate geographical area at the most and will not affect
the vast majority of your clients.

Caching servers furthermore are usually refreshed on a periodic basis and the
error is thereby automatically resolved on conclusion of the caching period
(usually not longer than 24 hours).

If you browse to TUCOWS (http://www.tucows.co.za) you will find a large selection for you to chose from. I personally like WSFTP Lite which is small, free and easy to use. It is also available from TUCOWS.

When you connect to your site via FTP you arrive in your home directory and need to change to the folder 'public_html' where your web site files reside. If you are using a Windows based FTP client such as WS_FTP you can simply set it to default to the publc_html directory. If you are using Macromedia Dreamweaver or Microsoft FrontPage you can also set a default startup directory in the Web site settings.