WebSite-Watcher 4.42


1  WebSite-Watcher HELP
     1.1  Welcome to WebSite-Watcher

     1.2  Overview
          1.2.1  The main window
          1.2.2  Main menu
          1.2.3  Toolbar
          1.2.4  Symbols in Bookmark list
          1.2.5  Symbols in Browser-Tabs
          1.2.6  What can be checked
          1.2.7  Useful Shortcuts


     1.3  Add new bookmarks
          1.3.1  Using the Wizard
          1.3.2  Add bookmarks manually
          1.3.3  Add bookmarks directly from your Browser
          1.3.4  Import bookmarks
          1.3.5  Import URLs from Text file


     1.4  Check bookmarks
          1.4.1  Check pages manually
          1.4.2  Check pages automatically (with AutoWatch)
          1.4.3  Check disabled bookmarks
          1.4.4  Status- and Error messages


     1.5  Open changed bookmarks
          1.5.1  How are changed bookmarks displayed
          1.5.2  How to open (changed) bookmarks
          1.5.3  Internal Tabbed Browser


     1.6  Filter: Ignore / Watch specific parts of a page
          1.6.1  What are filter settings (Overview)
          1.6.2  Auto-Filter
          1.6.3  Filter Wizard
          1.6.4  Create Ignore / Watch filter manually
          1.6.5  Special Filter


     1.7  Page type dependent settings
          1.7.1  RSS / Atom feeds
          1.7.2  Table based forums
          1.7.3  FTP files and directories
          1.7.4  Binary files
          1.7.5  Images, PDF- and Flash files
          1.7.6  Local files and folders


     1.8  Password protected pages
          1.8.1  Server Authentication
          1.8.2  Web based logins / Check-Macros
          1.8.3  Password protected FTP files


     1.9  Highlight changes
          1.9.1  Highlight methods
          1.9.2  Highlight images


     1.10  Newsgroups
          1.10.1  Newsgroups
          1.10.2  Server
          1.10.3  Add Newsgroups
          1.10.4  Threads
          1.10.5  Post articles


     1.11  Report / Export
          1.11.1  Overview / Templates
          1.11.2  Datafields for bookmarks
          1.11.3  Datafields for folder
          1.11.4  General datafields/options
          1.11.5  Example: Simple URL list in HTML format
          1.11.6  Example: Export to CSV format
          1.11.7  Example: Export to Opera bookmark file


     1.12  Working with Wildcards and Regular Expressions
          1.12.1  Overview
          1.12.2  Wildcards
          1.12.3  Regular Expressions


     1.13  Working with different bookmark files
          1.13.1  Where are bookmarks stored
          1.13.2  Move bookmark files to another location
          1.13.3  Export/Import bookmarks between bookmark files
          1.13.4  Synchronize bookmark files
          1.13.5  Transfer whole bookmark lists between two PCs


     1.14  Additional tools and features
          1.14.1  Extended Search
          1.14.2  Export to CHM
          1.14.3  Backup / Restore
          1.14.4  MiniBrowser
          1.14.5  Command line
          1.14.6  Date variables
          1.14.7  Import program configuration


     1.15  How to...
          1.15.1  Limit connections to a single server/URL
          1.15.2  Watch pages for Keywords
          1.15.3  Check pages which require Javascript
          1.15.4  Send e-mails when changes are detected
          1.15.5  Track a whole page (Follow Links)
          1.15.6  Display images instead of grey boxes
          1.15.7  Ignore updates
          1.15.8  Make a bookmark a Hotsite
          1.15.9  Monitor the full HTML code of a page


     1.16  What to do when...
          1.16.1  All bookmarks report an error
          1.16.2  A web page contains only cryptic characters
          1.16.3  A page cannot be displayed
          1.16.4  A check has status "Whole content filtered (verify your filter settings)"


2  User Interface

     2.1  Program configuration
          2.1.1  General
          2.1.2  Bookmarks
          2.1.3  Check
          2.1.4  AutoWatch
          2.1.5  Automatic time configuration
          2.1.6  Internal Browser
          2.1.7  Appearance
          2.1.8  Messages
          2.1.9  Folder
          2.1.10  InfoWin
          2.1.11  Sound
          2.1.12  External Browser
          2.1.13  Im/Export
          2.1.14  Colors
          2.1.15  Archive
          2.1.16  User Agent
          2.1.17  Check for new version
          2.1.18  Images
          2.1.19  Proxy
          2.1.20  E-mail
          2.1.21  Connections
          2.1.22  Dialup
          2.1.23  Tweak


     2.2  Bookmark Properties
          2.2.1  General
          2.2.2  Options
          2.2.3  Keywords
          2.2.4  AutoWatch
          2.2.5  Actions
          2.2.6  Time Settings
          2.2.7  RSS/Atom
          2.2.8  Newsgroups
          2.2.9  Highlight changes
          2.2.10  Follow Links
          2.2.11  Images
          2.2.12  Check
          2.2.13  Ignore updates
          2.2.14  Report
          2.2.15  Server Authentication
          2.2.16  Cookies
          2.2.17  Get/Post
          2.2.18  Troubleshooting
          2.2.19  Note / Info fields


     2.3  Folder properties
          2.3.1  Folder properties


3  Scripting language
     3.1  Scripting language (Overview)
     3.2  Syntax

     3.3  Script commands
          3.3.1  AbortScript
          3.3.2  BackupToZip
          3.3.3  CheckBookmarks
          3.3.4  CheckFolder
          3.3.5  CloseBrowser
          3.3.6  CreateReport
          3.3.7  ImportBookmarks
          3.3.8  MarkAsVisited
          3.3.9  MessageBox
          3.3.10  OpenBookmarkFile
          3.3.11  OpenWithInternalBrowser
          3.3.12  PlaySound + SystemBeep
          3.3.13  QuestionBox
          3.3.14  Quit
          3.3.15  RasDial
          3.3.16  RasHangup
          3.3.17  RestartScript
          3.3.18  RunProgram
          3.3.19  SelectFolder
          3.3.20  SendMail
          3.3.21  StartAutoWatch
          3.3.22  SyncBookmarkFiles
          3.3.23  WaitDelay + WaitUntilTime
          3.3.24  WindowToTray


     3.4  Variables and advanced commands
          3.4.1  Variables
          3.4.2  Label and Goto
          3.4.3  IF statement
          3.4.4  Built-in functions


     3.5  Global settings/flags
          3.5.1  Flags to disable defined bookmark properties

     3.6  Example 1: Check bookmarks
     3.7  Example 2: Simulate AutoWatch
     3.8  Example 3: Create and send a report
     3.9  Advanced Examples / Code snippets


4  About...
     4.1  Install on Removable Drive / USB-Stick
     4.2  Order WebSite-Watcher Online
     4.3  Online Support
     4.4  License Agreement

1  WebSite-Watcher HELP

1.1  Welcome to WebSite-Watcher

WebSite-Watcher allows you to monitor your favorite websites for updates and changes with a minimum of time and online costs. This prevents you from visiting each page manually looking for changes. When changes in a page are detected, WebSite-Watcher saves the last two versions to your hard disk and highlights all changes in the text.

Many features give you control, when and how a page should be checked for updates. For example to get only an update notification when a specified keyword is within the changed content.

WebSite-Watcher works as client on your computer, similar to an e-mail client. All bookmarks and configurations are stored locally on your hard disk, other than online monitoring services you don't need our server to check pages for updates.


Main features



1.2  Overview

1.2.1  The main window

The main window of WebSite-Watcher is divided into 3 panels.

website-watcher main window with folder panel, bookmark list and internal preview

  1. In the folder tree on the left side you can find some predefined folders (for example AutoWatch, HotSites or Trash) and user defined folders which can be created by the user.

  2. The panel on the top lists all bookmarks in the selected folder. For each bookmark you can define bookmark properties which can be opened with the right mouse menu.

  3. The bottom panel is the internal browser where the selected bookmark is displayed. After starting WebSite-Watcher, this panel is closed and will automatically be opened when you double click/open a bookmark. The internal browser can optionally be placed at the bottom or on the right side.


1.2.2  Main menu

WebSite-Watcher has the following menus:





1.2.3  Toolbar

Main Toolbar

Open a bookmark file. Bookmarks are saved in files with the extension *.wsw, downloaded files in the related directory *_WSW
Wizard to add new bookmarks
Add new bookmark
Check all bookmarks in the selected folder
Abort check
Show info window with bookmarks which are currently checked
Goto previous bookmark
Goto next bookmark
Goto next changed bookmark (changed bookmarks are displayed in bold and red)
Open/Close internal browser
Open a window with extended search features
Turn AutoWatch on/off
Move WebSite-Watcher to the tray bar
Exit WebSite-Watcher



Browser Toolbar Buttons

Browse back
Browse forward
Abort
Reload page in internal browser
Find text in internal browser
Additional page settings and features
Edit bookmark properties
Create an Auto-Filter (Ignore highlighted changes)
Restore previous version
Open next changed bookmark (changed bookmarks are displayed in bold and red)
Goto next change within the opened page
Open online version of the bookmark
Open new version of the bookmark
Open old version of the bookmark
Open version with highlighted changes
Open both, version with highlighted changes and old version
Maximize internal browser
Open current page with external browser


The toolbar can be configured in the Options menu.


1.2.4  Symbols in Bookmark list

Each bookmark can have one or more of the following icons:

Each bookmark can be assigned a flag, similar to several e-mail clients. Main purpose is to be a marker for better bookmark visibility and has only small other functionalities, for example the "Don't auto-delete bookmarks with flags" in the folder properties. You can assign a flag with a double click on the first column or via the context menu where flags with more colors are available.
This icon appears when notes have been entered in the bookmark properties. If you double click that icon, you will get into a separate "Notes" dialog without having to open the bookmark properties.
Bookmark is a HotSite. Each bookmark can be marked as a Hotsite. All bookmarks with that flag are listed in the folder "Hotsites".
Bookmark is a Master-Bookmark (Follow-Links feature is enabled in the bookmark properties).
Bookmark is part of a follow links bookmark set (but not a Master-Bookmark).
Bookmark is queued for checking
An error occurred while checking the page, bookmark is queued for a second check
Bookmark is currently checked
An error occurred while checking the bookmark, WebSite-Watcher checks the page a second time



1.2.5  Symbols in Browser-Tabs

Each Browser-Tab has one of the following icons:

Page is loading.
Page fully loaded.
Page fully loaded, Tab has been selected.



1.2.6  What can be checked

WebSite-Watcher can monitor a lot of different file types and pages listed below:



1.2.7  Useful Shortcuts

Navigate through changed bookmarks
F12 Open next changed bookmark
Ctrl+F12 Goto next change
Enter Open selected bookmark (if the bookmark list has the focus)
Shift+Enter Open selected bookmark and maximize internal browser (if the bookmark list has the focus)
Ctrl+Enter Set the focus to the bookmark list
Ctrl+Shift+Enter Set the focus to the folder tree
Ctrl+Alt+Enter Open selected bookmark in external browser
Internal Browser
F11 Maximize internal browser
Space Scroll down the internal browser
Shift + Click on  Open version in new browser tab
Shift + Click on a link Open link in new browser tab
Shift+Ctrl + Click on a link Open link in new browser tab. The new tab will be opened in foreground if the option "Open new tabs in background" is enabled and vice versa.
Ctrl + Alt + Click on  Open version in external standard browser
Ctrl + Alt + Click on a link Open link in external browser
Ctrl+Tab Select next browser tab
Ctrl+W Close selected browser tab
Ctrl+Shift+W Close all opened browser tabs



1.3  Add new bookmarks

1.3.1  Using the Wizard

To add a bookmark with the Wizard, you have to use the Wizard button ui01a_wizard in the main toolbar. In several steps you can make some basic settings, the wizard also helps you to choose the best settings dependent from the page type.

On the Wizard's first page you have to decide, if an URL can be accessed directly or if a page is placed behind a web based login.


After clicking the Next button, WebSite-Watcher performs a check and initializes the page. As next step you have to choose the page type which is the base for all further actions within the wizard. If WebSite-Watcher cannot determine the page type correctly, you have to choose it manually. Dependent from that page type, the Wizard helps you choosing the best options and settings for the bookmark.


  1. Click the Wizard button ui01a_wizard in the main toolbar
  2. Enter the URL you want to monitor (or create a Check-Macro in case of password protected pages)
  3. Click "Next" to initialize the page
  4. Select the page type (if not detected automatically)
  5. Follow the next steps dependent from the page type


1.3.2  Add bookmarks manually

Alternatively to the Wizard you can add bookmarks manually by clicking the Add button in the main toolbar (or by pressing the Ins key).

You have only to enter the address to the URL field and press the 'Check Now' button to initialize the page, all other settings have typical default values. If you leave the bookmark name empty, WebSite-Watcher will assign it automatically with the page title.


  1. Click the Add button in the main toolbar (or the Ins key)
  2. Enter the URL you want to monitor
  3. Click the "Check Now" button


1.3.3  Add bookmarks directly from your Browser

A further and comfortable method to add new bookmarks directly from your browser is WebSite-Watcher's browser integration:




1.3.4  Import bookmarks

Bookmarks can be imported from different locations, the import commands can be found in the Tools menu.


  1. Click Tools the main menu
  2. Select "Im/Export"
  3. Select the menu entry from where you want to import bookmarks



1.3.5  Import URLs from Text file

WebSite-Watcher can import URLs from text files which have one of the following formats:



  1. Click Tools in the main menu
  2. Select "Im/Export"
  3. Select "Import all/new bookmarks from Text file"
  4. Select the location and the format of the text file
  5. Press OK



1.4  Check bookmarks

1.4.1  Check pages manually

After startup WebSite-Watcher is in idle mode and you have to check the bookmarks manually or turn on the AutoWatch mode. With AutoWatch you can check bookmarks periodically with predefined time settings.

The following methods can be used to check bookmarks manually:



When you start a check, the bookmarks are placed in a check queue and a grey earth appears on the left side of the bookmark. If a bookmark is actually checked, a blue globe is displayed. If the check has finished, the earth will be removed.


1.4.2  Check pages automatically (with AutoWatch)

Alternatively to the manual bookmark check, WebSite-Watcher supports an automated check where bookmarks can be monitored with predefined time settings (called AutoWatch). Working with the AutoWatch mode consists of two steps:

  1. Enable AutoWatch in the bookmark properties
  2. Start the AutoWatch mode


There are several ways how AutoWatch can be enabled

  1. Right click a bookmark, open the bookmark properties and select the AutoWatch tab. In that tab you can enable the AutoWatch feature and optionally some time settings when the bookmark should be checked.

    You can do the same for more bookmarks at once: Select all bookmarks for which AutoWatch should be enabled and right click them. Then choose the menu entry "Set properties in all selected bookmarks..."

  2. Drag&Drop bookmarks to the AutoWatch folder. This will enable the AutoWatch flag for the dragged bookmarks. As time setting WebSite-Watcher will use the predefined time from the general options.

  3. In the general program configuration you can pre-define AutoWatch settings for new bookmarks (button "Assign bookmark properties"). This can also be done per folder via the folder properties.

All bookmarks with enabled AutoWatch flag are listed in the AutoWatch folder.


Start the AutoWatch mode

Click the AutoWatch button in the main toolbar to start the AutoWatch mode. Bookmarks are only monitored automatically when this button is checked.



1.4.3  Check disabled bookmarks

Each bookmark can be disabled in the bookmark properties, that means it will be skipped when you try to check it. A bookmark can also be skipped when you have defined some time settings, for example if you have enabled the option "Check only once a day" and check that bookmark a second time within the same day.

The feature "Check bookmarks (Extended options)" offers you a way to ignore these restrictions.

  1. Select the bookmarks you want to check
  2. Press Ctrl+F9
  3. Click the OK button



1.4.4  Status- and Error messages

The status column in the bookmark list displays the result of the last check. If there was an error, the status is displayed in blue.

Successful check



Successful check with infos/warnings

If at least one of the following messages appear in the status column in combination with the "OK" message, then the page could be checked correctly, but you could probably optimize some settings.



Check with failures

If at least one of the following messages appear in the status column, then the page could not be checked.



1.5  Open changed bookmarks

1.5.1  How are changed bookmarks displayed

WebSite-Watcher use several places to show, which and how many bookmarks are marked as changed:



1.5.2  How to open (changed) bookmarks

WebSite-Watcher's tabbed web browser is used whenever you open a bookmark or a web page within WebSite-Watcher. Technically said, WebSite-Watcher uses an embedded Internet Explorer to open bookmarks and web pages.

Two common ways to open bookmarks are:

  1. F12 - opens the next unread bookmark
  2. Double click a bookmark - opens the selected bookmark


After a check the following shortcuts are very useful and efficient to walk through the list of changed bookmarks:

  • F12 - opens the next unread bookmark
  • Ctrl+F12 - jumps to the next change within the opened page
  • Space - scrolls the opened page down


If you prefer working with your mouse, you can click the button to open the next changed bookmark, and the button to jump to the next change within the opened page.


1.5.3  Internal Tabbed Browser

When you open a bookmark with a double click or the next changed bookmark with F12, WebSite-Watcher will always use the first (left) tab. Links from that page can be opened in a new tab by pressing the Shift key while clicking a link.


Pages will be opened in a new Browser-Tab when:

  • Holding the Shift key while clicking a hyperlink
  • Via the context menu when right-clicking a hyperlink
  • Holding the Shift key while clicking one of the following buttons in the browser toolbar:
  • Opening a new, empty Browser-Tab manually with the shortcut Ctrl+T



Open new Browser-Tabs in foreground/background

New browser tabs can optionally be opened in foreground or in background. That means, that if a new browser tab is opened in foreground it will be activated automatically. If you open new browser tabs in background, the active browser tab stays in foreground. The foreground/background setting can be changed as follows:

  Method #1
  1. Open menu "Options"
  2. Select "Program configuration"
  3. Select the "Internal Browser" tab
  4. Enable the option "[x] Open new tabs in background"

  Method #2
  1. Click the "WebSite-Watcher-Eye" toolbar button of the internal browser
  2. Select "Browser Tabs"
  3. Select "Open new tabs in background"

  Method #3
  1. If more tabs are opened then right click a tab and select "Open new tabs in background"

TIP - Individual handling with the Ctrl+Shift key:
If the Ctrl+Shift keys are pressed, then the new tab will be opened in foreground if the option "Open new tabs in background" is enabled and vice versa.


Opened tabs can be closed with:

  • Right clicking a browser tab
  • Using the shortcut Ctrl+W
  • All opened Browser-Tabs can be closed with Ctrl+Shift+W


The button opens the page of the active Browser-Tab in the system's default browser, for example Internet Explorer.

If you hold the Shift+Alt key while clicking one of the buttons , the page will also be opened in the default browser.


Icons in Browser-Tabs:

Page is loading.
Page fully loaded.
Page fully loaded, Tab has been selected.





1.6  Filter: Ignore / Watch specific parts of a page

1.6.1  What are filter settings (Overview)

To detect updates, WebSite-Watcher compares the content of the new version of a page with the content of the old version of a page. If these contents are different, WebSite-Watcher alerts an update. If a page contains changing parts (for example a daily date, some kind of ad, ...), an update would be reported with each check. With a filter you can ignore specific parts of a page to prevent false update notifications.

If a filter is defined, WebSite-Watcher will compare the filtered content of the new version with the filtered content of the old version of a page to detect updates.

Filter settings are defined in the bookmark properties where you can also see the button "Test filter". This button opens a dialog which displays the filtered content of the new version and the filtered content of the old version.




Filter definitions can be divided into four categories

  1. Automatically created Ignore filters (Auto-Filter)
    The Auto-Filter system is a self learning filter system and provides an easy and comfortable way to create a set of Ignore filters automatically based on highlighted changes. You should call this filter only when you get a false positive (for example caused by a changing date, a changing visitor counter, etc.), but not if a page contains any other highlighted news or changes.

  2. Manually defined an Ignore filters (Ignore userdefined strings)
    This filter ignores a specified part of a page, for example a text with changing numbers ("You are visitor number 8234"), a daily date or everything from the page beginning until the text "Daily News".

  3. Manually defined a Watch filters (Watch userdefined strings)
    This filter watches a specified part of a page instead of ignoring it. It is a watch-and-ignore-everything-else filter and can be used to watch for example only the version number of a software.

  4. Special Filters
    WebSite-Watcher has also some predefined filter options which must only be checked or unchecked. These filter options work for the whole page and not for specified parts like Ignore/Watch filters.

In most cases it works best to define a set of Ignore filters, either with the Auto-Filter system or manually via the Filter-Wizard.


How are Ignore/Watch filters defined

  1. Using the Auto-Filter system
    The Auto-Filter system is a self learning filter system and provides an easy and comfortable way to create a set of Ignore filters automatically based on highlighted changes. You should call this filter only when you get a false positive (for example caused by a changing date, a changing visitor counter, etc.), but not if a page contains any other highlighted news or changes.

  2. Using the Filter Wizard
    The Filter Wizard lets you create a filter interactively in a very comfortably way. Using the Wizard is an easy task and consists of two steps: firstly you have to select the text you want to ignore/watch and then, secondly, select the type of the filter you want to create (Eg. "the selected text is a text with changing numbers", or "the selected text is a date").

  3. Create the filter manually
    Alternatively to the Auto-Filter system and the Filter Wizard, you can create an Ignore/Watch filter manually with simple Wildcards and/or Regular Expressions.



1.6.2  Auto-Filter

The Auto-Filter system is a self learning filter system and provides an easy and comfortable way to create a set of Ignore filters automatically based on highlighted changes.


When can the Auto-Filter system be used?

You should call this filter only when you get a false positive (for example caused by a changing date, a changing visitor counter, etc.), but not if a page contains any other highlighted news or changes.

Create an Auto-Filter if you have changes like:
Today is May 29th, 2006 - 13:41:56 am

You are visitor number 8,736

Comments (7), Trackback (3)


DON'T create an Auto-Filter if you have changes like:
.....

02-May-2006
WebSite-Watcher 4.10 has been released.
This major update introduces often requested Unicode support,
many improvements to the user interface and lots of new features.


26-Apr-2006
AM-Notebook 4.0 has been released.
This major update comes with many new formatting features,
table support, formula based spreadsheets, multi-tab support, clips,
predefined styles and much more.

.....



How to create an Auto-Filter?

1. Directly in the internal browser of WebSite-Watcher:
  1. Click the Auto-Filter button in the toolbar of the internal browser
  2. Click the button "Save learned items" in the Auto-Filter dialog


2. Within the Filter-Wizard:
  1. Open the bookmark properties
  2. Click the "Filter-Assistant" button
  3. Click the button "Create filter automatically"
  4. Click the button "Create Auto-Filter (Ignore highlighted changes)"
  5. Click the button "Save learned items" in the Auto-Filter dialog
  6. Test your filter with the "Test filter" button (optional, but recommended)



The learning process

After clicking the Auto-Filter button you get the following dialog that shows the number of learned changes and the number of learned filters:



Sometimes a filter can be created immediately the first time you call the Auto-Filter feature, in other cases only changes are learned and a filter will probably be created after a few more learning processes. It's dependent from the type of the change if and when a filter can be created.


WebSite-Watcher cannot create a working Auto-Filter

If WebSite-Watcher isn't able to create a filter automatically, you have to use the Filter Wizard to create a filter manually. Manually created filters have more priority and are executed before Auto-Filters.


Automatically created filters are deleted automatically after some time when they are no longer used. There's no need to maintain these kind of filters manually.



1.6.3  Filter Wizard

The Filter Wizard can be launched in the bookmark properties (by clicking the "Filter-Assistant" button) and offers an easy and comfortably way to create Ignore and Watch filters interactively with only a few mouse clicks.



Creating a filter with the Filter-Wizard consists of two steps


After you have selected the filter type, a window pops up where WebSite-Watcher displays the matching results. This can be zero results when WebSite-Watcher was not able to find the selected text, one result if the selection was a unique text, or more results if WebSite-Watcher was able to find more matches which are "compatible" with the created filter.

If WebSite-Watcher doesn't find a result, then you should try to make a more precise selection.


The order of filters is important!

Please keep in mind that filters are always executed from top to bottom. If the filter in the first line filters a part of the content, then this content is no longer available for filters in following lines.

Example:

You have defined the following two ignore filters:

   Watcher
   WebSite-Watcher

The first line filters "Watcher". The second line will never find a match since "Watcher" is no longer available after executing the first filter. The correct order for these two filters would be:

   WebSite-Watcher
   Watcher

Here the first line filters all words "WebSite-Watcher". The second line can filter all remaining words "Watcher".


Outdated filters

Outdated ignore filters are detected and deleted automatically after some time when they no longer find any matches. There's no need to maintain and delete these kind of filters manually.

Outdated watch filters are not deleted automatically, you have to maintain these kind of filters manually.


Don't forget to test your filter settings

The feature "Test filter" gives you always the possibility to verify your filter settings by comparing the filtered content of the new page with the filtered content of the old page.


  1. Open the bookmark properties
  2. Click the "Filter-Assistant" button
  3. Select the text you want to filter/watch
  4. Click the button "Create filter manually"
  5. Click the button "New Ignore filter" (or "New Watch filter")
  6. Select the type of the filter
  7. A window is opened which shows the matching results. If the results are correct, then click the OK button to return to the Filter-Wizard
  8. Test your filter with the "Test filter" button (optional, but recommended)





1.6.4  Create Ignore / Watch filter manually

Alternatively to the Auto-Filter system and the Filter Wizard you can create all Ignore/Watch filters manually. Enter one filter expression per line. All filter definitions are case insensitive, they are converted to lowercase internally.



The button "New Ignore Filter" (or "New Watch Filter") opens a help dialog where you can enter and validate a filter expression. With the button "Test selected line" you can validate the active line. The "Test filter" button tests the whole filter by comparing the filtered content of the new page with the filtered content of the old page.


Each line can contain one of the following elements:

  1. Static text phrase
    You can use that type if you want to ignore specific phrases in a page.

  2. Text with a Wildcard
    Filters with Wildcards consist typically of a start text, an end text and any text between them. The * character (Wildcard) stands for the text between the defined start/end markers.

  3. Regular Expression
    With Regular Expressions you can define complex search and filter expressions which must be placed in special function names, for example "regex(....)".


Wildcard filter

WebSite-Watcher supports 3 types of Wildcard filters with the restriction that only one Wildcard is allowed per filter expression:



Regular Expressions

WebSite-Watcher supports PERL5 compatible Regular Expressions which can be used to define complex filter expressions. Regular Expressions must be placed in one of the following functions:



The order of filters is important!

Please keep in mind that filters are always executed from top to bottom. If the filter in the first line filters a part of the content, then this content is no longer available for filters in following lines.

Example:

You have defined the following two ignore filters:

   Watcher
   WebSite-Watcher

The first line filters "Watcher". The second line will never find a match since "Watcher" is no longer available after executing the first filter. The correct order for these two filters would be:

   WebSite-Watcher
   Watcher

Here the first line filters all words "WebSite-Watcher". The second line can filter all remaining words "Watcher".


Outdated filters

Outdated ignore filters are detected and deleted automatically after some time when they no longer find any matches. There's no need to maintain and delete these kind of filters manually.

Outdated watch filters are not deleted automatically, you have to maintain these kind of filters manually.


Related topics


  1. Open the bookmark properties
  2. Click the "Filter-Assistant" button (or the text "Manual text filter")
  3. Enter the filter expressions
  4. To test your filter, click the button "Test selected line" or the button "Test filter" to test the whole filter settings (not required, but recommended)



1.6.5  Special Filter

WebSite-Watcher supports some predefined filter options which must only be checked or unchecked, whether you want to use them or not. These filters work for the whole page and not only for specified parts as the Ignore/Watch filters do.



1.7  Page type dependent settings

1.7.1  RSS / Atom feeds

What is RSS?

RSS feeds provide a way to offer content outside of a web browser and are stored in a structured, uncomfortably readable format. A news page might have an RSS feed which contains only the headlines and links to the full stories. RSS stands for "Really Simple Syndication".


WebSite-Watcher and RSS feeds

WebSite-Watcher will convert RSS feeds into a readable format and you can handle them as normal web pages.

Normally no special configuration is required for RSS feeds. If WebSite-Watcher cannot identify an RSS feed automatically and is unable to convert it to a readable web page, then you have to change the file type setting in the bookmark properties from "auto detect" to "rss".




1.7.2  Table based forums

WebSite-Watcher supports a special technique for table based forums, concretely for the pages that list the forum topics. Such a page must typically contain:

  1. A table header
    The header tells WebSite-Watcher, where the topic list starts, for example the line:
    Topics | Replies | Author | Views | Last Post

  2. A "Last Post" date

  3. A table footer
    The footer tells WebSite-Watcher, where the topic list ends. The footer should be a static text, for example "Mark forum read" or "Page 1 of".


Typical forums that fulfill these requirements can be found at http://www.aignes.com/forum/.

If a forum fulfills these requirements, you can use the Forum-Wizard to configure all required bookmark settings (such as watch/ignore filters), no further configuration is required in that case.

  1. Create a new bookmark
  2. Enter the forum address, for example http://www.aignes.com/forum/viewforum.php?f=3
  3. Click the "Wizard" button
  4. Select "Forum-Wizard" (this will initialize the page) and follow the steps of the assistant


See also chapter Highlight methods for more information.



1.7.3  FTP files and directories

FTP files and directories

FTP addresses can be monitored by entering the FTP address into the URL field of a bookmark.

If you want to check a single file, you have use the complete address with path and filename. WebSite-Watcher will check the file by file date and file size (entry in the directory listing), no content is transferred.

If you want to monitor a complete folder, the last character of the URL must be a Slash / (without a filename)!


How to check the content of a (text) file

With the checking method "automatic" a file is checked via the directory listing. If you want to check a file by content (for example a text file), you have to change the checking method to "check-by-content". Then the whole file is downloaded and checked by it's content.


Password protected FTP files / directories

By default WebSite-Watcher uses anonymous FTP logins. If an FTP server is password protected, you have to enter username and password in the bookmark properties (Advanced + Server Authentication).


1.7.4  Binary files

WebSite-Watcher will analyze the server log file and determine, how a binary file can be checked. Possible methods are:


Dependent from the server log, WebSite-Watcher uses one or a combination of these techniques. Binary files are not downloaded completely when they are checked for updates.

Normally no special settings are required for binary files. If WebSite-Watcher cannot identify a binary file (for example when a script redirects to a binary file), then you have to change the file type from "auto detect" to "binary".



1.7.5  Images, PDF- and Flash files

Images, PDF- and Macromedia Flash files are handled as binary files. Dependent from the server log file, one or a combination of the following checking methods is used:


The addresses of these file types can be inserted into the URL field of a bookmark, but it's not possible to highlight differences in PDF files nor to use the filter settings to ignore unwanted content.

Normally no special settings are required for these file types. If WebSite-Watcher cannot identify these files as binary (for example when a script redirects to a binary file), then you have to change the file type from "auto detect" to "binary".



1.7.6  Local files and folders

WebSite-Watcher supports monitoring local files and folders. Local addresses can be inserted directly into the URL field (eg. c:\projects\bookmark.wsw), or by entering the directory or file via the user interface (click the options button and select a file/folder from the popup menu).


Monitor a directory with subdirectories

If you want to check a folder and all files in subfolders, you have to use the Follow-Links feature. It's recommended to start with link depth 1 and increase that value if needed.


Directories and the modified date

If a file in a directory is changed, then the modified date of the corresponding directory is changed, too. This will probably give you redundant update notifications which can be avoided as follows:

  1. Create an appropriate filter
    This can be done with the Filter-Wizard, examples see below.

  2. Display the creation date instead of the modified date
    Alternatively you can display the creation date instead of the modified date for folders by entering the following line to the Tweak section or the program configuration:
    CheckLocalFolderUseCreationDate=1


Create Filter using the Filter-Wizard

A directory listing has the following format:

2005-02-20 23:12:16   DIR          FirstFolder
2006-03-20 13:11:26   DIR          AnotherFolder
2006-01-08 12:01:22   FILE   zip   MyZipFile.zip 1.187.673 Bytes
2006-03-12 13:12:31   FILE   zip   ZipFileName.zip 3.374.123 Bytes
2006-04-11 11:58:47   FILE   zip   FileName13.zip 2.342.234 Bytes


Ignore date changes of directories:
  1. Open the Filter-Wizard
  2. Select "2006-03-20 13:11:26 DIR"
  3. Select "New Ignore Filter + Selected Text + The selected text contains changing numbers"


Ignore date changes of all zip files:
  1. Open the Filter-Wizard
  2. Select "2006-04-04 17:22:06 FILE zip"
  3. Select "New Ignore Filter + Selected Text + The selected text contains changing numbers"


Ignore changes of specific files:
  1. Open the Filter-Wizard
  2. Select a whole line, for example "2006-04-04 17:22:06 FILE zip ZipFileName.zip 1.187.673 Bytes"
  3. Select "New Ignore Filter + Selected Text + The selected text contains changing numbers"



1.8  Password protected pages

1.8.1  Server Authentication

Server Authentication is a special technique to protect pages from public access. You can identify that type of login, when a small dialog pops up where you have to enter username and password, as the following screenshot shows:



If you get such a dialog, you have to enter username and password in the bookmark properties (Advanced + Server Authentication)

If the fields for username and password are placed within a web page, then it is a web based login and you have to record a Check-Macro.

  1. Open the bookmark properties
  2. Select the Advanced tab
  3. Select "Server Authentication" on the left side
  4. Enter username and password



1.8.2  Web based logins / Check-Macros

What are web based logins?

Web based logins are logins where the fields for username and password are placed within a web page (other than logins with Server Authentication where a small window pops up to enter username and password).

Most password protected pages use a web based login. These logins don't work with a standardized technique, it's dependent from the server and the webmaster how the login technique is implemented.


WebSite-Watcher and web based logins

Unfortunately there is no general way to automate web based logins. To handle web based logins, WebSite-Watcher supports a technique called Check-Macros. A Check-Macro can be recorded interactively with the integrated tool MiniBrowser and stores all steps you make when you login and surf to the page you want to watch. WebSite-Watcher repeats all these steps when a bookmark is checked for updates.

To record a macro, you have to click the Check-Macro button in the bookmark properties. This will start MiniBrowser and a dialog where you have to enter the Start-URL of the macro.



As there are so many different solutions how a login can work, WebSite-Watcher supports 3 different techniques which can be used to record a macro.


That sounds probably very technical yet, but to make things easier to understand you have simply to try another record option if a macro doesn't work. Best way is to start with method #1, if it doesn't work, then try method #2 and method #3.


Session-ID which is located in the path of an URL

In some cases a page inserts a dynamic Session-ID into the path of an URL which is not available as a variable (from URL parameters or cookies).

For example http://www.aignes.com/download/00938-8837-8872/files/file.htm where 00938-8837-8872 is the Session-ID. If you have such a case, you need this feature to handle the dynamic Session-ID which is located in the path of the URL. Do not use this feature for URLs which have the format http://www.aignes.com/index.htm?sessionID=9987-2234123

You have to know the syntax of the Session-ID, then you can define a Regular Expression which extracts the Session-ID from the URL. Don't add a leading and a trailing Slash, MiniBrowser will do that automatically.

Typical examples:


GET / POST dialogs during macro recording

For each URL which is opened during macro recording, a dialog pops up (only for the methods "Record dynamic/static values"). This dialog contains the used download technique (GET or POST), the URL and some additional parameters (for example the values after filling out a form). Normally you can press the GET button to continue recording (or the POST button in case of the POST command). Only if you are performing a logout, you have to check the appropriate checkbox in that dialog.


Demos and Videos

To make things more understandable, you can find some videos at http://www.aignes.com/support.htm. These videos show how Check-Macros can be used to login to a password protected page or how a search query can be performed


  1. Create a new bookmark
  2. Press the "Check-Macro" button in the bookmark properties
  3. A window pops up, enter the Start-URL of the macro
  4. Click the button "Start recording"
  5. Surf to the page you want to watch (for each step a dialog pops up where you can normally continue by clicking the GET or POST button)
  6. When you have reached the page you want to watch, press the OK button at the bottom of the MiniBrowser window (if you want to perform a logout, you have to do this before. You have to select the "logout" checkbox in the dialog that pops up for each URL)
  7. The OK button at the bottom of the dialog will stop recording and return to the bookmark properties
  8. Click the "Check Now" button to check the page



1.8.3  Password protected FTP files

By default WebSite-Watcher uses anonymous FTP logins.

If an FTP server is password protected, you have to enter username and password in the bookmark properties (Advanced + Server Authentication).

  1. Open the bookmark properties
  2. Select the Advanced tab
  3. Select "Server Authentication" on the left side
  4. Enter username and password



1.9  Highlight changes

1.9.1  Highlight methods

If WebSite-Watcher detects an update, the changes in the text will be highlighted. WebSite-Watcher supports several methods to highlight textual changes.



  1. Open the bookmark properties
  2. Select the Advanced tab
  3. Select "Highlight changes" on the left side
  4. Configure the highlight settings



1.9.2  Highlight images

WebSite-Watcher can optionally put highlight-borders around changed images.


How are changed images detected?

That's dependent from the image configuration. WebSite-Watcher supports three different configurations to download or images:

  1. Download all images
    If an update is detected, then WebSite-Watcher downloads all images immediately and save them to your hard disk. With that option WebSite-Watcher will use the image content to determine if an image has been changed. This is the most reliable method to put highlight-borders around changed images.

  2. Use absolute image addresses
    With that setting, WebSite-Watcher downloads only the html page and loads the images from their server as soon as you open the page in your browser. If you use absolute image addresses, then WebSite-Watcher will compare the filenames of the images to determine, if they have been changed or not.

  3. Display grey boxes instead of images
    It's the fastest method to check and open pages, but you will see grey boxes instead of the images when you open a page in your browser. With that option WebSite-Watcher is not able to highlight images.


Please note, that a web page is only marked as changed, when a textual change in a page has been detected, and not when only an image has been changed!
If you want to watch a concrete image, you can put the image address into the bookmark's URL field.


  1. Open the bookmark properties
  2. Select the Advanced tab
  3. Select "Highlight changes" on the left side
  4. En/Disable the "Highlight images" option


Related topics



1.10  Newsgroups

1.10.1  Newsgroups

The newsgroup functionality of WebSite-Watcher provides an easy way to monitor newsgroups for specified keywords or to stay updated with low traffic newsgroups.

The newsgroup module doesn't replace a real newsreader, it has also some limitations for high traffic newsgroups where a typical newsreaders supports better and more advanced functionalities (for example filters, scoring, etc).

The newsgroup functionality works only in the internal browser of WebSite-Watcher, it's not possible to open newsgroup in the external browser.



1.10.2  Server

Use this dialog to add, remove and maintain the available list of news servers.

For each server you can define a descriptive name, the server address and an identity (for posting articles). The server name and the port number must be entered, default port is 119.

The identity section contains some pre-defined fields which are used when you post new articles or replies. If no identity is defined, then it must be entered each time you post an article.



1.10.3  Add Newsgroups

Select the server

In a first step you have to select a newsserver from the drop-down box. If no newsserver is listed, then click the "News-Server..." button to add and configure a server.

If you haven't already downloaded the available newsgroups for the selected server, then this list is downloaded automatically. Downloading the available newsgroups can take up to several minutes. Usually you can let the option "Download available newsgroups" unchecked, re-downloading the list is only required if you are looking for new newsgroups on the server.


Subscribe to groups

After pressing the "Next" button you will see all available newsgroups for the selected server. Click the checkbox in the left column to subscribe to one or more newsgroups. To search for specific groups, you can enter one or more search terms into the search field. For example "music rock" (without quotes) will list all newsgroups which contain "music" and "rock", eg. the newsgroup alt.music.modern.rock


Monitor only headers or full articles with bodies

After you have selected the newsgroups, you are asked in a last step if you want to download newsgroup bodies immediately. Otherwise only the headers (author and subject) are monitored and the bodies (the text of the articles) will be downloaded on demand.

You should only download bodies immediately if you want to monitor the text of articles for specific keywords. In all other cases it doesn't make really sense since the check takes longer and more data must be transferred. Using that option means that you also download bodies for postings you aren't interested in.

If you only want to monitor a newsgroup for new postings and replies, then you should not use the "download bodies" option. The check is faster in that case and bodies can be downloaded on request when you want to read them.



1.10.4  Threads

This dialog shows all postings for the selected thread.

Shortcuts

Esc - close window
Space - Scroll down the body text

To open the next unread posting or to go to the next/previous posting, you can use the same optional shortcuts as in the WebSite-Watcher main window.


Replies

If you want to post an answer to a message, simply click the Reply button in the toolbar.

Quotes in replies:




1.10.5  Post articles

WebSite-Watcher contains a basic posting functionality, you can enter all fields which are required to post an article. Name, e-mail and the signature can be predefined in the server configuration dialog.

Quotes in replies:



Clicking the Send button will post the article immediately, there is no queue or folder for outgoing postings.



1.11  Report / Export

1.11.1  Overview / Templates

The Report/Export feature lets you create reports in your own text, html or xml format. To export bookmarks to a user defined format, you have to work with templates. A report template is a HTML file (for HTML reports) or a text file (for text exports) which contains several predefined datafields. These datafields will be replaced with real values when the report is created.

Reports are always written in the UTF-8 character set!


What to do in WebSite-Watcher?

  1. Create a new report by clicking the "New..." button
  2. Select a report template
  3. Select the output file into which the report should be created
  4. Select the "Bookmarks" tab where you can choose the bookmarks you want to add to the report



General structure of a HTML report template (without folders)

<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<title>your title</title>
</head>
<body>
Your header text

{wsw_begin_url}
  <a href="{wsw_url_url}" target="_top">{wsw_url_name}</a><br>
  {wsw_url_text}<br>
  date: {wsw_url_date_changed}<br>
{wsw_end_url}

<br>
<br>
report date: {wsw_report_date}<br>
</body>
</html>



General structure of a HTML report template (with folders)

<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<title>your title</title>
</head>
<body>
Your header text

{wsw_begin_folder}
  Folder: <b>{wsw_folder_name}</b><br><br>
  {wsw_begin_url}
    <a href="{wsw_url_url}" target="_top">{wsw_url_name}</a><br>
    {wsw_url_text}<br>
    date: {wsw_url_date_changed}<br>
  {wsw_end_url}
{wsw_end_folder}

<br>
<br>
report date: {wsw_report_date}<br>
</body>
</html>





1.11.2  Datafields for bookmarks

The following datafields are related to bookmarks and can