NET SEARCH EXTENDER

[Stanley Sinclair]

Bear with me. I am being very calm; took a Valium. I have waited two
weeks to write this, because every time I wrote it before the message
was, at best, nasty.

I need to use the services of NET SEARCH EXTENDER. This is the first
time in over five years of IBM (DB2) developing that I need this.

I don't know how to do it. (Db2 v8.1.2, Windows) I see that I must
deal with indexes, with cache, with other stuff.

The information files tell me worse than nothing -- they are
misleading. I tried through the wizard in control panel. That always
ends with "SQL syntax error" -- strange, since I didn't write the SQL!

I tried through the command window. I set the variable DB2DBDFT with
the -g switch, with the -i switch, with the -all switch and I entered
via Control Panel. Every time I try to execute a command, the error
message is "Varaible DB2DBDFT is not set." I rebooted, reset,
rebooted ... same error.

I have searched every where I know, in my installed help files and on
the web. The typical search on NET SEARCH EXTENDER returns about 60
files: one of them praises the virtues of the subject, 30 are on the
subject of XML extender, and the rest are irrelevent.

What I need is step-by-step instructions on how to create the proper
index on a column, how to create a cache of the column, and how to do
a search using those indices.

There is no place which I can find that gives me that information,
although there are dozens which tell me how wonderful is this product.

OK -- this is a long message, but I hope that my extreme anger does
not come through, that I have not insulted anyone, and that someone
can help me.

Stan

[Mark Yudkin]

You have my sympathy. We never got any of the text search technologies to
work correctly. When the database got large we got spurious hits or internal
errors. Word stemming failed horribly (German, but we got a partial fix for
plural recognition). We even had somebody from the IBM Böbligen labs
on-site. We opened PMRs, some got fixed, most "permanent restrictions" or
similar. After over a year of messing around, we finally did the job using
Oracle.

The documentation (318 pages) is on line at
http://publibfp.boulder.ibm.com/epubs/pdf/h1267402.pdf.

"Stanley Sinclair" <st*************@bellsouth.net> wrote in message
news:6f**************************@posting.google.c om...

Bear with me. I am being very calm; took a Valium. I have waited two
weeks to write this, because every time I wrote it before the message
was, at best, nasty.

I need to use the services of NET SEARCH EXTENDER. This is the first
time in over five years of IBM (DB2) developing that I need this.

I don't know how to do it. (Db2 v8.1.2, Windows) I see that I must
deal with indexes, with cache, with other stuff.

The information files tell me worse than nothing -- they are
misleading. I tried through the wizard in control panel. That always
ends with "SQL syntax error" -- strange, since I didn't write the SQL!

I tried through the command window. I set the variable DB2DBDFT with
the -g switch, with the -i switch, with the -all switch and I entered
via Control Panel. Every time I try to execute a command, the error
message is "Varaible DB2DBDFT is not set." I rebooted, reset,
rebooted ... same error.

I have searched every where I know, in my installed help files and on
the web. The typical search on NET SEARCH EXTENDER returns about 60
files: one of them praises the virtues of the subject, 30 are on the
subject of XML extender, and the rest are irrelevent.

What I need is step-by-step instructions on how to create the proper
index on a column, how to create a cache of the column, and how to do
a search using those indices.

There is no place which I can find that gives me that information,
although there are dozens which tell me how wonderful is this product.

OK -- this is a long message, but I hope that my extreme anger does
not come through, that I have not insulted anyone, and that someone
can help me.

Stan

[Sabine Perathoner]

Hi Stan,

I'd like to point you to the documentation:

Net Search Extender v8.1:
http://publibfp.boulder.ibm.com/epubs/pdf/h1267401.pdf

'Chapter 3. User scenarios' gives you two simple examples how to use Net
Search Extender.

In addition please look at the sample in .../sqllib/samples/db2ext
To create text indexes etc. run:
nsesample <databasename>
To perform full text search:
connect to the database and then run:
db2 -tvf search

As for your problem with DB2DBDFT:
try to add following clause to your commands instead of using DB2DBDFT:
' ... connect to <databasename>'
For example:
db2text "CREATE INDEX db2ext.myTextIndex FOR TEXT ON books (story)
CONNECT TO sample"

When you are using the control center and the action fails with "SQL
syntax error", could you klick on 'Show SQL' to see which command is
generated?

I hope this helps. Please let me know if you have additional questions.

Regards,
Sabine
Stanley Sinclair wrote:

Bear with me. I am being very calm; took a Valium. I have waited two
weeks to write this, because every time I wrote it before the message
was, at best, nasty.

I need to use the services of NET SEARCH EXTENDER. This is the first
time in over five years of IBM (DB2) developing that I need this.

I don't know how to do it. (Db2 v8.1.2, Windows) I see that I must
deal with indexes, with cache, with other stuff.

The information files tell me worse than nothing -- they are
misleading. I tried through the wizard in control panel. That always
ends with "SQL syntax error" -- strange, since I didn't write the SQL!

I tried through the command window. I set the variable DB2DBDFT with
the -g switch, with the -i switch, with the -all switch and I entered
via Control Panel. Every time I try to execute a command, the error
message is "Varaible DB2DBDFT is not set." I rebooted, reset,
rebooted ... same error.

I have searched every where I know, in my installed help files and on
the web. The typical search on NET SEARCH EXTENDER returns about 60
files: one of them praises the virtues of the subject, 30 are on the
subject of XML extender, and the rest are irrelevent.

What I need is step-by-step instructions on how to create the proper
index on a column, how to create a cache of the column, and how to do
a search using those indices.

There is no place which I can find that gives me that information,
although there are dozens which tell me how wonderful is this product.

OK -- this is a long message, but I hope that my extreme anger does
not come through, that I have not insulted anyone, and that someone
can help me.

Stan

[Jürgen Metter]

The best way to start with Net Search Extender after installation is
to run the supplied samples. The samples are installed in the DB2
installation directory .../sqllib/samples/db2ext on Unix or
....\sqllib\samples\db2ext on Windows.
There are two samples. The administration sample creates a database,
two tables db2ext.texttab and db2ext.htmltab within the database and
loads some data.
The db2ext.htmltab table is used to demonstrate structured search on
HTML documents. The database is enabled for Net search Extender.
The next step creates Net Search Extender indexes on selected text
columns.
The following command runs the administration sample :
nsesample your_database_name
On Windows switch to a DB2 command window with "db2cmd" first.
A second sample can be used to run a set of Net Search Extender
searches on the created indexes.
The following command runs the search sample :
db2 -tvf search
It is recommended to run the latest Fix Pack level. Currently Fix Pack
2 is the latest level which requires DB2 V8.1 Fix Pack 2. Use db2level
to find out the latest DB2 level and db2text level to check the Net
Search Extender level.
For Net Search Extender information see :
http://gwareview.software.ibm.com/so...rch/index.html
Via Support and Download you get to the Fix Pack 2 download site.

[Mark Yudkin]

I assume you're actually answering Stanley and not me (our problems were all
reported to, and were reproduced by, IBM support).

"Jürgen Metter" <me*@de.ibm.com> wrote in message
news:f0**************************@posting.google.c om...

The best way to start with Net Search Extender after installation is
to run the supplied samples. The samples are installed in the DB2
installation directory .../sqllib/samples/db2ext on Unix or
...\sqllib\samples\db2ext on Windows.
There are two samples. The administration sample creates a database,
two tables db2ext.texttab and db2ext.htmltab within the database and
loads some data.
The db2ext.htmltab table is used to demonstrate structured search on
HTML documents. The database is enabled for Net search Extender.
The next step creates Net Search Extender indexes on selected text
columns.
The following command runs the administration sample :
nsesample your_database_name
On Windows switch to a DB2 command window with "db2cmd" first.
A second sample can be used to run a set of Net Search Extender
searches on the created indexes.
The following command runs the search sample :
db2 -tvf search
It is recommended to run the latest Fix Pack level. Currently Fix Pack
2 is the latest level which requires DB2 V8.1 Fix Pack 2. Use db2level
to find out the latest DB2 level and db2text level to check the Net
Search Extender level.
For Net Search Extender information see :
http://gwareview.software.ibm.com/so...rch/index.html Via Support and Download you get to the Fix Pack 2 download site.

[Stanley Sinclair]

I thank everyone who has tried to help.

When I try anything suggested in this forum, or anything in the
instructions in the official documentation, I get a series of errors
which results in failure.

It really does not matter which of the many routes I take, every one
of them ends in failure.

Here is one example of perhaps eight I could quote:

I try to create a text index. First error message:
- No db2text start command was issued.
I do that and get the error message:
- db2text-db2 service is not started.
I try to start that and get the error message:
- db2text service does not exist.

Up to that point I have done everything in the documentation and the
user's manual exactly as instructed.

I have spent very many hours on this with no results to show ...

Stan

[Stanley Sinclair]

Please see what I wrote to Sabine.

SS

[Sabine Perathoner]

Hi Stan,

it looks like during installation of NSE v8fp2 the service was not
registered correctly.

You can do either one of the follwing:
Register the service manually for your existing instance:
ctereg <instancename> register <username> <password>
Create a new db2 instance and the NSE service will be registered
automatically:
db2icrt <instancename> -u <username>

Please make sure that the DB2 instance services run under a user account
and not under the systems account.
You can check that in the 'services' window. In the 'Log On As' column
there must be the username.

Kind regards,
Sabine
Stanley Sinclair wrote:

I thank everyone who has tried to help.

When I try anything suggested in this forum, or anything in the
instructions in the official documentation, I get a series of errors
which results in failure.

It really does not matter which of the many routes I take, every one
of them ends in failure.

Here is one example of perhaps eight I could quote:

I try to create a text index. First error message:
- No db2text start command was issued.
I do that and get the error message:
- db2text-db2 service is not started.
I try to start that and get the error message:
- db2text service does not exist.

Up to that point I have done everything in the documentation and the
user's manual exactly as instructed.

I have spent very many hours on this with no results to show ...

Stan

[Stanley Sinclair]

<<It is recommended to run the latest Fix Pack level. Currently Fix
Pack 2 is the latest level which requires DB2 V8.1 Fix Pack 2. Use
db2level to find out the latest DB2 level and db2text level to check
the Net Search Extender level.>>

**Where can I find a list of ALL db2 commands and ALL db2text
commands?**

They do not follow any convention, are not intuitive, and need very
special syntax. Eg, Every other program uses "ver" for version. This
uses "level."

(I am, in fact using the latest versions of everything.)

<<For Net Search Extender information see :
http://gwareview.software.ibm.com/software/data/db2/extenders/netsearch/index.html>>

That link is dead.

Stan

[Stanley Sinclair]

So far, every wizard in Control Panel using db2text has failed with
multiple syntax errors. It also does not allow editing of the SQL
text or even to copying it. Eg, The wizard ends everyting with a ;,
and the Command Window rejects anything which ends in a ;.

Some things which were in parentheses must not be; some things should,
or should not, be in "" "" marks or ' ' marks.

Again, it was a disaster in terms of wasting my time.

When I tried to set DB2DBDFT (?) it would be set, but when I ran
something using it, the message up to this time, is "DB2DBDFT not
set."

After creating a new instance, per your suggestions, error messages
concerning instances appeared after anything. (I always rebooted.) I
could not get back to the instance in which my main databases exist,
threatening the end of my carrer. The command db2set did nothing for
DB2INSTANCE.

Complete disaster.

I must quote Mark at the beginning of this thread:

"We never got any of the text search technologies to work correctly...
After over a year of messing around, we finally did the job using
Oracle."

Sadly, that's where I'm going.

Thanks for all your help.

Stan

[Database Guy]

st*************@bellsouth.net (Stanley Sinclair) wrote in message news:<6f**************************@posting.google. com>...

The wizard ends everyting with a ;,
and the Command Window rejects anything which ends in a ;.
That's obviously because you've not set the CLP statement terminator
on. This really is beginners' stuff.
Some things which were in parentheses must not be; some things should,
or should not, be in "" "" marks or ' ' marks.
Can't comment, this is so vague.
When I tried to set DB2DBDFT (?) it would be set, but when I ran
something using it, the message up to this time, is "DB2DBDFT not
set."
Again, not very easy to comment about "something".
After creating a new instance, per your suggestions, error messages
concerning instances appeared after anything. (I always rebooted.) I
could not get back to the instance in which my main databases exist,
threatening the end of my carrer.
Oh dear, how dramatic.
The command db2set did nothing for
DB2INSTANCE.

Complete disaster.
That's because DB2INSTANCE is a shell variable, not part of the DB2
Registry. This is all covered in any basic DBA course, as
I must quote Mark at the beginning of this thread:

"We never got any of the text search technologies to work correctly...
After over a year of messing around, we finally did the job using
Oracle."

Sadly, that's where I'm going.

DG

[Stanley Sinclair]

Dear Mr Guy,

First, please read the first lines of the first item in this thread.
I'm afraid that I, again, got carried away in some of the things that
I said.

However, it would have been very pleasant if you were to help instead
of trying to poke fun of me in your superiority.

The wizard ends everyting with a ;,
and the Command Window rejects anything which ends in a ;.

That's obviously because you've not set the CLP statement terminator
on. This really is beginners' stuff.

Why could you not just tell me exactly how to do that, and then I
would no longer be such a beginner? I'm not, in fact a beginner, but
have not dealt with this before. I see many messages in this forum
which begin with "Newbie," etc, all of which being politely answered.

Some things which were in parentheses must not be; some things should,
or should not, be in "" "" marks or ' ' marks.

Can't comment, this is so vague.

That was a statement, not a question. Requiring no comment. It just
said that the SQL generated by the wizard required editing before it
would be accepted by the CLP.

When I tried to set DB2DBDFT (?) it would be set, but when I ran
something using it, the message up to this time, is "DB2DBDFT not
set."

Again, not very easy to comment about "something".

Sorry. For "something" read "anything."

After creating a new instance, per your suggestions, error messages
concerning instances appeared after anything. (I always rebooted.) I
could not get back to the instance in which my main databases exist,
threatening the end of my carrer.

Oh dear, how dramatic.

I am sorry for the melodramatics. But instead of sarcasm, couldn't
you tell me how to solve the problem? The only reasons why you would
not do so are: You don't know, or, you are concentrating on insulting
me and showing how great you are.

The command db2set did nothing for
DB2INSTANCE.

Complete disaster.

That's because DB2INSTANCE is a shell variable, not part of the DB2
Registry. This is all covered in any basic DBA course, as

But, Mr Guy, you are unwilling to tell me how to catch up. My last
formal course was at ver 2. I have read all that I can since. Please
complete your statement, "This is all covered in any basic DBA course,
as . . ." I hope it includes the names of courses I can attend
without leaving home.

With best wishes.

Stanley Sinclair

[P. Saint-Jacques]

See answers imbedded ######## . Some text snipped.

Stanley Sinclair wrote:

The wizard ends everyting with a ;,
and the Command Window rejects anything which ends in a ;.
That's obviously because you've not set the CLP statement terminator
on. This really is beginners' stuff.

Why could you not just tell me exactly how to do that, and then I
would no longer be such a beginner? I'm not, in fact a beginner, but
have not dealt with this before. I see many messages in this forum
which begin with "Newbie," etc, all of which being politely answered.

########### Set the terminator by going to the tools option on the
option bar, select settings and then follow thru to set. The default
terminator is generally pre-selected as ;
########### When you work from the command line, the db2 -td function
allows you to set the terminator. As in-- db2 td% If you don't specify
anythin char. then ; is assumed.

Some things which were in parentheses must not be; some things should,
or should not, be in "" "" marks or ' ' marks.
Can't comment, this is so vague.

That was a statement, not a question. Requiring no comment. It just
said that the SQL generated by the wizard required editing before it
would be accepted by the CLP.

########### The wizard or show command option will both show "funny"
SQL. Generally, you should strip any double or single quotes except.
Exceptions: Double quotes at the start of the statement and at the end,
as in: db2 "select ........ order by col1".
Also, watch out if stmt. has where clauses and values are in it the all
literals will be in single quotes, as in where col1 = 'yourname'
Thsi is explained in the SQL Ref. for statements and COmmand ref. for
commands structure and options.

When I tried to set DB2DBDFT (?) it would be set, but when I ran
something using it, the message up to this time, is "DB2DBDFT not
set."
Again, not very easy to comment about "something".

Sorry. For "something" read "anything."

########### DB2DBDFT should be set with db2set command and use the
-i parm which specifies for which instance the default db applies. And
yes, you may have multiple DB2DBDFT but only one per instance. Again,
look at the online Command Rer. manual.

After creating a new instance, per your suggestions, error messages
concerning instances appeared after anything. (I always rebooted.) I
could not get back to the instance in which my main databases exist,
threatening the end of my carrer. ########### If my carreer was threatened, I'd probably mention a few
odd error messages as opposed to something and or anything. We can't
help if we don't know what is going on. What error messages and when
they appeared what were you trying to do.
When you reboot, DB2 will look for which instance to make active when
any application stats.
1) did you set the instance on the command line with
set db2instance=instname Then that's the default and it must have
the DB2DBDFT default dbname catalogued.
2) Uses the default value set at the global profile register in:
db2set DB2INSTDEF instname
Same thing with having the db catalogued.
3) Uses the default value set in the OS environment variables, either
at install or after. On a command line, do:
echo %DB2INSTANCE% and if it has been set it will come back with it.
In Windows, check both the user and system registry.

Oh dear, how dramatic.

I am sorry for the melodramatics. But instead of sarcasm, couldn't
you tell me how to solve the problem? The only reasons why you would
not do so are: You don't know, or, you are concentrating on insulting
me and showing how great you are.

The command db2set did nothing for
DB2INSTANCE.

######### db2set DB2INSTDEF This is documented in the online Command
Ref.
Complete disaster.

######### I shouldn't wonder
That's because DB2INSTANCE is a shell variable, not part of the DB2
Registry. This is all covered in any basic DBA course, as

######### It may covered in any bsic course (I know Iteach them) but
it is not well documented and hard to grasp, even when well explained.

But, Mr Guy, you are unwilling to tell me how to catch up. My last
formal course was at ver 2. I have read all that I can since. Please
complete your statement, "This is all covered in any basic DBA course,
as . . ." I hope it includes the names of courses I can attend
without leaving home. ######### Stanley, if your last class is on V2, quite a lot of things
have changed and just by looking at the IBM DB2 site, you could find
that they have both comp. based courses (no travel) as well as Web based
(no travel) courses. All of the Docs. for DB2 are on line and can be
searched in a much easier fashion then paper docs. As you can do
contextual searches, you can find all the manuals and their sections
where DB2INSTANCE or DB2INSTDEF or db2set,, are discussed.

HTH, Pierre.
With best wishes.

Stanley Sinclair

--
Pierre Saint-Jacques
IBM DB2 Cerified Solutions Expert - Administration
SES Consultants Inc.

[Sabine Perathoner]

Hi Stan,

I suppose the problem with the setting of the DB2INSTANCE variable is
solved now. Is the NSE service registered for the newly created instance,
and can you start it with db2text start?

Did you already try to run the sample?

The DB2DBDFT variable must be set as environment variable to be
interpreted by NSE. (not via db2set)
But you don't necessarily need the variable, as stated in my first
posting:

>>>>>>>>>>>>>>>>>> Problem with DB2DBDFT:
try to add following clause to your commands instead of using DB2DBDFT:
' ... connect to <databasename>'
For example:
db2text "CREATE INDEX db2ext.myTextIndex FOR TEXT ON books (story)
CONNECT TO sample">>>>>>>>>>>>>>>>>>

To see a list of the NSE administration commands:
db2text help
To see the syntax for a specific command:
db2text help <command>
For example:
db2text help enable

Please feel free to contact me directly if you need additional help with
NSE.

Kind regards,
Sabine
Stanley Sinclair wrote:
I tried to respond to p.*********@videotron.ca, but the message was
repeatedly refused with error "not our customer."

I wrote in French, as I am an expatriate québecois; I didn't want to
post it here. It was a thank-you and a request for information about
videotron and SES Consultants.

Stan

[Database Guy]

st*************@bellsouth.net (Stanley Sinclair) wrote in message news:<6f**************************@posting.google. com>...

Dear Mr Guy,

First, please read the first lines of the first item in this thread.
I'm afraid that I, again, got carried away in some of the things that
I said.
As you said, this was is your first post, not the subsequent ones (one
of which I replied to). So now you're saying that your apology should
not have been seen as an apology for past posts, so much as a
declaration of intent for future ones?
However, it would have been very pleasant if you were to help instead
of trying to poke fun of me in your superiority.

If I was poking fun it was in response to the attitude you struck.
It's one to say that you want help, qite another to start slagging off
a product and blaming it for nearly losing your job, when it's quite
obvious you have next to no knowledge of the basics (and I did check
your other posts before replying BTW). There may be genuine problems
with Net Search Extender, I don't know; but reading your post I wasn't
very convinced.

Bottom line is you are likely to have just as many problems (if not
more) with Oracle unless you have a deeper Oracle background - it's a
famously tricky product to administer, whereas you might find SQL
Server a bit easier than both Oracle and DB2. Good luck with it
anyway.
DG

[Stanley Sinclair]

Dear Mr Guy,

I wish I could say that I'm sorry for upsetting you, but I'm not. In
your writings in this thread you have said nothing that would help me,
only criticism and sarcasm.

The purpose of this forum is for those without certain knowledge to
request that knowledge from those with the knowledge. No matter how
elementary. (I have been working mostly on interfaces for the past
few years, and am out-of-touch with newer database techniques and
processes. But I believe that, with a little help I can quickly be up
to speed.)

If you have knowledge which could have helped me, you have very
studiously kept it to yourself.

Well, now: Please relax, giggle to yourself, but do not respond.

SS

[Stanley Sinclair]

I tried to respond to p.*********@videotron.ca, but the message was
repeatedly refused with error "not our customer."

I wrote in French, as I am an expatriate québecois; I didn't want to
post it here. It was a thank-you and a request for information about
videotron and SES Consultants.

Stan