471,319 Members | 1,958 Online
Bytes | Software Development & Data Engineering Community
Post +

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 471,319 software developers and data experts.

Building a Syslog Server

Hello.

I am needing some advice. I need to build a syslog server that writes
to a sql backend.
I am concerned about the server not being able to handle multiple
requests. For example on an enterprise network, I may need to handle a
large number of requests. I assume a thread pool will be needed but I'm
wondering what other advice some of you might have?

Thanks in advance.

-A

Jan 21 '06 #1
8 11078
Guy,

You wouldn't need to do this at all. SQL Server is built from the
ground up to handle multiple requests from multiple sources and not worry
about contention.

The only thing you have to worry about is if you are going to issue
multiple statements at the same time, and want them treated as an atomic
action (using a transaction), but that logic is up to you.

Hope this helps.
--
- Nicholas Paldino [.NET/C# MVP]
- mv*@spam.guard.caspershouse.com
"Guy Noir" <ah******@gmail.com> wrote in message
news:11**********************@z14g2000cwz.googlegr oups.com...
Hello.

I am needing some advice. I need to build a syslog server that writes
to a sql backend.
I am concerned about the server not being able to handle multiple
requests. For example on an enterprise network, I may need to handle a
large number of requests. I assume a thread pool will be needed but I'm
wondering what other advice some of you might have?

Thanks in advance.

-A

Jan 21 '06 #2
Nicholas, thanks for the reply.

What I am worried about is when the server is handling the inbound udp
message will it miss other incoming messages?

Thanks again
-A

Jan 21 '06 #3
Guy,

You shouldn't be worried about SQL Server when it handles incoming
messages. It handles concurrent messages fine on it's own.
--
- Nicholas Paldino [.NET/C# MVP]
- mv*@spam.guard.caspershouse.com

"Guy Noir" <ah******@gmail.com> wrote in message
news:11**********************@g49g2000cwa.googlegr oups.com...
Nicholas, thanks for the reply.

What I am worried about is when the server is handling the inbound udp
message will it miss other incoming messages?

Thanks again
-A

Jan 21 '06 #4
Guy,
you would need to build a multithreaded UDPClient Server (probably a windows
service) to receive the SysLog messages.

I just finished one and I used Ami Bar's "Smart Threadpool" to handle the
thread pooling needs. I'd happily share some code, but I can't under my NDA.
Hope that helps.
Peter

--
Co-founder, Eggheadcafe.com developer portal:
http://www.eggheadcafe.com
UnBlog:
http://petesbloggerama.blogspot.com


"Guy Noir" wrote:
Hello.

I am needing some advice. I need to build a syslog server that writes
to a sql backend.
I am concerned about the server not being able to handle multiple
requests. For example on an enterprise network, I may need to handle a
large number of requests. I assume a thread pool will be needed but I'm
wondering what other advice some of you might have?

Thanks in advance.

-A

Jan 21 '06 #5

"Guy Noir" <ah******@gmail.com> wrote in message
news:11**********************@z14g2000cwz.googlegr oups.com...
Hello.

I am needing some advice. I need to build a syslog server that writes
to a sql backend.
I am concerned about the server not being able to handle multiple
requests. For example on an enterprise network, I may need to handle a
large number of requests. I assume a thread pool will be needed but I'm
wondering what other advice some of you might have?

Thanks in advance.

-A


Rather than reinventing the wheel, you may consider looking at Kiwi Syslog
Daemon. It runs as a Windows service and will log to number of different
targets, such a text files or ODBC data sources. We're using it on our
network to capture Syslog output from a number of network devices and Unix
servers. We have it configured to log to a SQL Server database. It works
quite well and the prices isn't too bad either, about $100, I believe.

http://www.kiwisyslog.com

CVD
Jan 21 '06 #6
Excellent idea, I never even thought to mention it.

Although in my case we need to be able to do message / priority / facility
parsing with a rules engine that can forward to another SysLog server, send
an SMS or email message, forward to MSMQ, and log to a SQL Server backend all
at the same time.
Peter

--
Co-founder, Eggheadcafe.com developer portal:
http://www.eggheadcafe.com
UnBlog:
http://petesbloggerama.blogspot.com


"Cletus Van Damme" wrote:

"Guy Noir" <ah******@gmail.com> wrote in message
news:11**********************@z14g2000cwz.googlegr oups.com...
Hello.

I am needing some advice. I need to build a syslog server that writes
to a sql backend.
I am concerned about the server not being able to handle multiple
requests. For example on an enterprise network, I may need to handle a
large number of requests. I assume a thread pool will be needed but I'm
wondering what other advice some of you might have?

Thanks in advance.

-A


Rather than reinventing the wheel, you may consider looking at Kiwi Syslog
Daemon. It runs as a Windows service and will log to number of different
targets, such a text files or ODBC data sources. We're using it on our
network to capture Syslog output from a number of network devices and Unix
servers. We have it configured to log to a SQL Server database. It works
quite well and the prices isn't too bad either, about $100, I believe.

http://www.kiwisyslog.com

CVD

Jan 21 '06 #7
>Excellent idea, I never even thought to mention it.

Although in my case we need to be able to do message / priority / facility
parsing with a rules engine that can forward to another SysLog server, send
an SMS or email message, forward to MSMQ, and log to a SQL Server backend all
at the same time.


You can do that with Kiwi Syslog and NotePage's software - they have some info
about it here: http://www.notepage.net/kiwi-syslog/kiwi-syslog.htm

HTH
R. Crane

Jan 22 '06 #8
Peter, thanks for the link to Ami Bar's "Smart Threadpool".

I have used kiwi in the past as some have suggested, however I'm trying
to develop a turnkey package. (I have the client piece/service already
written.)

Do you have a suggestion as to the number of threads in the pool vs the
number of simultaneous udp syslog messages being fired at the server?

tia!!

-Aaron

Jan 23 '06 #9

This discussion thread is closed

Replies have been disabled for this discussion.

Similar topics

1 post views Thread by Erich Trowbridge | last post: by
5 posts views Thread by Micha³ Wo¼niak | last post: by
reply views Thread by Stephen Touset | last post: by
1 post views Thread by Gregory Starck | last post: by
3 posts views Thread by Troels Arvin | last post: by
1 post views Thread by Lincoln Yeoh | last post: by

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.