Lightbulb Efficient way to take count for multiple strings from a huge log file.

Can't Post

Hi all,

I have a huge log [more than 1 GB] file generate from server everyday. I am checking the all exception from the file, send count for each every exception and transaction. The log contains 24 hour data and I need to take only for a time 5:00 am to 5:00 pm. I used a shell script to do it but its take huge time. I will explain here how I have done in the shell script.

I used the command SED for taking 5 to 5 from the log file first like the below

My problem is this script is taking huge time and I am greping the string again & again in the file and opening the file frequently. I know this will be done in perl very quick and easily. So please help me on this Is there any way is available to tune my script using perl.

Re: [senthilkumar_ak] Lightbulb Efficient way to take count for multiple strings from a huge log file.
[In reply to]

Can't Post

In Reply To

My problem is this script is taking huge time and I am greping the string again & again in the file and opening the file frequently. I know this will be done in perl very quick and easily. So please help me on this Is there any way is available to tune my script using perl.

1GB files are going to take a lot of time to process regardless of what software you use.