| Linux - Server This forum is for the discussion of Linux Software used in a server related context. |
| Notices |
Welcome to LinuxQuestions.org, a friendly and active Linux Community.
You are currently viewing LQ as a guest. By joining our community you will have the ability to post topics, receive our newsletter, use the advanced search, subscribe to threads and access many other special features. Registration is quick, simple and absolutely free. Join our community today!
Note that registered members see fewer ads, and ContentLink is completely disabled once you log in.
Are you new to LinuxQuestions.org? Visit the following links:
Site Howto |
Site FAQ |
Sitemap |
Register Now
If you have any problems with the registration process or your account login, please contact us. If you need to reset your password, click here.
Having a problem logging in? Please visit this page to clear all LQ-related cookies.
 |
GNU/Linux Basic Guide
This 255-page guide will provide you with the keys to understand the philosophy of free software, teach you how to use and handle it, and give you the tools required to move easily in the world of GNU/Linux. Many users and administrators will be taking their first steps with this GNU/Linux Basic guide and it will show you how to approach and solve the problems you encounter.
Click Here to receive this Complete Guide absolutely free. |
|
 |
10-11-2010, 02:51 AM
|
#1
|
|
Member
Registered: Aug 2009
Posts: 64
Rep: 
|
Sample Squid Proxy Log Files
hi
I'm doing a research for my MSc analyzing the patterns in squid proxy logs. for that I need sample squid proxy log files which are freely avaliable to refer.
It's great help for me to provide some proxy log files or providing links to download them.
your responses are highly.
tnx
|
|
|
|
|
10-11-2010, 03:20 AM
|
#2
|
|
Member
Registered: Sep 2010
Posts: 56
Rep: 
|
What type of logs do you want or after for? the proxy access logs?
|
|
|
|
|
10-11-2010, 06:18 AM
|
#3
|
|
Member
Registered: Aug 2009
Posts: 64
Original Poster
Rep:
|
Sample Squid Proxy Log Files
Hi leejohnli ,
My requirement is to analyze the sites which browsed and retreival time of those sites.Based on this I analyze a pattern (ex: browse site and time), propose a solution.
I really appreciate your kind support.
tnx
|
|
|
|
|
10-12-2010, 05:10 AM
|
#4
|
|
Senior Member
Registered: Apr 2007
Location: bbsr,orissa,India
Distribution: RHEL5 ,RHEL4,CENT OS5,FEDORA,
Posts: 1,261
Rep:
|
Take this squidaccess.log:
Last edited by divyashree; 10-12-2010 at 05:12 AM.
|
|
|
|
|
10-12-2010, 05:12 AM
|
#5
|
|
Senior Member
Registered: Apr 2007
Location: bbsr,orissa,India
Distribution: RHEL5 ,RHEL4,CENT OS5,FEDORA,
Posts: 1,261
Rep:
|
Squid cache.log:
Code:
2010/10/03 04:02:08| storeDirWriteCleanLogs: Starting...
2010/10/03 04:02:08| Finished. Wrote 0 entries.
2010/10/03 04:02:08| Took 0.0 seconds ( 0.0 entries/sec).
2010/10/03 04:02:08| logfileRotate: /var/log/squid/store.log
2010/10/03 04:02:08| logfileRotate: /var/log/squid/access.log
2010/10/03 04:02:08| helperOpenServers: Starting 50 'squid_ldap_auth' processes
2010/10/03 12:17:45| Preparing for shutdown after 12 requests
2010/10/03 12:17:45| Waiting 30 seconds for active connections to finish
2010/10/03 12:17:45| FD 60 Closing HTTP connection
2010/10/03 12:17:45| FD 62 Closing HTTP connection
2010/10/03 12:18:16| Shutting down...
2010/10/03 12:18:16| FD 63 Closing ICP connection
2010/10/03 12:18:16| Closing unlinkd pipe on FD 61
2010/10/03 12:18:16| storeDirWriteCleanLogs: Starting...
2010/10/03 12:18:16| Finished. Wrote 0 entries.
2010/10/03 12:18:16| Took 0.0 seconds ( 0.0 entries/sec).
CPU Usage: 0.143 seconds = 0.046 user + 0.097 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 1
Memory usage for squid via mallinfo():
total space in arena: 2912 KB
Ordinary blocks: 2855 KB 36 blks
Small blocks: 0 KB 6 blks
Holding blocks: 244 KB 1 blks
Free Small blocks: 0 KB
Free Ordinary blocks: 56 KB
Total in use: 3099 KB 98%
Total free: 56 KB 2%
2010/10/03 12:18:16| Squid Cache (Version 2.6.STABLE21): Exiting normally.
2010/10/08 16:38:32| Starting Squid Cache version 2.6.STABLE21 for i686-redhat-linux-gnu...
2010/10/08 16:38:32| Process ID 26076
2010/10/08 16:38:32| With 1024 file descriptors available
2010/10/08 16:38:32| Using epoll for the IO loop
2010/10/08 16:38:32| DNS Socket created at 0.0.0.0, port 51616, FD 6
2010/10/08 16:38:32| Adding nameserver 202.56.215.54 from /etc/resolv.conf
2010/10/08 16:38:32| Adding nameserver 192.168.1.1 from /etc/resolv.conf
2010/10/08 16:38:32| helperOpenServers: Starting 50 'squid_ldap_auth' processes
2010/10/08 16:38:33| User-Agent logging is disabled.
2010/10/08 16:38:33| Referer logging is disabled.
2010/10/08 16:38:33| Unlinkd pipe opened on FD 61
2010/10/08 16:38:33| Swap maxSize 10485760 + 8192 KB, estimated 0 objects
2010/10/08 16:38:33| Target number of buckets: 40361
2010/10/08 16:38:33| Using 65536 Store buckets
2010/10/08 16:38:33| Max Mem size: 8192 KB
2010/10/08 16:38:33| Max Swap size: 10485760 KB
2010/10/08 16:38:33| Local cache digest enabled; rebuild/rewrite every 3600/3600 sec
2010/10/08 16:38:33| Rebuilding storage in /var/spool/squid (CLEAN)
2010/10/08 16:38:33| Using Least Load store dir selection
2010/10/08 16:38:33| Set Current Directory to /var/spool/squid
2010/10/08 16:38:33| Loaded Icons.
2010/10/08 16:38:33| Accepting proxy HTTP connections at 192.168.0.1, port 3128, FD 63.
2010/10/08 16:38:33| Accepting proxy HTTP connections at 127.0.0.1, port 3128, FD 64.
2010/10/08 16:38:33| Accepting ICP messages at 0.0.0.0, port 3130, FD 65.
2010/10/08 16:38:33| WCCP Disabled.
2010/10/08 16:38:33| Ready to serve requests.
2010/10/08 16:38:33| Done reading /var/spool/squid swaplog (0 entries)
2010/10/08 16:38:33| Finished rebuilding storage from disk.
2010/10/08 16:38:33| 0 Entries scanned
2010/10/08 16:38:33| 0 Invalid entries.
2010/10/08 16:38:33| 0 With invalid flags.
2010/10/08 16:38:33| 0 Objects loaded.
2010/10/08 16:38:33| 0 Objects expired.
2010/10/08 16:38:33| 0 Objects cancelled.
2010/10/08 16:38:33| 0 Duplicate URLs purged.
2010/10/08 16:38:33| 0 Swapfile clashes avoided.
2010/10/08 16:38:33| Took 0.3 seconds ( 0.0 objects/sec).
2010/10/08 16:38:33| Beginning Validation Procedure
2010/10/08 16:38:33| Completed Validation Procedure
2010/10/08 16:38:33| Validated 0 Entries
2010/10/08 16:38:33| store_swap_size = 0k
2010/10/08 16:38:34| storeLateRelease: released 0 objects
2010/10/08 16:39:13| Reconfiguring Squid Cache (version 2.6.STABLE21)...
2010/10/08 16:39:13| FD 63 Closing HTTP connection
2010/10/08 16:39:13| FD 64 Closing HTTP connection
2010/10/08 16:39:13| FD 65 Closing ICP connection
2010/10/08 16:39:13| Cache dir '/var/spool/squid' size remains unchanged at 10485760 KB
2010/10/08 16:39:13| Initialising SSL.
2010/10/08 16:39:13| User-Agent logging is disabled.
2010/10/08 16:39:13| Referer logging is disabled.
2010/10/08 16:39:13| DNS Socket created at 0.0.0.0, port 43711, FD 8
2010/10/08 16:39:13| Adding nameserver 202.56.215.54 from /etc/resolv.conf
2010/10/08 16:39:13| Adding nameserver 192.168.1.1 from /etc/resolv.conf
2010/10/08 16:39:13| helperOpenServers: Starting 15 'adzapper' processes
2010/10/08 16:39:13| helperOpenServers: Starting 50 'squid_ldap_auth' processes
2010/10/08 16:39:15| Accepting transparently proxied HTTP connections at 192.168.0.1, port 3128, FD 76.
2010/10/08 16:39:15| Accepting transparently proxied HTTP connections at 127.0.0.1, port 3128, FD 77.
2010/10/08 16:39:15| Accepting ICP messages at 0.0.0.0, port 3130, FD 78.
2010/10/08 16:39:15| WCCP Disabled.
2010/10/08 16:39:15| Loaded Icons.
2010/10/08 16:39:15| Ready to serve requests.
2010/10/08 16:41:45| Reconfiguring Squid Cache (version 2.6.STABLE21)...
2010/10/08 16:41:45| FD 76 Closing HTTP connection
2010/10/08 16:41:45| FD 77 Closing HTTP connection
2010/10/08 16:41:45| FD 78 Closing ICP connection
2010/10/08 16:41:45| Cache dir '/var/spool/squid' size remains unchanged at 10485760 KB
2010/10/08 16:41:45| Initialising SSL.
2010/10/08 16:41:45| User-Agent logging is disabled.
2010/10/08 16:41:45| Referer logging is disabled.
2010/10/08 16:41:45| DNS Socket created at 0.0.0.0, port 49341, FD 8
2010/10/08 16:41:45| Adding nameserver 202.56.215.54 from /etc/resolv.conf
2010/10/08 16:41:45| Adding nameserver 192.168.1.1 from /etc/resolv.conf
2010/10/08 16:41:45| helperOpenServers: Starting 15 'adzapper' processes
2010/10/08 16:41:46| helperOpenServers: Starting 50 'squid_ldap_auth' processes
2010/10/08 16:41:48| Accepting transparently proxied HTTP connections at 192.168.0.1, port 3128, FD 76.
2010/10/08 16:41:48| Accepting transparently proxied HTTP connections at 127.0.0.1, port 3128, FD 77.
2010/10/08 16:41:48| Accepting ICP messages at 0.0.0.0, port 3130, FD 78.
2010/10/08 16:41:48| WCCP Disabled.
2010/10/08 16:41:48| Loaded Icons.
2010/10/08 16:41:48| Ready to serve requests.
2010/10/08 16:42:00| Preparing for shutdown after 103 requests
2010/10/08 16:42:00| Waiting 30 seconds for active connections to finish
2010/10/08 16:42:00| FD 76 Closing HTTP connection
2010/10/08 16:42:00| FD 77 Closing HTTP connection
2010/10/08 16:42:31| Shutting down...
2010/10/08 16:42:31| FD 78 Closing ICP connection
2010/10/08 16:42:31| WARNING: Closing client 192.168.0.227 connection due to lifetime timeout
2010/10/08 16:42:31| http://v15.lscache3.c.youtube.com/videoplayback?ip=0.0.0.0&sparams=id%2Cexpire%2Cip%2Cipbits%2Citag%2Calgorithm%2Cburst%2Cfactor%2Coc%3AU0dXS1VRTl9FSkNNN19NS1JJ&fexp=901306%2C903103&algorithm=throttle-factor&itag=34&ipbits=0&burst=40&sver=3&expire=1286560800&key=yt1&signature=10276745AAE8D3FE43EC0CD217C73129D51C3210.09D5D0E1D9204C2046820E7B58B291B9D7EE3DDE&factor=1.25&id=01b7223b29a92f9a&
2010/10/08 16:42:31| Closing unlinkd pipe on FD 61
2010/10/08 16:42:31| storeDirWriteCleanLogs: Starting...
2010/10/08 16:42:31| Finished. Wrote 8 entries.
2010/10/08 16:42:31| Took 0.0 seconds (47904.2 entries/sec).
CPU Usage: 0.424 seconds = 0.175 user + 0.249 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 1
Memory usage for squid via mallinfo():
total space in arena: 3356 KB
Ordinary blocks: 3281 KB 95 blks
Small blocks: 0 KB 5 blks
Holding blocks: 504 KB 2 blks
Free Small blocks: 0 KB
Free Ordinary blocks: 74 KB
Total in use: 3785 KB 98%
Total free: 74 KB 2%
2010/10/08 16:42:31| Squid Cache (Version 2.6.STABLE21): Exiting normally.
|
|
|
|
|
10-12-2010, 11:00 PM
|
#6
|
|
Member
Registered: Aug 2009
Posts: 64
Original Poster
Rep:
|
Sample Squid Proxy Log Files
hi all,
tnx a lot for your kind support.Is it posssible you to provide me logs for at least last month since using one or two days its difficult to analyze a pattern. don't make this as a distubance for you.
this is a kind request for you.
tnx
|
|
|
|
|
09-13-2012, 07:42 PM
|
#7
|
|
LQ Newbie
Registered: Aug 2011
Location: Philippines
Distribution: CentOS
Posts: 5
Rep: 
|
Hi,
You may want to explore SARG (Squid Analysis Report Generator)
This will analyze your access.log and can be run on a scheduled basis.
Useful Link : http://adlinux.blogspot.com/2009/07/...gure-sarg.html |
|
|
|
| Thread Tools |
Search this Thread |
|
|
|
Posting Rules
|
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
HTML code is Off
|
|
|
All times are GMT -5. The time now is 09:28 PM.
|
|
|
LinuxQuestions.org is looking for people interested in writing
Editorials, Articles, Reviews, and more. If you'd like to contribute
content, let us know.
|
|
 Latest Threads
LQ News
|
|
