Resources
From ChekMate Security Group
Application Security
- Application Security Assessments Advice on Assessing your Custom Application by Gunter Ollmann
- Open Web Application Security Project (OWASP) is dedicated to enabling organizations to develop, purchase, and maintain applications that can be trusted.
Application Monitoring
- H.323 Beacon is a tool that can be used to measure, qualify and troubleshoot performance of H.323 Videoconference sessions both at the network and host levels (end-to-end) http://www.itecohio.org/beacon
- aslookup tool searches the sequence of AS number specified with the parameter from IRR and indicates the first line of Description of AS Object. http://www.bugest.net/software/aslookup/index-e.html
- arpwatch, ftp://coast.cs.purdue.edu/pub/tools/unix/netutils/arpwatch/ if this link fails then you can FTP it from ftp://ftp.ee.lbl.gov/arpwatch.tar.Z (since this is the master repository it may also be a more recent version than the one above).
- Big Brother http://bb4.com/ and its clone Big Sister http://bigsister.graeff.com/ consists of local clients that test system conditions and the availability of network services, and send these status reports to one or more DISPLAY servers where these reports appear as little dots on a web page, or PAGER servers that notify administrators about system problems.
- Dig http://ciac.llnl.gov/ciac/ToolsUnixGeneral.html#Dig
- Netdisco http://netdisco.org/ is an Open Source web-based network management tool. Designed for moderate to large networks, configuration information and connection data for network devices are retrieved by SNMP. With Netdisco you can locate the switch port of an end-user system by IP or MAC address. Data is stored using a SQL database for scalability and speed. It also provide optional use of the Cisco Discovery Protocol (CDP).
- D-ITG (Distributed Internet Traffic Generator) http://www.grid.unina.it/software/ITG/ is a platform (collection of tools) capable of producing traffic (network, transport and application layer) and of accurately replicating appropriate stochastic processes for both IDT (Inter Departure Time) and PS (Packet Size) random variables (exponential, uniform, cauchy, normal, pareto, ...)
Architecture
Auditing & Assessments
Authentication
- Password Safe Encrypted database for storage and generation of passwords
Backup Strategies
- Making secure remote backups with Rsync
- Installing RSYNC on Windows 2003/XP/2000/NT
- Backups using rsync
Best Practices
- NIST 800-18 Guide for Security Information Technology Systems PDF
- NIST IT Contigency Planning Guide PDF
Certifications
- Cisco Certifications: http://cisco.com/certification
Disaster Recovery
Distributions
- http://www.babytux.org/articles/howto/how2livecd.php - Example uses Mandrake but any distro should be possible.
- http://www.livedistro.org/search/node/gentoo LiveDistro's Gentoo Documentation
- ChekMate Live We are in the process of building a Knoppix Live CD Snort Sensor specific to our Snort deployment. Knowledge gained will be used for other Live CD deployments.
- CHAOS/openMosix Linux Cluster Distribution
- Building Your Own Live CD Create your own special-purpose live CD distribution with these little-known secrets of bootable CDs.
- 10 Best Security Live CD Distros (Pen-Test, Forensics & Recovery) Darknet.org summarizes ten different security based LiveCDs and rates them. A good article for figuring out which security LiveCD to add to your toolbox.
- BackTrack is the result of the merging of two Innovative Penetration Testing live Linux distributions - Whax and Auditor. Combining the best features from both distributions, and paying special attention to small details, this is probably the best version of either distributions to ever come out. Based on SLAX (Slackware), BackTrack provides user modularity. This means the distribution can be easily customised by the user to include personal scripts, additional tools, customised kernels, etc.
- VMWare FreeBSD Sguil image available from Taosecurity.blogspot.com
- The Auditor Security Collection is a Live-System based on KNOPPIX.
- Operator v3.3.20 (http://ussysadmin.com/operator/) contains an extensive set of Open Source network security tools for monitoring, discovering networks, computer forensic and data recovery tools on a Debian KNOPPIX CD.
- Anonym.OS LiveCD by kaos theory is an OpenBSD 3.8 Live CD with strong tools for anonymizing and encrypting connections. Standard network applications are provided and configured to take advantage of the tor onion routing network.
- Stillsecure, a sponsor of Bleeding Snort, has a preconfigured setup of the free version of Strata Guard available as a VMWare Player image.
eCommerce
Education
- National Center for Forensic Science - Provides research, education, training, tools and technology to meet the current and future needs of the forensic science, investigative and criminal justice communities.
- ComputerForensics - Serving government and private sectors with university based forensic training
- http://www.ecst.csuchico.edu/~dranch/LINUX/function.s Tutorial on Basic Unix Hacking guide
Whitepapers from http://www.redsiren.com/:
- The GLBA Hidden Hammer: Understanding the Gramm-Leach-Bliley Act's Requirements For Safeguarding Networked Customer Information
- Building the Better Mousetrap: An Analysis of Security Management Systems
- Think Secure: Building a Security-Minded Workforce
- Computer Forensics: What Lawyers and Managers Should Know
- Beyond the Firewall: The Value of Intrusion Detection Services
- Firewalls: Verifying the Facts & Disputing the Myths About Your Network's First Line of Defense
- A Prescription For Success: Compliance with the Health Insurance Portability and Accountability Act (HIPAA)
Whitepapers from http://www.forensics.com/:
- Instant Messaging: What You Can't See Can Hurt You (In Court) By Deborah H. Juhnke & David P. Stenhouse
- Can New Technology Solve the Problem? A Look at the Future of Electronic Discovery By Deborah H. Juhnke
- Collecting and Preserving Electronic Media By Joan E. Feldman
- Cyber Terrorism or Cyber Crime? By Deborah H. Juhnke
- Discovery of Databases in Litigation By Deborah H. Juhnke
- Effective Data Searches By Joan E. Feldman
- Electronic Discovery in 2010 By Deborah H. Juhnke
- Electronic Risk Control By Joan E. Feldman
- Email and Other Electronic Data: Treasure Troves of Evidence By Joan E. Feldman
- The Essentials of Computer Discovery By Joan E. Feldman
- Essentials of Electronic Discovery: Finding and Using Cyber Evidence By Joan E. Feldman
- Everything You Wanted to Know About Email Discovery But Were Afraid to Ask By Joan E. Feldman
- Expert’s Role in Computer Based Discovery By Joan E. Feldman
- Finding the Elusive 1% By Deborah H. Juhnke
- Lost? No. Found? Yes. Those Computer Tapes and Emails Are Evidence By Joan E. Feldman
- Reducing Exposure in Litigation By Deborah H. Juhnke
- Show Me the Money: Cost Concerns in Computer Discovery By Joan E. Feldman, Deborah H. Juhnke, James L. Michalowicz, and Jonathan M. Redgrave
- Ten Steps to Successful Computer-Based Discovery By Joan E. Feldman
- Ten Ways to Torpedo your Data Discovery Expert By Deborah H. Juhnke
- Top Ten Things to Do When Collecting Electronic Evidence By Joan E. Feldman
- Where Litigation Support Ends and Electronic Discovery Begins By Deborah H. Juhnke
- Why Use A Discovery Referee? By Richard E. Best
- Zubulake – Toward a Path of Reasonableness in Computer Discovery By Deborah H. Juhnke
Encryption
- SimpLite Secure MSN Messenger Highly Recommend! By encrypting messages before they leave your computer to the Internet, SimpLite-MSN prevents eavesdroppers from reading your personal MSN Messenger conversations.
- Hardening Linux
- How to Configure Apache Authentication with Active Directory
- Securing Linux Step-by-Step
- Enigmail GPG Encrypted/Signed email plugin for Thunderbird
- WinPT Digital signiture and publickey encryption - GPG/PGP frontend
- TrueCrypt Encrypted drive, similar to loop-aes for Linux
- TrinityOS A Guide to Configuring Your Linux Server for Performance, Security, and Manageability
- Encrypt your harddrive with 256bit AES encryption (dm-crypt & >= linux-2.6.4)
- Security and Encryption FAQ
- SSH Tunnels (Linux to Linux, but also relevant from Windows to Linux)
- Adjusting The Way Bash History Functions
- HOWTO Anonymity with Tor and Privoxy
- HOWTO Encrypt Your Home Directory Using CFS
- PaX
- Rainbow Tables
- Anonymizing UNIX Systems
- Clear screen on logout
- Debugging with Hardened Gentoo
- Emailing with smartcards
- Encrypting Root Filesystem with DM-Crypt
- SECURITY Index
- Intruder Detection Checklist
- Limit User Processes
- Logical Levels of Defence
- SSH without a password
- Secure Instant Messaging
- dmcrypt
- Stack smash protection
- Cisco Password Recovery Procedures
- Cisco Catalyst Secure Template
- Cisco VPNClient Password Decoder
This script uses: "ltrace -i ./vpnclient connect ... 2>&1 | fgrep 805ac57" to decode passwords. (client: vpnclient-linux-4.0.3.B-k9). This does not work with newer versions of the Linux vpnclient, e.g. 4.6. It has something in it to defeat ltrace (clearly in response to publicicity about the vulnerability). Might be just some of the privilege separation voodoo which breaks ltrace. Cisco did not changed the encoding method, so the above online decoder does still work.
- Free Password Breakers
- Tempest, van Eck phreaking, and High Tech Tinfoil
- SECURITY - Stub
- Template Listing
- Template:SECURITY Index
Enterprise Security
- Passive Information Gathering - The Analysis of Leaked Network Security Information by Gunter Ollmann
- Instant Messenger Security Securing Against the ‘Threat’ of Instant Messengers by Gunter Ollmann
Exploits
- Cisco Security Advisory: Cisco Optical Networking System 15000 Series and Cisco Transport Controller Vulnerabilities
- FrSIRT Exploit Database http://www.frsirt.com/exploits/
- NetBios Exploit
- Metasploit Framework is an advanced open-source platform for developing, testing, and using exploit code. This project initially started off as a portable network game and has evolved into a powerful tool for penetration testing, exploit development, and vulnerability research.
- milw0rm.com
- milw0rm Remote Exploits
- milw0rm Local Exploits
Finger Printing
- Nmap http://www.insecure.org/nmap/ is a utility for port scanning of large networks, although it works fine for single hosts.
- OPENXTRA has a version (NMapWin) for Windows http://www.openxtra.com/.
- TBIT TCP Behavior Inference Tool http://www.icir.org/tbit/
Firewall & Perimeter Protection
- Cisco Password Recovery Procedures
- El Cheapo Router Challenge broadbandreports.com
- Blake (a Calgarian) solicits the members of BBR to get an unsolicited packet through the NAT/Firewall of several popular home routers.
- Challenge Delivered
- First Winner
- Kerio, Sygate, ZoneAlarm Personal firewalls. Sygate and Kerio's firewalls are more advanced than ZoneAlarm
pf Firewall
The pf firewall is a BSD licenced firewall that showed up around OpenBSD 3.0. It has been adopted by FreeBSD, NetBSD and a few others. It is known for it's clarity in configuration and flexibility with large feature set. QoS, statefull failover, and a large feature set for logging and authetication make this a firewall of choice for some users of this site.
FAQs and Docs
- OpenBSD pf FAQ
- The pf Firewall from it's primary developer
- Peter N. M. Hansteen's great pf tutorial.
Configuration help
- Eric Bullen's Newbie pf Guide
- Shreveport/Bossier Linux Users Group's Example Lockdown config for pf with QoS
Logging and Monitoring
iptables example rulesets and utility programs
(Mirrored from Daniel De Graaf's web site with permission. http://daniel.6dns.org/info/iptables/)
Programs
Ruleset manipulation
- confread, which allows you to make a more english-like configuration file (example)
- view, which displays a summary of the iptables rules from an iptables-restore file, or if run as root with no arguments, the current table
- mkscript, which converts these rulesets to shell scripts
- patch, which takes two rulesets and outputs a script to move from one to the other (needs IPTables.pm)
Ruleset debugging
- trace - allows you to see what actions are taken on a packet as it goes through iptables. Use -v to see each rule that is checked. This script uses IPTables.pm. There is no relation between this and the TRACE target
- TRACE target - add this to the raw table (like iptables -t raw -A PREROUTING -j TRACE) and the packets will be traced in the system log. This target requires that you patch your kernel and iptables binaries with patch-o-matic and recompile them. See the README for a quick howto
- nfsim - full kernel-level simulation of netfilter code. More useful for debugging the kernel modules, but you can debug or test a ruleset with it
Log analysis
- adcfw-log - firewall log analyzer/summarizer with several types of reports
- IptablesWeb - Inspect iptables logs using a web browser, PHP, and MySQL
- fire-log, which either displays a summary of firewall logs or runs a continuous summary. Config file
Administration tools
- ulogd - if you are using the LOG target for more than just debugging, ULOG is better for several reasons: it doesn't fill up dmesg, logs to a separate file or even database, and can log in tcpdump format
- conntrack - Kernel 2.6.14 and later lets you manipulate the conntrack table from userspace. This program can list, add, remove, or clear entries from the conntrack table
- ctview - a perl ncurses-based frontend to the conntrack tool above. Entries with an endpoint on the local system are resolved to the owning pid, uid, and command. You can also delete any entry by using 'd' when it is selected
Frontends
If you don't want to learn iptables, you can use one of several frontends to it. I haven't personally used any of them, but other people like them. There are many more on google; there are just the ones I have looked at.
- KIptablesGenerator - a graphical frontend to iptables that generates a script and lets you configure allowed ports and NAT
- ipkungfu - generates an iptables ruleset from a set of config files in /etc/ipkungfu/. Allows both simple and complex configuration including NAT and logging, or custom rules if needed
Example rulesets
Simpler rulesets are at the start, with more complex scripts near the end. All rulesets are in iptables-save format and I discuss their use below.
Empty Script
- empty - this resets the firewall to an accept-all policy. Ignore any "unable to initialize table" rules
Single host
- minimal - no open ports, logging, or anything else. Good starting place
- ssh for single host - allow SSH connections from a single IP address (1.8.9.7)
- simple - two open services, DNS and WWW
- simple+log - same, but with logging to syslog
- simple+ulog - log to ulog (need ulogd running; creates a separate firewall log)
- server - basic server. Mail, dns, www, ssh access from local network (10.0.0.0/8) and another host
- outbound filtering by UID. This is usually not needed, but can provide an extra barrier to certain attacks (for example, an exploit on the http server would not be able to create a spambot or connect to a controlling host)
Normal router
- MAC filtering - bind a specific MAC to an IP. This can be spoofed, but it requires finding an unused mac-ip pair and taking them. Eth1 is local network, eth0 is the internet link, all requests come from a single MAC.
NAT Router
- NAT router - simple NAT router, no open or forwarded ports; eth1 is local network, eth0 is dynamic IP
- Port forward - NAT router with port 80 forwarded to 10.0.0.2 and port 25 open on the router; with logs
- DMZ router - NAT router with a DMZ of 10.0.0.* and clients on 10.0.1.*; one mail&ssh server and one ftp&web server.
- complex - NAT, server, port-knocking, portscan-blocking, logging, bad-source-block, ipv6, ... this was generated from this configuration file by confread, and commented to be more readable.
Bridge Router
- bridge router - simple bridge, network connected to eth1 is allowed to make outgoing connections but incoming connections are blocked
- my bridge - filtering bridge allowing card0 and card1 full access, but doing a bit of protection against inbound. Newer version of the complex ruleset above, with the source
Abnormal setups
- Passwordless VNC server - You can run a VNC server on port 5900, with no password, and it is only accessible by someone logged in as you. This is useful if you tunnel it through SSH (which this example also opens) - you've already logged in once
- Multi-subnet virtual host NAT - Each server has its own /24 which is actually empty, but which the server thinks contains all the other services it needs to contact. External connections retain their source, of course. This was created for a contest that requires you to eventually drop the firewall, but not the NAT
Use of the recent module
- port knocking - to connect to SSH, first connect to port 12345, then connect to ssh within 5 minutes (300 seconds) of your first connection
- multiport knocking - to connect to SSH, connect to port 10001,20002,30003,40004,50005 then connect to ssh
- CGI knocking - Instead of connecting to random ports, just visit a webpage. This ruleset could be protected with a password on the webserver for extra security. It could be combined with either of the previous two rulesets
- portscan blocking - gives an hour's block to any IP that tries to connect to an unused port 4 times (in this example, all ports are unused). The service on tcp port 12345 cannot be revealed by nmap unless you know the number beforehand (or are excessively patient)
- brute-force prevention - prevents more than two SSH connections per minute to slow down SSH scans. Can be used in combination with port knocking to prevent a DoS attack - just put the port knocking first.
- ident opening - Opens the ident port to any host you connect on port 25 (SMTP) or 6667 (IRC) so that ident checks succeed while not giving everyone access to the ident port. Closes the port after 60 seconds
- manual conntrack - If you are getting SYN flooded at 100-500Mbit, the linux state modules panics. This is an alternate state-tracking ruleset written using -m recent which doesn't crash the kernel. Of course, the normal state tracking is better and this code should only be used when actually under an attack
HowTo
Tutorials
- Iptables Tutorial by Oskar Andreasson (mirror) is a very nice starting place for iptables, but may be a bit long
- netfilter.org howtos - Some of the external links on that page are outdated, but overall it is a good collection of information
Diagrams
Rulesets
These rulesets are in iptables-save format. I have written some simple documentation of the iptables-save format. I use this format for several reasons: it ensures there are no other rules in iptables, it loads faster, it avoids the possibility of a race condition that most iptables scripts have (although the race window would be about 1ms for most rulesets).
There are several ways to use these rulesets.
- Use the scripts as an init script without any modifications
- Use mkscript to convert the iptables-save file into a shell script and add the script to your init scripts
- Save the ruleset as-is to /etc/iptables.conf and use this init script
- Add pre-up iptables-restore < /etc/iptables.conf to the internet-facing interface in /etc/network/interfaces (Debian-based Distributions only)
For the best security, a firewall should be applied before the internet-facing interface is brought up. If you have a dynamic IP and need to use it in your ruleset, consider loading a simple deny-all firewall (remember to allow DHCP) before bringing up the interface, then switching to the real firewall after the you get an IP.
Related scripts
- sysctl settings that may be useful if you are running a firewall.
References
- The iptables 1.3.4 manpage, which has a full syntax description and covers all the modules.
- Netfilter, the official iptables/netfilter website.
Forensics
- AccessData Corporation's Registry Quick Find Chart
- Computer Crime Research Center A non-profit organization which conducts extensive research on the problems of computer crime and cyber terrorism.
- DoD Cyber Crime Center http://www.dcfl.gov/dc3/home.htm
- Breakwater Security Associates - A leading provider of information protection and forensics solutions for business and government.
- The Forensic Science Service - Supplier of forensic science services to police forces, as well as being a source of training, consultancy and scientific support.
- US Secret Service - Forensic examiners in the Secret Service Forensic Services Division (FSD) provide analysis for questioned documents, fingerprints, false identification, credit cards, and other related forensic science areas.
- The Coroner's Toolkit http://www.porcupine.org/forensics/tct.html http://www.fish.com/tct
- Independent Validation & Verification of SMART for Linux by Thomas Rude, CISSP
An Independent Validation and Verification for the data forensic program SMART, developed by ASR Data Acquisition and Analysis, LLC. In this paper I verified the four critical functions all forensic examiners need; authentication, imaging, restoring, and wiping. (PDF format) - Next Generation Data Forensics & Linux by Thomas Rude, CISSP
I wrote this article so that folks new to Linux could get a clear grasp of what makes Linux so powerful and an excellent platform for performing Data Forensics work, whether it be the analysis of standalone personal computers or network investigations. It was originally published in the June 2002 edition of Under the Brim, the monthly Red Hat publication. It is part one of a two part series. (PDF format) - Building a Super Kernel for Data Forensics Updated January 2003 by Thomas Rude, CISSP
After receiving a number of e-mails and wanting to make updates I set out to revise my original paper. However, after a bit of work I opted for a clean start, a new write. So here it is, my new kernel paper. Please discard the old copy if you have it! This paper focuses on recompiling the Linux kernel for the benefit of data forensics. - Independent Validation & Verification of SMART for BeOS by Thomas Rude, CISSP
This paper is the result of an validation I performed on the SMART utility written by ASR Data & Acquisition, LLC. I tested four functions of the program; hashing, imaging, wiping, and restoring. View the results in this paper (PDF format). - Poor Man's Guide to Multi-Booting by Thomas Rude, CISSP
A KISSing (Keeping it simple stupid) approach on partitioning a hard disk so that numerous operating systems can be installed and booted. Take you from A to Z, including some key technical information. Read this to jump start your system! - Analysis of Microsoft's AutoComplete Function by Thomas Rude, CISSP
An in-depth analysis of how this function is used within Internet Explorer. I've also included a list of tools that can be used to monitor this activity. - And You Thought DELETE Meant DELETE! by Thomas Rude, CISSP
This is a very high level article aimed at the average computer user. When you delete a file, is it really deleted? Read this article to find out! - Evidence Seizure Methodology for Computer Forensics by Thomas Rude, CISSP
I started writing this paper as a guideline for evidence seizure - sort of a step-by-step approach. As I got more and more involved with this subject area, I became aware that there is no one methodology for seizing evidence. From that, this paper branched out into how to prepare your department for a forensics investigation, the importance of developing a methodology, as well as the steps to take when seizing evidence. - Examples of using DD within UNIX to Create Physical Backups by Thomas Rude, CISSP
In response to some questions I've received as well as listening to a few individuals at the Computer Crime Symposium, I decided to write a short paper on the UNIX DD command and how useful it is when creating a physical backup of evidence.
Hacking
- How "Crackers" Crack - Rory J. O'Connor, Mercury News Computing Editor
- Being A Hacker - on the meaning of being a hacker. - by Valerio "Elf Qrin" Capello (http://www.ElfQrin.com)
- Mentor's Last Words (the hackers manifesto)
- Trinity's SSHNUKE (On SecurityFocus) (Nmap's Author's Comments)
Incident Handling
Intrusion Detection
- Snort
- Snort.org
- SourceFire
- SiliconDefense
- VRT Rule update 2006-03-29
- PortScanAI Snort Preprocessor
- Portsentry/Logsentry
- Shadow
- Sguil The analyst console for NSM
Legal Issues
- American Bar Association - An article on ensuring the admissibility of electronic forensic evidence and enhancing its probative value at trial
- FSS - The FSS delivers support to diverse customers throughout the UK legal system such as coroners and the Criminal Cases Review Commission.
- When Data Spills, Who do You Notify? - Columnist Linda LeBlanc had her laptop stolen a few weeks ago, and she's still digging out from the mess. But the theft left her with some questions. Who should be notified? (Wi-Fi Planet)
Malicious Code
Network Monitoring
- ANL Web100 based Network Configuration Tester http://miranda.ctd.anl.gov:7123/ tests the reliablity and operational status of your network link.
- Gomez http://www.gomez.com/ Website performance monitoring, QA, and load testing services.
- Internet Detective http://detective.internet2.edu/ is a small Windows application that offers computer users easy access to the status and capabilities of their current network connection by providing information about advanced network capabilities, including connectivity to an Internet2 backbone network, an estimate of available bandwidth and multicast capabilities.
- JetMon http://jetmon.uoregon.edu/ is a client-server link monitoring tool for NOC operations, written in Java. The server pings a list of network devices, reporting the state to the clients.
- Lachesis ftp://ftp.intel.com/pub/papers/lachesis.ps a tool from Intel to monitor and report on response time and packet loss to "landmark" Internet sites. It is based on the publically available tool Imeter ftp://ftp.intel.com/pub/ietf/ippm/.
- LinkRank http://linkrank.cs.ucla.edu/ BGP dynamics visualization tool "LinkRank" also presented at Nanog 32 at Reston, VA (http://www.nanog.org/mtg-0410/lad.html).
- mrtg http://www.ee.ethz.ch/~oetiker/webtools/mrtg/mrtg.html Multi Router Traffic Grapher. Also available from OPENXTRA http://www.openxtra.com/.
- NetLogger tools to make it easy to instrument distributed applications and visualize the results. http://www-didc.lbl.gov/NetLogger/
- NetNow http://www.merit.edu/ipma/analysis/ a prototype tool providing realtime NAP & ISP backbone delay & packet loss performance statistics.
- netstat http://snowhite.cis.uoguelph.ca/course_info/27420/netstat.html
- NetStat Live http://www.analogx.com/contents/download/network/nsl.htm is a small, easy to use TCP/IP protocol monitor which can be used to see your exact throughput on both incoming and outgoing data.
- NetTest http://www-itg.lbl.gov/nettest/ Nettest is a secure, real-time network monitoring utility. The nettest framework is designed to incorporate existing and new network tests, and be run as a daemon or an interactive process. Requests for network tests are received via a SSL connection or the user interface and are authorized using an ACL list (in the future authorization using Akenti will also be supported).
- Network Diagnostic Tool (NDT) http://miranda.ctd.anl.gov:7123/ a web100 Java applet developed to test the reliablity and operational status of your desktop computer and network connection.
- ns http://www.isi.edu/nsnam/ns/index.html network simulator is a discrete event simulator targeted at networking research.
- NIST Net http://snad.ncsl.nist.gov/itg/nistnet/ allows a single Linux PC set up as a router to emulate a wide variety of network conditions.
- Ntop http://www.ntop.org/ntop.html is a Unix tool that shows the network usage, similar to the popular top Unix command.
- NOCOL http://ciac.llnl.gov/ciac/ToolsUnixNetMon.html#Nocol
- nslookup http://www.stopspam.org/usenet/mmf/man/nslookup.html
- OWAMP http://www.slac.stanford.edu/xorg/nmtf/e2epi.internet2.edu/owamp/ One Way Active Measurement Program from Internet 2. provides one way delay measurements.
- Qcheck http://www.qcheck.net/ checks network response time, throughput, and streaming performance, by means of thin agents installed on hosts that are to be checked.
- RANCID http://www.shrubbery.net/rancid/ monitors a router's (or device's) configuration, including software and hardware (cards, serial numbers, etc), using CVS. Rancid logs into each of the devices in a router table file, runs various commands, chomps the output, and emails any differences ( sample) from the previous collection to a mail list.
- RouteViews http://www.antc.uoregon.edu/route-views/ is a tool for Internet operators to obtain real-time information about the global routing system from the perspectives of several different backbones and locations around the Internet.
- Spong http://spong.monsters.org/spong/www-spong Son of Pong (spong) is a simple system monitoring package, that will monitor system attributes and network services on a variety of machines. It will gather status reports and contact staff if there are problems. It will also summarize the information and display it via a web interface
- Sting http://www.cs.washington.edu/homes/savage/sting/ end-to-end active monitoring tool that estimates one way loss through careful manipulation and observation of TCP behavior.
- TCPtune http://moat.nlanr.net/Software/TCPtune/ a TCP stack tuner for Windows
- Zabbix http://zabbix.sourceforge.net/ is software for application and network monitoring. Zabbix supports both polling and trapping techniques to collect data from monitored hosts. Flexible notification mechanism allows easy and quckly configure email notifications for pre-defined events.
FTP
- Autobuf http://dast.nlanr.net/Features/Autobuf_v1.0/ is an auto tuning-enabled FTP client and server. The client, a modification of the NcFTP Client, enables Auto Tuning to calculate optimal window sizes before files are transferred. The client is compatible with most other FTP servers. The server, a modification of the WuFtp FTP server, allows connecting clients to reset its buffer size dynamically by using a SITE option.
- bbcp http://www.slac.stanford.edu/~abh/bbcp/ a secure peer to peer file copy program supporting large windows and multiple streams. See also the presentation and the PDF paper.
- bbftp http://ccweb.in2p3.fr/bbftp/ is designed to quickly transfer files across a wide area network. The package comprises of a server and clients. It also provides compression and secures the transmission of the username and password by using the cryptolib of the OpenSSL project.
- Firehose http://heroinewarrior.com/firehose.php3 Firehose uses multiple interfaces to stripe a bulk data transfer (it's geared towards files, the home-grown protocol includes sending a filename and the client requires a file) over multiple network interfaces.
- GSIFTP http://www.globus.org/security/v1.1/ftp/install.html is an ftp client and server with built in kerberos and GSI (globus) security, and also allows you to set the TCP buffers on both the client and server.
- SafeTP http://www.cs.berkeley.edu/~smcpeak/SafeTP/ operates by installing a transparent proxy in the Windows networking stack which detects outgoing FTP connections from any Windows FTP client, and silently secures them using modern cryptographic techniques.
- NcFTP http://www.ncftp.com/ has a popular free FTP client that adds support for firewalls, intelligent ls caching, background and scheduled processing, and Microsoft Windows.
- RFT http://www-unix.mcs.anl.gov/~madduri/RFT.html Reliable File Transfer Service is a service that allows byte streams to be transferred in a reliable manner. Reliability, in this context, means that problems of less than a certain, user defined magnitude are dealt with automatically. i.e. problems like dropped connections, machine reboots, temporary network outages, etc are dealt with automatically (usually via retry) until they either resume or meet some "ultimate failure" condition
- WU-FTPD http://www.wuftpd.org/ is a popular FTP server from Washington University.
Mapping
- GeoPlot http://www.caida.org/tools/visualization/geoplot/ is a light-weight java applet which allows users to create a geographical image of a data set.
- Mapnet http://www.caida.org/Tools/Mapnet/Backbones/ from NLANR/CAIDA is a tool for visualizing the infrastructure of multiple backbone providers simultaneously (Mapnet), and for updating and correcting information that may be invalid or out of date (Mapnet Update)
- NetGeo http://www.caida.org/tools/utilities/netgeo/ is a database and collection of Perl scripts used to map IP addresses, domain names and AS numbers to geographical locations.
Monitoring Infrastructures
- Cheops http://www.marko.net/cheops/ is an Open Source Network User Interface designed to unify your network utilities.
- CycleTraders http://www.cycletraders.com/, is a cooperative network of users that gather critical information about the status of each other's website.
- Ganglia http://ganglia.sourceforge.net/ is a scalable distributed monitoring system for high-performance computing systems such as clusters and Grids.
- Mon http://www.kernel.org/software/mon/ is a general-purpose resource monitoring system, which can be used to monitor network service availability, server problems, environmental conditions such as the temperature in a room, or any number of things.
- Nagios http://www.nagios.org/ (used to be NetSaint) is an open source host, service and network monitoring program. It is designed to run under Linux, although it should work under most other *NIX variants. It can run either as a normal process or as a daemon, intermittently running checks on various services that you specify. The actual service checks are performed by external "plugins" which return service information to Nagios. Several CGI programs are included with Nagios in order to allow you to view the current service status, history, etc. via a web browser.
- NetMeter http://www.ccaba.upc.es/netmeter/ This application provides an integrated graphical interface for a set of tools that allows the measurement of QoS parameters over IPv4 and IPv6 networks. Network Performance Meter (netmeter) is an Tcl/Tk application which tries to solve these tasks in a flexible and modular way.
- Network Performance Advisor http://dast.nlanr.net/Projects/Advisor/ is a single application which integrates the measuring, analyzing, and displaying of network performance statistics.
- NIMI http://www.psc.edu/networking/nimi/welcome.html
- OSSMON http://www.crystalballinc.com/vlad/software/ossmon/ is a web-based monitoring package based on OSSWEB application framework. It supports SNMP monitoring as well as specific services like POP3, SMTP, Ping.
- PingER http://www-iepm.slac.stanford.edu/pinger/ End-to-end active measurement using ping to monitor end-to-end performance of Internet links.
- SCAMPI http://www.ist-scampi.org/ SCAMPI is a platform for passive monitoring. It can use several different hardware monitoring adapters (SCAMPI adapters developed in the project, DAG cards produced by Endace and regular NIC cards). It provides MAPI (Monitoring API) as a high-level abstraction of passive monitoring for easy creation of portable monitoring applications.
- Scriptroute http://www.cs.washington.edu/research/networking/scriptroute/ is a flexible network measurement and debugging system. Measurements are expressed as scripts that run as an ordinary user, and a priviledged daemon schedules and manages the packet exchange. The goal is to allow any user to connect to any server and execute any safe network measurement.
- Website Monitoring http://checkwebsite.org/ is a free website monitoring application released under the GPL that provides an uptime monitoring tool.
- Wombat http://wombot.net/ monitors the availability and operation of websites. When your website goes down or produces a defineable error, WOMbot will automatically notify you via SMS and Email.
Path Characterization
- ABwE http://moat.nlanr.net/PAM2003/PAM2003papers/3781.pdf Available Bandwidth Estimator.
- Bandwidth Estimation Tools http://www.icir.org/models/tools.html a compendium of tools maintained by Sally Floyd.
- Bing http://spengler.econ.duke.edu/~ferizs/bing.txt is a point-to-point bandwidth measurement tool (hence the 'b'), based on ping. You can download it from here
- Bprobe & cprobe http://cs-people.bu.edu/carter/tools/Tools.html provide measurement of bottleneck and congestion bandwidth using ping.
- Clink http://rocky.wellesley.edu/downey/clink/ is a tool for estimating Internet link characteristics.
- Nettimer http://mosquitonet.stanford.edu/~laik/projects/nettimer/ is a project to do end-to-end network performance measurement. It can listen passively to existing network traffic or actively probe the network
- Pathchar ftp://ftp.ee.lbl.gov/pathchar/ is a tool to infer the characteristics of Internet paths. There are some usage notes from CAIDA. There is also a SIGCOMM '99 paper on Using pathchar to estimate Inernet link characteristics by Allen Downey.
- PathChirp http://moat.nlanr.net/PAM2003/PAM2003papers/3824.pdf
- Pathload http://www.cc.gatech.edu/fac/Constantinos.Dovrolis/bw.html measures the available bandwidth of a link.
- Pathprobe http://www.psc.edu/~web100/pathprobe/ is a MIB tool that uses TCP and web100 to probe and characterize the path between two hosts. The goal of this tool is to run hop-by-hop tests to determine if the paths along the way are capable of supporting the desired end-to-end target bandwidth between the sender and receiver.
- Pathrate http://www.cc.gatech.edu/fac/Constantinos.Dovrolis/pathrate_tutorial.html measures end-to-end capacity
- Pchar http://www.employees.org/~bmah/Software/pchar/ an independent implementation of Van Jacobsens pathchar with more intelligible output. Available for FreeBSD, Solaris, Linux, IRIX
- Pipechar http://www.dsd.lbl.gov/OldProjects/NCS/generic/net-tools.html a tool for reporting dynamic network characteristics in particular the bottleneck bandwidth.
- STAB http://www.spin.rice.edu/Software/STAB/ short for spatio-temporal available bandwidth estimator, locate congested links on an end-to-end network path.
Ping
- fping http://rpmfind.net/linux/rpm2html/search.php?query=fping is similar to ping but is optimized to ping a large number of hosts in parallel. You may be able to download from here.
- Fpinger http://www.kilievich.com/ Visualizes your computer network as an animated screen that lets you perform administration functions, monitoring, pinging, scanning, exporting, looking for software and hardware over the network.
- FREEping http://www.tools4ever.com/products/free/freeping/ will ping all your 2003-XP-2000-NT servers (or any other IP address) in free-definable intervals. FREEping will send you a popup when one of the 2003-XP-2000-NT servers stops responding
- Just-ping http://just-ping.com/ pings from 8 locations worldwide to a host you select.
- MTR http://www.bitwizard.nl/mtr/ combines the functionality of the 'traceroute' and 'ping' programs in a single network diagnostic tool.
- pathping is built into Windows 2000, it pings all nodes along a route.
- Ping 'Classic' ftp://ftp.arl.mil/pub/ping.shar and the Nikhef Ping ftp://ftp.nikhef.nl/pub/network/ping.tar.Z variant and its man page.
- The SLAC/HEPNRC PingER suite of ping tools for monitoring response time, packet loss etc. are available via the PingER Tools from the ICFA-NTF WG on Monitoring page http://www.slac.stanford.edu/xorg/icfa/ntf/tool.html.
- Pingroute.pl http://www.slac.stanford.edu/comp/net/pingroute.readme is a simple Perl script to ping all nodes along a traceroute and provide min, max, avg response time, plus packet loss analysis for 100 and 1400 byte packets. The source is freely available for SunOS, Solaris, Linux, AIX and Digital OSF1.
- TCP based pings use TCP to figure out the Round Trip Time (RTT)
- Synack http://www-iepm.slac.stanford.edu/tools/synack/ measures the Round Trip Time to establish a TCP session using the SYN request and SYN/ACK response, allows specification of the TCP port.
- Tping http://www.eecs.umich.edu/~azeitoun/tools.html also also can ping more than one host at a time.
- Traceping http://slacvx.slac.stanford.edu:8097/www/traceping_description.html measures the packet loss to nodes along a route.
- TRIUMF's Visual Ping http://vancouver-webpages.com/net/about-visual-ping.html provides a Web page that the user can make ping transfer rate measurements between the Web server and the browser.
- hping2 http://www.kyuzz.org/antirez/hping2.html is a network tool able to send custom ICMP/UDP/TCP packets and to display target replies like ping do with ICMP replies.
- Zinger http://img.cmpnet.com/windows/fixes/zinger.zip a small Perl program that pings the closest router on network and reports any loss of connection. When it detects a problem, it does two things. First, it announces the problem over the PC speakers. Then, it writes the time and date to a log file. When the connection comes back up, the program writes another entry in the log and announces the happy event over the speakers again.
RRDtool
(Round Robin Database tool) is a system to store and display time-series data.
- Bronc http://bronc.blueaspen.com/ is a package of utilities that allow you to gather and visualize data in the form of graphs. It uses RRD and is similar in function to Cricket and MRTG, though it is claimed to be faster.
- Cricket http://cricket.sourceforge.net/ is a high performance, flexible system for monitoring trends in time-series data. The collector runs from cron every 5 minutes (by default), and stores data into a file-based database managed by the RRD Tool. Later, when you want to check on the data you have collected, you can use a web-based interface to view graphs of the data.
- Host Grapher II http://software.foxlink.org/hostgrapher2/ is a light program that uses RRD to draw graphics of Hosts for Network, Processes, CPU, Memory etc. Writing addicional plugins is quite simple. Works on all major UNIX platforms and on win32.
- NMIS http://www.sins.com.au/nmis/ Network Management Information System is an SNMP polling and statistics viewer front-end to Tobi Oetiker's RRDTool.
- Orca http://www.orcaware.com/orca/ is a tool useful for plotting arbitrary data from text files onto a directory on a Web server.
- remstats http://remstats.sourceforge.net/release/releasenotes.html Remstats is a system of programs to: gather data from servers and routers, store and maintain the data for long periods, produce graphs and web-pages tieing them together, and monitor the data for anomalous behavious and issue alerts. This software is a pretty good hack to wrap around rrdtool as collector and presenter, easy to set up with not to much prerequesits. It only needs a some perlmodules and perl. Its under GPL and is able to maintain and monitor big environments.
- SmokePing http://people.ee.ethz.ch/~oetiker/webtools/smokeping/ measures latency and packet loss in your network. Uses RRDtool to maintain a longterm datastore and to draw pretty graphs giving up to the minute information on the state of each network connection.
SNMP
- Analyse It http://mechsoft1.tripod.com/ is a shareware device poller that produces graphical performance reports for devices. You use it for trend analysis. The reports are in HTTP format for global organization view ability. Enables pro active network availability, performance, reliability and utilization reporting.
- CMU SNMP ftp://lancaster.andrew.cmu.edu/pub/snmp-dist/ or for a Perl5 extension module
- STC http://serprest.pt/cocoon/serprest/tool/stc.html is a free command line tool to get and compare, side by side, SNMP tables entries from different computers. The output is always in XML format which is by default associated with a XSL script. So it can be processed later or immediately viewed with a WEB browser.
- Tricklet man pages and code
- UCD SNMP public domain tools http://www.firstlinux.com/cgi-bin/package/content.cgi?ID=7013
Throughput Tools
- bulk http://www.terena.nl/conferences/tnc2005/programme/presentations/show.php?pres_id=95 is achievable performance measurement tool (iperf-like), which allows real-time monitoring of any socket options and their members, particularly TCP_INFO option, which provides useful clues for performance debugging. You can monitor rtt, cwnd, ssthresh, retransmits, etc. down to per sent segment, if you wish. The tool does not require root access or any kernel patch (even though it works with an accompanying AIMD patch for per-socket AIMD tuning). Download
- gen_send/gen_recv http://www.citi.umich.edu/projects/qbone/generator.html a simple UDP trafic generator.
- I2perf http://www.internet2.edu/~shalunov/i2perf
- IPerf http://dast.nlanr.net/Projects/Iperf/ is a tool for measuring maximum TCP and UDP bandwidth, reminiscent of tools such as ttcp. It has been written to overcome the shortcomings of those aging tools.
- The MGEN toolset http://manimac.itd.nrl.navy.mil/MGEN/ provides programs for sourcing/sinking real-time multicast/unicast UDP/IP traffic flows.
- netperf http://onet1.external.hp.com/netperf/NetperfPage.html maintained by HP, is a general measure of performance of a network. Provides a measure of latency between request and response of generic transactions across a TCP/IP network.
- RUDE http://www.atm.tut.fi/rude/ stands for Real-time UDP Data Emitter and CRUDE for Collector for RUDE. RUDE is a small and flexible program that generates traffic to the network, which can be received and logged on the other side of the network with the CRUDE.
- Tcpspray http://www.mnis.fr/home/linux/appli/communication/tcpspray.html sends data to either the discard or echo TCP service on the specified host and prints the average throughput.
- thrulay http://www.internet2.edu/~shalunov/thrulay/ measures achievable UDP and TCP single stream throughputs (currently only supports Linix) also provides RTT estimates.
- TReno http://www.psc.edu/~mathis/ippm/ a tool to function as a basis for a formal bulk transfer metric for the Internet.
- ttcp ftp://ftp.arl.mil/pub/ttcp/
- UDPmon http://www.hep.man.ac.uk/~rich/net/tools/net_test_programs_v2-5.pdf This is a set of tools using UDP and TCP to give estimates of the request-response latency and bandwidth found in the route between the two end nodes.
Traceroute
- Gtrace http://www.caida.org/tools/visualization/gtrace/ is a traceroute visualization tool that uses a combination of methods to either determine or guess at the physical location of a node in the traceroute path. It is flexible enough to support addition of new databases, heuristics to map IP addresses to physical location and maps.
- mturoute http://www.elifulkerson.com/projects/mturoute.php is a small Windows tool to determine the path MTU between you and a specified host. In traceroute mode it will additionally show you the mtu at every hop between you and the specified host.
- NeoTrace http://www.neotrace.com/ provides graphical traceroute information.
- pathping a Windows NT utility to do a traceroute and then measure to each node along the route.
- Prtraceroute ftp://ftp.ripe.net/pride/tools/README is a version of traceroute, from the RIPE Internet Routing Registry toolset, that presents routing policy information together with the real time packet trace obtained from traceroute. It adds AS information to the normal traceroute output, making use of Routing Registry (RR) database information.
- TCPtraceroute http://michael.toren.net/code/tcptraceroute/ uses TCP to a port at the end node to do a traceroute.
- The tracepath for Linux is like traceroute but does not need superuser and has no fancy options. It does discover the PMTU along the route.
- Traceroute-nanog http://packages.debian.org/unstable/net/traceroute-nanog.html has additional features like AS lookup, TOS support, microsecond timestamps, path MTU discovery, parallel probing and others.
- VisualRoute http://www.visualroute.com/ a GUI based traceroute for Windows.
Network Tools
- DShield.org Distributed Intrusion Detection System DShield provides a platform for users of firewalls to share intrusion information. DShield is a free and open service.
- Net