After you get Windows 95 installed your going to want to get it updated somewhat.

I used a CD I got from on-disk for $4 and it saved a lot of update headache.
You can find it here: http://on-disk.com/product_info.php/products_id/33

Here is the blurb from their site:

If you have a new windows 95 install this CD is a must have!

It contains several programs to bring the older Windows 95 computer up
to speed.

Contents:
Internet Explorer 5.5 SP2 (The latest version of Internet Explorer for
Win95) - This is the full version with Outlook Express, 128 bit
encryption, and Java.

DirectX 8.0a - If you use Windows 95, this is the latest version of
DirectX you can install; it supports the majority of games that run
effectively on Windows 95.

Windows media player 7.1 - Microsoft has 6.4 for download but the only
reason 7.1 didn't run on Win95 was because microsoft coded it to
refuse to install on 95 when they stopped supporting it. Well, someone
figured out that if you use the 7.0 installer to install 7.1 you can
run Media Player 7.1 on Windows 95!

Windows 95 Y2K Update - Updates Windows 95 to make it Y2K compliant.

Windows 95 OEM SR2 Update (for Multifunction CardBus Cards Resolve
several Plug and Play issues with PC Cards).
This download contains the Windows 95 OEM SR2 Update for Proper Plug
and Play Operation with Multifunction CardBus Cards. The update fixes
several problems users may experience when using multifunction PC
Cards. Please note that this patch does not resolve issues associated
with any other versions of Windows 95 other than the OEM SR2 version.
If you are not sure which version of Windows 95 you have, you can find
out simply by checking your System Properties. To do this, right-click
My Computer and select Properties. An OEM SR2 system will show a
designator, such as "4.00.9500 B," as the version. The number may vary
slightly, but the letter designator will be a B for the OSR2 version.
Version designators without a B, such as those that include an "A" or
show nothing after the number, cannot utilize this patch.

Note: IBM ThinkPad models 770, 770E, 560X, 380XD, 385XD, and 600
incorrectly had the "TP-DOCK1" BIOS signature when they were initially
released. Owners of these machines should update to the current BIOS
from IBM before installing the PC Card update.

OpenOffice.org 1.0.3.1 (Legacy Build for Win 95) - known and the
"better than" alternative to Microsoft Office. It includes the key
desktop applications, such as a word processor, spreadsheet,
presentation manager, and drawing program, with a user interface and
feature set similar to other office suites. Sophisticated and
flexible, it also works transparently with a variety of file formats,
including those of Microsoft Office.

Trillian 0.74 - All in one Instant Messenger. Chat with all your
friends on mIRC, AIM, ICQ, MSN, and Yahoo Messenger.

ExtractNow - A "Zip" compression extractor allowing you to extract
more than one archived file at a time, with one click of a button.
Makes extracting files quicker and easier. ExtractNow supports ZIP,
RAR, ACE, IMG, IMA, IMZ, ISO, & BIN, archives.