Web Fetching

httptype is a Perl program that returns the http host software of a website. It reads the http_proxy and no_proxy environment variables to determine whether to use a proxy or not. httptype homepage

Advertisements:

getstockquote is an embeddable Perl script that fetches stock or mutual fund data from a variety of sources. It uses command line arguments for grabbing data and so can be used in different ways without altering the script itself. It's...

Retrieve articles from one newsgroup to which no reply has yet been posted. Articles are all printed to the standard output. Progress messages are printed to the standard error handle. Scripts From The Software Path Perl Scripts From The Software...

This is a simple Perl script that takes a list of books and looks to see if they are considered published on fatbrain. It requires the LWP module. EarthLinkT« - Page Not Found Anytime, anywhere, EarthLink connects people to the power and...

Displays eClickz.com PPC listings on your site based off of randomly selected keywords that you choose. This could be used as an alternative to Google's Adsense, as it has a similar format and you earn a portion of the revenue earned from each...

WebThief is an extremely easy to use script intended for grabbing files and pages from World Wide Web via HTTP protocol. The WebThief works with httpget.lib library, which supplyed with this package. To receive data from the web, you shold specify...

WebFetch is a set of Perl5 modules that provide a framework for retrieving information from local files and/or the web for display on the web or export to other sites. Its use is oriented around periodically automatically updated information on a...

This Hot Links SQL add-on fetches urls from Google, DMOZ, & Yahoo based on keywords entered. Also spiders any url entered and fetches the outgoing urls. Great way to add bulk to your Hot Links SQL directory. CGI Scripts PHP Scripts Web Hosting...

The Random Quote Viewer works with our own Quote Cache (http://quotes.prolix.nu)and its archive of hundreds of literary quotes. It fetches an XML document containing a random quote, changes it to HTML and writes it to your site. The quote can be...

Mangle your favorite Web pages with this travesty algorithm. Once users enter the URL of an HTML page in the text box and press Mangle, after some processing, it will display the requested Web page appended by your customized header. It requires...

Browse the Internet absolutely anonymous and secure with FreeSurfer - a powerful shield against data spies and tracking of your Internet activity. FreeSurfer hides your identity from others and allows you to take back your privacy while surfing...

SomeNEWS allows you to check for articles on the net, filter it, take off the HTML, etc. It can be used to make Web portal, or have article locally on you PC, etc. SourceForge.net: SomeNEWS Get SomeNEWS at SourceForge.net. Fast, secure and free...

Sitescooper automatically retrieves the stories from several news websites, trims off extraneous HTML, and converts them into formats you can read on your Palm computing device for later reading on-the-move. It maintains a cache, and will avoid...

SiteShadow pulls information from other web sites, and places it within your own content as if it were your own. Put a favourite web site on your own web site, changing graphics, header, footer, or names. Or pull content from a free web host and...

This is an advertising display script for use with RevenuePilot.com's affiliate program. Revenue Pilot offers 60% revenue sharing, which is on the higher end of the spectrum. This is a great alternative to Google's Adsense. Very easy to set up and...

This is a simple script that uses the XML feed from ROLSearch.com's affiliate program to display Adsense styled ads on your page. Very easy to set up and implement. No SSI required, only one line of javascript. CGI Scripts PHP Scripts Web Hosting...

These Perl/Tk headline grabbers allow you to get and display the current headlines from a number of Linux-related resource sites including freshmeat.net, slashdot.org, linuxdev.net, and icewalkers.com. NetPedia.net...

News Clipper is an application which allows you to integrate information from around the internet into your own personal web page - in your own personal style. It accomplishes this by snipping content from pages that you define and shipping them...

Moresuitable allows you to intergrate targeted news content with complete control over news positioning, color, and font. More than 300 news categories available from Moreover. Moresuitable News Feeds Scripts Fully customizable script which embeds...

This free perl script will fetch the headlines from MaximumEdge.com and display them with links to their articles on your website. You can choose which categories to display including business, entertainment, health, international, sports, tech,...

Master Snooper is an easy to install, easy to maintain CGI program written with Perl 5 to let you see the real code behind web pages. Have you typed in one URL and ended up somewhere else? Use Master Snooper to see the HTML source code they used...

This is just a simple script that grabs products from Amazon.com and neatly displays them on your site with your affiliate code embedded. The products are randomly displayed based on a list of key terms that you supply. This is a great way to...

This script allows you to fetch a specified Web page using HTTP, FTP and GOPHER, and parses it for links counting them as it goes. With multiple sites it will calculate the average links per webpage. The script requires the Win32::Internet module....

This script fetches the backend file from The Linux Review server every 60 minutes (default) and saves it locally. On request, the local file is read and healines printed in a formatted manner. The script is useful for including headlines in html...

Add news headlines to your webpage by using javascript or a perl cgi script. Headline databases are available for free and can be used by webmasters and developers in their projects. HeadlineNewsfeeds.com Add a news section to your website at no...

This utility queries Wunderground.com's snow depth listing and parses it to derive whatever state and cities you want to see the snow depth for. SYNTAX: perl getsnow.pl [] ... (multi-word names in quotes) IE: perl getsnow Hampton Sheffield...

FirstProductions Dining Guide, a CGI script written in the Perl language, can give your web site a comprehensive worldwide dining guide, including restaurant information, reviews, and direct links to even more reviews. Now includes support for...

The Finance-QuoteHist bundle is several modules designed to fetch historical stock quotes from the web. Modules include: Top level aggregator that will select a default lineup of site instances from which to retrieve quotes, The real workhorse of...

HAMweather is a free weather software package that can be used to add custom weather capabilities to your web site. These added weather forecasting abilities will provide the user interactivity you need to keep your web visitors coming back....

Dtheatre News Grabber is a CGI/Perl script that allows you to fetch the newest Digital Theater news headlines. It comes with a few customizable features. It requires IO::Socket and IO::Handle modules. Movie Trailers and Movie News - dTheatre.com...