Login

Register

Please enter you password

Password:

Repeat Password:

Java Website Crawler Tutorials

Whether you are looking to obtain data from a website, track changes on the internet, or use a website API, website crawlers are a great way to get the data you need. While they have many components, crawlers fundamentally use a simple process: download the raw data, process and extract it, and, if desired, store the data in a file or database. There are many ways to do this, and many languages you can build your spider or crawler in.

Java is an object-oriented programming language, that can both run as a scripting language and as compiled code. This makes it quite flexible and desired for many people in a wide variety of circumstances, including website crawler development.

This is a tutorial made by Program Creek on how to make a prototype web crawler using Java. This guide covers setting up the MySQL database, creating the database and the table, and provides sample code for building a simple web crawler.

This is a tutorial posted by Kim Mason on creating a parallelized web crawler using Java that only fetches urls once without duplicate downloading. This tutorial starts from an original script and modifies it to implement parallelization.

This is a tutorial made by Anurag Jain on how to create a web crawler and how to efficiently store data using Java. This includes explanation for setting up the database, creating a front-end page interface for usability, describes the functionality performed, and explains the database system in relation to the final crawler.

Parallax Web Design

Parallax website design moves one part of your website at a different speed than the rest of your page. This often creates a 3D-like effect, adding depth and interest to your webpage design. The resources, including themes, tutorials, and examples, are designed to help you build a website with parallax scrolling.

How to build an infinite scrolling website with card design using Masonry, AJAX, JavaScript, PHP, and MySQL.

Website Crawlers

Looking to download a lot of data? Need to find the exact information in a gigantic internet haystack that you are looking for? These resources are designed to help you build spiders, crawlers, and other tools to obtain data from the internet.

Website Theme Resources

Website themes are an easy to create a great website quickly. They provide a beginning point for you to build your websites, giving you layout, code, and functionality to work with. These resources are made to help you find the right theme to help you start building your website.