Web Scraping with Python, Ruby & import. io

Learn exactly how to scrape web data from many popular websites even if you have very little experience as a programmer!

3.8
(40 ratings)

Instead of using a simple lifetime average, Udemy calculates a
course's star rating by considering a number of different factors
such as the number of ratings, the age of ratings, and the
likelihood of fraudulent ratings.

How taking a course works

Discover

Learn

Take your courses with you and learn anywhere, anytime.

Master

Learn and practice real-world skills and achieve your goals.

About This Course

Published 8/2015
English

Course Description

Latest Update:May 8, 2016 - Import io had a major update going from software to browser based web scraper. I have added new lessons to show you how to use the new Import io. I have left the lectures up for the software as well.. since that can still be used and is a more powerful tool (so far). Enjoy!

Also, see the end of this for all the updates that have been made the course over the last six months.

_____________________________________________________________

You'll be web scraping in less than an hour!!

This course teaches you three ways to scrape websites:

Import. io is a software that you download and is a really quick way to start web scraping quickly. It is not without its limitations but depending on what you need or plan to do it could do everything you need. No programming experience necessary!

If you prefer to learn a little programming along the way, and aren't afraid to invest a little time, you can learn how to do web scraping with Ruby and/or Python. Both have their pluses and minuses but both can do just about anything you could imagine.

Even if you have never used Python or Ruby you can learn how to still use these programs as a web scraper. But if you are willing to learn you can scrape just about any website there is online!

Want to do some web scraping of super popular websites? That's how you will learn!

This course comes complete with code for every lecture for Ruby and Python!

You will learn to web scrape popular websites like:

Zillow

Craigslist

Yelp

IMDB

Wikipedia

Google

Macys

YouTube

NFL

Nordstrom

Wal-Mart

Twitter

You will learn to install Python and Ruby. You'll learn how to download what you web scrape into CSV files and with Python you will learn how to put your data into a database.

Other lessons include how to get around obstacles such as websites with ajax that load content dynamically. You'll also learn how to crawl multiple pages of websites and get all the data you need!

With Import. io you will learn how to download a website that has over 40,000 products on it. Yes, 40,000 products and you will learn how to scrape all of those products.

Stop imagining you can grab data off websites and use them for your next web project, you an do it now.

Please note: Software installation can be done for both Mac OSX and Windows. I use a Mac so it is more focused on OSX however instructions are available for Windows.

Update: January 17, 2016 - Added three Scrapy videos. How to setup scrapy and scraping CraigslistUpdate: October 17, 2015 - Added Bonus lesson on extracting zip codes from YelpUpdate: September 15, 2015 - Added How to find JSON and scrape it on WalmartUpdated: September 1, 2015 - Three new Twitter API scraper videos. How to scrape user tweets, users searching for keywords and how to follow those users through Ruby/Twitter APIUpdate: August 28, 2015 - Added Wikipedia scraper and map

Enroll now!

What are the requirements?

How to install software on their computer

Be able to understand a reasonable level of programming -- much of it will be explained

Follow step-by-step instructions

What am I going to get from this course?

Scrape a variety of websites

Scrape websites with Ruby

Scrape websites with Python

Scrape websites with Import. io

What is the target audience?

Anyone who has an interest or idea where they want to utilized data from other websites

Students Who Viewed This Course Also Viewed

SHARE

Instructor Biography

Over 17 years of digital media experience. Currently, CTO executive for B2B publishing company with eight magazine websites as well as lead at its Interactive Agency working with Fortune 500 companies.

Previous experience includes Digital General Manager over cool magazines such as Guitar World and Revolver Magazine. And General Manager running digital for the daily newspaper in Salt Lake City with over 30 million page views per month.