Skills

Languages

Job State

I need to crawl the following web page.
[url removed, login to view]
The user should select the product type
the user will select vehicle type
The program will go to year and select the first year available(2019)
then select the first make for the corresponding year (Audi)
then select the first

I want a program in Python.
It can moniter several web pages in real time and fetch the title or content if they meet the keyword(s) given. And it need to notify me via email in real time.
Besides, I can adjust target URL and keywords by myself later.
Note: My target web pages are in Chinese language.

Seeking a full stack web developer, to create a mobile friendly website with API capability to crawl other websites for prices.
For example please see [url removed, login to view] . You will note this site is a comparison site which displays live prices from other sites and compares alternative options from the users search details.
The end goal is

Hi, we ...rel seo pages and because of these we have lost almost 70% of the organic traffic in last 1 month. We wanted to take these URL Parameters off from google where google should crawl all pages again in same way as before a month ago and give them same ranking. If you think you can do that, please tell us in details so we can go further. thanks

...servers, currently i am using nginx server and apache server, on centos 7.4. One website is using nginx, another three websites using same apache server settings. So right now this apache server is rejecting all access to google to crawl inside the website. Not sure if the apache blocking any ips or from google bots especially, none of my sites is being

I want an application for webcrawling that I can run on my own. The UI doesnt have to be flashy. Just a simple UI that takes half a dozen inputs. The application will crawl a specific website (provided in UI). Get data from the website and store on local database. run web queries based on the database and keywords (provided in UI). Download few pdfs

We are looking for someone who has knowledge with scrappy ...knowledge with scrappy crawlers and python. The job will be to:
A. create a spider that can crawl an ecommerce site and collect the following:
1. Image URL
2. Product Name
3. Product Description
4. SKU
5 . Size
6. Price
B. Export the following information to a CSV file.

I already have a working Scrapy code (attached) to crawl a site, but when I follow a link to load more articles, articles are not loaded. May be javascript is enabled on the website. You just need to add few lines of code so that more articles will be loaded on javascript enabled button links. Please take a look at the attached code and let me know

...Googlebot couldn't crawl your URL because your server either requires authentication to access the page, or it is blocking Googlebot from accessing your site.
My google robot txt is using allow all, so it shouldn't be an issue, my main website is able to index, just my two new websites is not able to ( one of the new websites is few months old,

Hi Nasrin,
I will hire you for 6 days for $50.00.
Your job will be to advertise our Bar Crawl and Clothing Line posts.
Our goal is to generate Sales!
I will release $25 dollars tonight and the other $25 dollars on March 18th.
Thank you

We are looking for a developer/agency, who can crawl/scrape sites using a headless browser to crawl sites using javascript to load.
We are not looking for development of software, but simple a company who can deliver the data from the particular site as fast as possible.
If you have the capabilities, then write us and we will provide you with

[EXPERIENCED FREELANCERS ONLY]
We are looking to make a list of list all the startups and their contact information in the Netherlands, Belgium and Luxembourg.
For this purpose, we created the attached Excel files for you to fill.
For the Netherlands, please mine this list of 2199 companies: [url removed, login to view]

Essentially this project is for a Python script that prompts the user for a future date range such as DD-MM-YYYY_DD-MM_YYYY then crawl and /scrape 8 calendar like sites that are very similar (nearly identical).
We hired a coder to revise the old script as per the documentation and new output template. It is about 55-70% complete. The budget to finish

This project is for Python crawler and scraper that will request a date input and crawl and /scrape 8 sites that are very similar (nearly identical). The script was nearly completed by a coder buy they were unable to finish 1-2 of the sites due to lack of available time. Outcomes: - It will display if it was successful or not for each site and output

This project is for Python crawler and scraper that will request a date input and crawl and /scrape 8 sites that are very similar (nearly identical). The script was nearly completed by a coder buy they were unable to finish 1-2 of the sites due to lack of available time.
Outcomes: - It will display if it was successful or not for each site and