Build 2 further web scraping tools for existing MySQL database - repost

Stagecoach Software Pty Ltd requires two automated ruby web scraping tools to populate an already existing MySQL database. This is an extension of the recently completed project No. 4975478 which has already developed two scraping tools. A third and fourth tool are now required. The third scraping tool needs to run on an automated schedule every day. It is required to scrape a single large web site listing thousands of unique products and then populate the MySQL database with details of the products and prices sought. The details to be scraped appear in a mostly consistent format on the site. On the first scrape the tool must obtain details for all products listed whilst subsequent scrapes are required to track new products listed or changes of price to existing products. The freelancer must populate the DB with the scraper as part of the project. It is essential that the new tool does not duplicate data already being obtained from the existing scraping tools. The fourth tool is required to automatically download and scrape on a weekly basis a different website that lists the realized prices for a significant proportion of the products being captured by the first and third tools. The fourth tool must populate an existing table in the MySQL database with these products and price results. Again, duplication of data already obtained must be avoided. The MySQL database already combines data from the first two tools to calculate the difference between realized prices and initial listed prices. The freelancer must ensure that the database continues to calculate these differences using the freshly scraped data obtained with tools 3 and 4. The DB is hosted on a cloud platform. The freelancer must ensure that the first and second tools continue to operate with the existing db while the third and fourth tools are being developed and tested. The new scraper tools must be able to be easily activated from the host site and full written operating instructions must be provided. Full details of the site to be scraped and the required DB columns will be supplied to the successful bidder. This project is to be followed with the creation of a RoR website that will present graphs showing aggregate and individual data obtained from the database and allow user searches. Preference will be given to freelancers interested in and qualified to carry on into this third stage.