Find Jobs
Hire Freelancers

PHP / cURL Programming Guru needed for Data Scraping Project New or Update Old

$15-25 USD / hour

Cerrado
Publicado hace más de 5 años

$15-25 USD / hour

PHP / cURL Programmer needed for Data Scraping Project Update Several years ago, I hired someone from here to develop a data scraper for me. The scraper worked perfect for what we needed, then we got our IP blocked by the site we were scraping. The original writer was able to incorporate proxy IPs for the requests and it worked again. Then everything sat for a few years. So, we have all the original code sitting on the original site, and it doesn’t work today. Could be that the server was updated to higher level PHP (my guess is it was written in 5.x?), could be the db. is corrupted. I really don’t know. I have been tasked to get this back up and running. Ultimately, I need a data scraper that will pull multiple levels of information from [login to view URL] The result page will look like [login to view URL] We will need most of the variable information on this page. Additionally, On the bottom of the page is a link with personnel that needs to be followed. Following this link may produce multiple names and position information. In the case of the above it produces [login to view URL] which has only a single name. But in other examples it could potentially produce something like [login to view URL] Where it shows multiple names and positions with the company. The scraper will need to capture all this information and associate it with the appropriate license number. This data source changes daily (as new people get a license, as licenses expire, or become suspended because they did something wrong, or have a law suit brought against them). The most important will be the new additions to the db (which will be easy to find by just increasing the license number up one until you find the next license). These need to be found daily or every other day. But every record will need to be updated verified and updated once a week. We will need a way of pulling any recorded to which there was a change in the last week, even if it was as simple as correcting the spelling of a name. Maybe a field for last changed. SOOOO… I ether need someone to work with what we have OR create something new. With either option, you will need to create or provide complete documentation in such a manner that if you disappeared, the next developer could easily see what you did, why you did it, and how to correct it should we have problems in the future. This is the first of 10 sites that will need to be scrapped. It would be great if we could use the same engine on each one with minor location tweaks. If this goes well, we would ideally like to work with the same person ongoing for years to come.
ID del proyecto: 17899877

Información sobre el proyecto

21 propuestas
Proyecto remoto
Activo hace 5 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos

Sobre este cliente

Bandera de UNITED STATES
Corona, United States
5,0
1
Forma de pago verificada
Miembro desde oct 17, 2007

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.