Researcher
£35,000 - £40,000
Hybrid
London
Leading media business intelligence organisation seeks talented researcher to join their team. The primary purpose of this role is to lead the research and buildout of a comprehensive database for digital infrastructure, using publicly available information, and validating this wherever possible. Responsibilities:
• Serve as an expert to retrieve and organise data from the web focused initially on digital infrastructure.
• Extract data publicly available on websites or through documents available for download.
• Contacting the major companies/owners and researching site information and validating web-researched data.
• Analyse our client's own library of /digital infrastructure and feed-in relevant data where appropriate.
• Liaise with the editorial team on upcoming relevant content.
• Utilize web scraping applications to automate data extraction.
• Monitor changes in website structures or data formats to keep information updated.
• Manually retrieve data from public websites where web scraping tools cannot be used.
• Create data extraction and data monitoring processes.
• Validate extracted data to ensure it is relevant, complete, and free of errors.
• Oversee and maintain the infrastructure supporting web scraping processes, which includes system performance monitoring, data backups, and troubleshooting any emerging issues.
• Continually optimise data extraction processes to improve their speed, efficiency, and reliability while minimising the impact on the target websites.
Profile of Experience:
• Experience in market research, ideally with a focus on digital infrastructure
• Familiarity with off-the-shelf web scraping tools and skilled using various APIs
• Capable of working independently and collaborating effectively across teams ensuring timely and successful projects completion
• Strong communication and collaboration skills
• Receptive to sharing, receiving, and implementing feedback
• Fast learner, detail and results oriented. Organisational and communication (verbal and written) skills in English
• General knowledge of digital infrastructure
• Proficiency in web scraping tools and Excel