• Data Collection and Storage: We collected job advert data from multiple sources, including job boards, CV libraries, government websites, and job agencies. The data was securely stored on AWS S3, ensuring easy access and retrieval by the client.
• Flexibility in Data Format: We offered complete autonomy to the client for publishing the aggregated data in the desired format. This included the flexibility to adjust the JSON format during the live stage to align with client preferences.
• Geographic Disaggregation: Besides local authority level data, we accommodated the client’s preferences for publishing disaggregated data at other geographic levels such as Travel to Work Areas and Local Enterprise Partnerships, allowing for deeper insights into regional job trends.
• Additional Aggregate Breakdowns: We were open to the client publishing other aggregate breakdowns of the data on their website, provided there was no exposure or disclosure of specific companies. This could include breakdowns by Standard Industry Classification (SIC), Standard Occupation Classification (SOC), skills, and company type.

Compliance with Web Scraping Policy: We ensured compliance with the client’s Web Scraping Policy, minimizing the burden on website owners and respecting the Robots Exclusion Protocol. Anonymization, IP rotation, and adherence to legal requirements were integral parts of our data collection process.