[ad_1]
We aim to make relevant measurements in a transparent and objective manner to help buyers identify the right proxy for their business.
Our first benchmark will cover residential proxies for businesses with technical teams that have significant (at least thousands of pages) crawling needs from domains deploying anti-scraping measures.
How do we ensure objectivity?
To ensure that we do not favor any solution: Each participant will
- provide the same participation fee
- provide free access to their solution during the assessment.
We will support the objectivity of our work with transparency. It is hard to be biased when all inputs are transparent.
How do we ensure transparency?
We will share detailed, URL level results of each participant with all participants.
What will be benchmarked?
Residential proxy services for technical business teams. Web crawling APIs will not be part of the benchmark.
How will we perform the benchmark?
Our benchmark aims to closely match the preferences of our target users. They want a flexible, cost-effective solution. Therefore, we will measure these metrics
Effectiveness
It will be measured by success rate of responses on our target URL set. Target URL set will include a total of 1,000 URLs with 100 URLs from each domain:
- E-commerce: AliExpress, Amazon, Craigslist, Homedepot, Walmart
- Travel: Booking
- Social: Facebook, Instagram
- HR: Indeed
Speed
Average response time and distribution of response times will be measured.
Scalability
The same metrics will be tested with a fixed number of simultaneous connections.
Cost
Public cost data published by the vendors will be used to calculate the cost of our benchmark. Vendor’s cost model will also be shared.
Customer service
Reviews on B2B review platforms will be analyzed to assess customer satisfaction.
How will the results be published?
They will be published on AIMultiple.com and will feature graphs that users can manipulate to find the right vendor for their business. Top 3 vendors in each of the above categories will be presented.
Why should you join?
Marketing & sales
To have a document that benchmarks your solution in the market. If the benchmark supports your marketing messages, you can back up marketing claims with 3rd party data gathered via an objective and transparent process.
Product
To understand your product’s strengths and weaknesses in a data-driven manner.
Why should you not join?
To get leads. AIMultiple is either the global leader or one of the leaders in digital audience in the domains where it runs benchmarks. However AIMultiple benchmarks are technical documents and are not geared towards a large audience.
How much does it cost?
A few thousand euros. The exact number depends on the number of participants as we will be splitting the cost of running and publishing the benchmark among all participants equally.
Please note that we are in the design phase of the benchmark and changes will be made as we get end user feedback and finalize our benchmark.
Source link