Humans vs GPT-3 competition launched by VWO

Share Article

GPT-3 generated headlines, product descriptions, and call to action will be tested against human-generated versions on live traffic on websites via A/B testing.

We think of this competition as the Turing test of the web as the data from an A/B test is the most objective assessment of competency, says Paras Chopra, Founder & Chairman, VWO.

GPT-3 is an AI made available by OpenAI’s newly launched API that specializes in natural language generation. VWO, the market-leading A/B testing tool, has incorporated that technology to make it easy for anyone to come up with AI-generated ideas for their website. To discover the efficacy of the AI recommendations, VWO has launched a competition in which participating websites will A/B test their existing, human-generated copy on the website against AI-generated one.

The entries for the competition are open now and the competition will begin on August 4, 2020. Visit the competition page to participate.

The rules for the Humans v/s AI competition are simple:

  • Copywriters from the participating website will get on a call with VWO team where they will pick one of the five AI-generated recommendations
  • They will specify their website’s goal (signups, purchases, clicks and so on)
  • Using VWO of their existing A/B testing software, they will split their website traffic 50-50 into two versions (AI generated and existing, human-generated)

The competition is expected to run for 6 weeks during which performance data is collected from websites. Winners from the competition will be declared as soon as there are results from five different websites.

Commenting on the competition, Paras Chopra, founder & chairman of VWO, said, “We think of this competition as the Turing test of the web as the data from an A/B test is the most objective assessment of competency. Even though I’m rooting for humans, nobody really knows how good AI systems have become, and hence results from the competition will be quite revealing.”

For press inquiries, send an email to media@vwo.com.

About VWO: VWO is the market-leading A/B testing and experimentation platform that growth marketing and product teams use for optimizing their business metrics. With clients in over 90 countries, it’s the experimentation platform of choice of thousands of brands across a diverse set of industries that includes online retail, software, travel, and media. Know more about VWO at vwo.com.

Share article on social media or email:

View article via:

Pdf Print

Contact Author

Mani Makkar
Wingify Software Pvt. Ltd.
+91 9899561406
Email >
Visit website