By thoroughly training our models on all the ways certain words or phrases are used, we improve our ability to catch policy-violating content and reduce the chance of inadvertently blocking legitimate reviews from going live. Our human operators regularly run quality tests and complete additional training to remove bias from the machine learning models. But if we teach our machine learning models that it’s only used in hate speech, we might erroneously remove reviews that promote a gay business owner or an LGBTQ+ safe space. For example, sometimes the word “gay” is used as a derogatory term, and that’s not something we tolerate in Google reviews. Training a machine on the difference between acceptable and policy-violating content is a delicate balance. The place itself: Has there been uncharacteristic activity - such as an abundance of reviews over a short period of time? Has it recently gotten attention in the news or on social media that would motivate people to leave fraudulent reviews?.The account that left the review: Does the Google account have any history of suspicious behavior?.

The content of the review: Does it contain offensive or off-topic content?.

Our machines look at reviews from multiple angles, such as: These patterns often immediately help our machines determine if the content is legitimate, and the vast majority of fake and fraudulent content is removed before anyone actually sees it. Machines are our first line of defense because they’re good at identifying patterns.

They have different strengths so we continue to invest tremendously in both. Given the volume of reviews we regularly receive, we’ve found that we need both the nuanced understanding that humans offer and the scale that machines provide to help us moderate contributed content. You can think of our moderation system as a security guard that stops unauthorized people from getting into a building - but instead, our team is stopping bad content from being posted on Google. Moderating reviews with the help of machine learningĪs soon as someone posts a review, we send it to our moderation system to make sure the review doesn’t violate any of our policies.

See my google reviews