Every Sunday when I was a kid in the tiny New York town of Hillsdale, my parents would drive five miles down a dirt road to the local grocery store to pick up the New York Times. My parents were transplants from the greater metropolitan area of New York City; I imagine that great hunk of newsprint helped them stay connected to the life they had—albeit willingly—left behind.
My mother immersed herself in the notoriously challenging crossword puzzle. My father delved into the sports pages to follow his beloved Yankees and into the financial pages to follow his beloved stock portfolio.
I went for the Book Review.
The New York Times Book Review was to me, and indeed to much of the literary establishment of the 1970s, the first and last word on books. I devoured the reviews that praised or damned, that elevated a writer to the national limelight or smashed all hope. And of course I dreamed of the day that one of my books would appear on its pages.
Forty-odd years later, I have resigned myself to the fact that no book of mine is ever going to be reviewed by the Times.
Goodbye to the gatekeepers
The dark underbelly of this system of appraisal was that only a tiny number of authors would ever see their work reviewed in the likes of the New York Times, the L.A. Times, or the New Yorker. Everyone else was, as we used to say, S.O.L.
These days—thanks to CreateSpace, Kindle Direct Publishing, Smashwords, and half a dozen other book publishing platforms—anybody can now publish a book. And they do.
Amazon, that 10,000-pound gorilla everyone loves to hate, has become the New York Times Book Review of our day. Writers, not to mention purveyors of garden gnomes and potpurri, feel only as good as their latest Amazon reviews. These reviews are fundamentally different from reviews by literary critics. Readers, not critics, are dispensing judgment. One can argue that readers’ opinions count more. However, it has always been possible for a work of art to be a critical success and a popular failure, and vice-versa. This raises the age-old question for artists: would you rather be critically acclaimed or sell a million books? The correct answer is both.
The changing calculus of book reviews and ratings has led to its own challenges. Sellers of books have figured out how to game the review system—something that was nearly impossible in the days of literary institutions and gatekeepers, and something that puts readers and buyers in a bind. How can we take a chance on a product we’re not familiar with if we think its reviews are fake?
My reviews got a failing grade
When I discovered a couple of websites, Fakespot and ReviewMeta, that purport to analyze and grade Amazon reviews, I couldn’t resist running my two novels through them. Here are the results.
The explanations for the review ratings were often somewhat less than transparent. Here’s what Fakespot said about the reviews for What Remains Unsaid, with my comments in red:
- Our engine has analyzed and discovered that 26.3% of the reviews are reliable. (Based on…?)
- Interesting tidbit: the most used word by reviewers is book. (Well, yes, it is a book.)
- How are reviewers describing this item? unsaid. (Huh?)
- Our engine detects that in general the reviewers have a suspiciously positive sentiment. (I’d argue that 19 reviews is not a high enough sample size to assign any meaning to either a positive or negative trend.)
- Our engine has profiled the reviewer patterns and has determined that there is high deception involved. (What does “high deception” mean, exactly? I hope it’s not anything akin to “high crimes and misdemeanors.”)
The ReviewMeta explanation is more in-depth. See for yourself why What Remains Unsaid received its failing grade. You can also dive deep into statistics to see how they come up with their ratings.
Three tips for indie authors
So what can you do to avoid your reviews being downgraded? Here’s what I gleaned from running my reviews through the two fake review detectors.
Spread out your review requests. Some of the downgrading happened because too high a percentage of the reviews came on the same day. I can see why that would raise red flags. But the reality of independent publishing is that you have to take advantage of the flurry of activity that accompanies the launch of your book. And Amazon’s sales algorithms work in a way that encourages lots of sales on the first day or two of publication, so you rise through the rankings.
Be wary of sending free review copies to Amazon reviewers. Of course for traditional book reviewers, there’s nothing unusual about receiving a free copy of the book from a publishing company. But free product in return for reviews is verboten on most product review sites. And on Amazon, readers who don’t purchase a copy are not VERIFIED PURCHASERS, which discounts their input. Better to direct those people to post a review on Goodreads.
Don’t take fake detection too seriously. Maybe I’m saying that only because my reviews fared so poorly. Yes, I’m all for sussing out fake reviews. They have become a big problem, not only on Amazon but on other sites such as Yelp. But it seems to me that an algorithm is not always great at distinguishing between a legitimate author with a small number of legitimate reviews by fans and someone who is gaming the system. And yet I have little choice but to play along.
Write a fantastic book about something you are passionate about, pay attention to the details of producing it, and don’t worry too much about reviews.
The algorithms are coming
And you thought automation was endangering only factory jobs and maybe eventually service jobs. It’s coming after the arts, too. Algorithms will write the books, as in a recent experiment described in Wired. We already have news-writing bots. Can review-writing bots be far behind?
Fight back while you can. If you’re a human, leave a review of What Remains Unsaid or Dance of Souls. Just don’t submit yours on the same day as everyone else. And don’t make them it too positive. And don’t give five stars to too many other products.
My algorithm thanks your algorithm.
- The Book Stop on fake reviews
- The New York Times talks about reviews for hire
- Forbes on Amazon’s fake review problem
- David Gaughran talks about another problem: fake books
This is really interesting. I definitely worry about reviews of my books and getting enough to merit Amazon’s internal promo of the book. NetGalley really helps but it’s expensive.
I know–as if we indie authors don’t have enough to worry about!
Go Audrey! Out thinking the algorithm. It could be a new career. Reminds me of the political parties these days, shutting out new voices because they don’t have fundraising chops. Thanks. This is pretty interesting.
Could turn into an infinite regression, though–watching the watchers watching the watchers…
LikeLiked by 1 person
I’d be happy just to get some reviews, although I know that if I ever get a decent number I will have to start worrying about things like this. It’s good of you to go to the trouble of checking it out and posting about your experience.
I went through it more as an intellectual exercise. I try hard not to let these things bother me–though I might be more upset if I had bad reviews with a good reliability score than the other way around!
Wow! This is really scary. I published an e-book and it is for sale on Amazon. I am sensitive. I will not read those other sites now that I have read your post. We can only do our best in life and it is a shame that there are these other sites that look to bring us down.
Susie sent me! Maybe you can check out my blog if you need any blogging tips. I write about how bloggers can be more successful. I also have blog parties like Susie.
Yes–it’s good not to take these kinds of sites/services too much to heart, although it is scary to realize that OTHER people may be relying on them. I will check out your blog!
LikeLiked by 1 person
Thanks for your reply. I will look forward to your visit to my blog. Make yourself at home when you get here :-).
As a reader, I don’t put much weight into the Amazon reviews (where shipping delays count towards the rating as well haha).
Yes, people like to downgrade products for all sorts of reasons far outside the control of the product’s creator! With books, I am always wary when readers pan books that are in a genre they say they don’t normally read or that they don’t like!
LikeLiked by 1 person
yes, good point!
I tested my two published novels with the first link you provided. I got an A for my first book and an F for my second. The only real difference is that on the second one, I had a publisher who released ARCS for early reviews, unlike the first book’s publisher. So I’m guessing the ‘verified purchase’ issue is the only thing going into their algorithm. Maybe I’ll have to test it out with some bigwig bestsellers and see what score they get. 😁
I thought about putting some big names to the test! I’d be interested to see what pops up.
And I’m relieved to know I’m not the only indie author with a bad GPA 🙂 (Although I never would let my kids get away with the excuse that “everybody else is getting bad grades…”)
Haha, but it works here well!
Thanks for putting yourself out there for the rest of us authors, Audrey!
Happy to be a science experiment for the cause.
I don’t have the mental energy to worry about reviews of my books. I am too busy teaching, coaching, and writing more myself, including my two blogs, Transition Times and Writing Life. Sure, I’d like to be reviewed by the NYT. But I’m not losing sleep over it. I have to trust that my work will find its readers through other channels. It’s a noisy, crowded world out there, but by narrowing down the audience you’re appealing to, I think you will hit your ball home.
Yep. That’s the only way to approach it, because the other way lies insanity.