That’s a good point, however if it was the case mine should be showing 5/5 as the only reviews that I had which docked me were a good 6-9 months ago now (one customer had a part that was really messed up. So I fixed it for him but it took an extra day, so he docked me two stars on speed… I even fixed the model for free for him and he still docked me!)
Similiar issue here mine shows 4.98 after 120orders and they have all been 5 stars except 2 4stars when I first started
It could just be the calculation and the way it’s displayed.
5 is a whole number but it’s seems that the rating is shown to 3 decimal places (dp) and rounded up or down dependent upon which side of .5 (halfway point) you are. greater than 5 round up, less than 5 round down
my rating is shown as 4.82 (2dp) and 4.818 (3dp)
Upon the hubs listing page it’s shows the rating as 4.9 (based upon 20 votes) appears upon tool tip when mouse pointer hovered over number.
It’s plausible, but how do you explain the difference on my hub if 4.95 and 4.88? I don’t see how either of those round to one another…
So why then if my rating is 5.00 average rating in my hub that this shows me at 4.5? Doesn’t add up.
could be due to the amount the data is based upon
I have a bad metric not yet displayed upon the dashboard, which I have completed 33 orders, but number shown in the hubs listing in brackets only shows 20 (based upon 20 votes). Some customers haven’t left a review or feed back upon my prints even though the experience and service they received was good.
Showing stats should always taken with a pinch of salt and I’m sure it’s work in progress so as time goes by the shown figures will make more sense
I’m not sure I understand your point on this one either. Are you suggesting that having less reviews by default lowers your average review score?
sort of depends what 3D Hubs means by votes. I don’t work for 3D Hubs so not able to say what these figures mean or how they are worked out. but in my areas listing
I have 20 in brackets (based upon 20 votes) but also a London based hub which has 434 (based upon 434 votes) but both hubs have the same rating 4.9 stars The only difference is the distance. There is a closer 5 star hub with the same number (20) in brackets and they have able to produce more consistent print and service as shown in their reviews.
Update
There is also a hub with 58 in brackets that has a 4.9 star rating. Which make me think that votes are orders. As I spoken to the hub owner and he has had many orders
Hi Parker,
You are right, there is an error on our side. We are in the middle of switching to a new service and there is some data discrepancy. We will fix it as soon as possible.
Don’t worry your ranking is not affected by this.
Adam, 3D Hubs
Thanks for confirming this Adam! I think we were all just worried there was something else going on. Knowing it is just an error I’m sure will bring relief to many! Thanks for letting us know.
The brackets are the number of actual reviews that hub has received. It’s not necessarily the number of orders, in most cases I find no matter how great a service is some customers just don’t take the time to write a review. That being said my hat goes off to anyone who has had a review for every customer they have had! I want to know what they’re doing that I’m not to get all those reviews Hope this clears things up for you
Appreciate the update.
Hi all,
Just got my Marvin test print reviewed. Got 5 stars. But, the graph showing my average hub rating versus everyone else’s average rating shows up as 4.39%. So, yeah, how do you get a 5 Star rating, but an average of 4.39% from 1 review? Math was not my strongest subject, but that doesn’t seem to add up.
I wonder if these numbers work through up to hub recommendation on the order page?
When I make a dummy order, I see a list of hubs, where hubs who are closer to my place, have a higher rating, lower lead time and within the country, are lower in the recommended list than other hubs?!? Why?
Because we look at number of other metrics as well. For example accept rate or retention.
Adam, 3D Hubs
Well, then this is an insight that is completely missing.
So how does it actually work?
Retention: customers returning to your hub
What if I have customers not returning:
- Because they are simply not interested in more 3D-prints at all?
- Because they need a total different process like FDM and rarely use SLA?
Does this affect my rating?
Accept rate: Orders accepted
- What if the customer does not respond to your requests and archives an order?
- What if they placed the same order at 5 hubs simultaneously and asked to archive the order from 4 of 5 hubs?
- What if they see a certain price, still place an order, then decide they don’t want to pay it?
Does this affect my rating?
There are so many factors that influence above two metrics and do not say _anything_ about the quality and work of the hub that it seems unfair if they affect your rating.
I honestly do not see why some nearby hubs with good ratings, reviews, response time and pictures are rated lower than one 400km away somewhere in another country. Or hubs with only 3 reviews which are almost in the top of the list(So I guess they have 5 star metrics on everything).
Being recommended is about the most important rating for a hub… But there is no way for us to understand how and why.
Referring to your point about customers placing mass numbers of orders: I actually created a thread about this a long time ago when I started seeing it more. No resolution was ever given. I said that I felt customers need to be more informed about how to properly manage the system and to place orders.
Can’t agree more. Same goes for active orders being archived by 3DHubs or the customer: you don’t receive any notification at all and there is never an explanation why it was archived. Customers are asked why they want to cancel an order, but we don’t get to see it.
It’s annoying to see a drop in customers without knowing or understanding why. Is the market quiet? Have a bad rating? Something else?
I hope these comments don’t affect my rating
Retention will be in the insights shortly, we are working on that this week.
I already answered this before but we made sure that a couple of customers that won’t come back will not influence your ranking. We only look at people with statistically low or high retention.
Declining orders affects your ranking, as it does for everyone else. It may seem a bit unfair at certain cases and we are working on making the system better, but everyone gets a bad order from time to time.
Hubs with few ratings may rank higher as we want to give them a chance to get their first orders. This is still hard for them as they are competing with Hubs that have potentially hundreds of reviews. In this case being in the first place doesn’t necessarily mean you get the order.
The Hub ranking may seem as a simple problem, but trust me it is very hard to get it right for thousands of Hubs. For example reviews are not the best indicator as they are public and people give more positive reviews to avoid potential conflict. There is a caveat like this for almost every metric.
We will continue to improve the insights in a way that they will give you an overview of all the metrics we use.
I hope I answered at least some of your question.
Adam, 3D Hubs
This is a good point. I will put this on our todo list.
Adam, 3D Hubs
@adamhayek which part lol, hopefully not that his comments would affect the hub rankings
Haha The part that we should inform you about the reason why we canceled or archived the order.
I was just looking at this. My average rating on my dashboard is 5/5 yet the graph says it’s 4.74 sooo yeah… I say there’s something wrong here.