Reply to Thread
Page 1 of 2 1 2 LastLast
Results 1 to 10 of 12

Thread: Better Testing - reward players for helping

  1. #1
    Erudite Pioneer
    Join Date
    Feb 2012
    Location
    England
    Posts
    77
    World
    Newfoundland

    Better Testing - reward players for helping

    watching daily chat, especially around releases it is clear how many people get frustrated that 5 minutes into an event or new functionality we see things not working and a emergency fix is scheduled, servers go down, game time lost etc. We all now how it goes.
    It's clear that insufficient testing occurs, and given BB's relative size it's not surprising as it's tough to test every possible combination.

    One real problem for me is when new stuff comes out I don't want to go to the test server and spend hours buying generals with the very generous amount of gems etc., then doing the skills to get the generals ready and then play some adventures. We just want to get on and play.

    So why not harness the power of the community, there's a lot of loyalty amongst the players, I for one have played for many years so we clearly love the game.

    I'd like to suggest that BB think about the following:
    Testing - When logging onto test they have two choices
    1. BB Setup - as is, use island provided by BB for testing purposes
    2. Clone your island but also have sufficient gems/resources to play around and test out all the new cool stuff, but not as many as option 1.

    Secondly, the more you play the greater the rewards, so if we choose option 2 from above then 50% of the XP earned from combat is transferred back to our main island.
    If you choose option 1 then a gem reward proportionate to the time played, and actually played not time browser is open.

    Let's take the recent Observatory fiasco. It's been out for ages, still doesn't work, despite at least one attempt to fix it. Why is it still like this? Because when it was first released into test no one did the skills on the generals that caused the endless loop, no one sent those generals to adventures. Why? because we're not testers, we're not incentivised to test properly.

    I go onto test, take a quick look at new features, buy the buildings etc. check placements, space etc. Minimal amount of time possible before going back to what I love - playing my settlers!

    Clearly you'd need to think how to balance the XP reward with the huge resources available otherwise we'd be doing endless Mountain Clan or similar and then that wouldn't be balanced, then again you'd not be getting the resources back to your main island either.

    I don't think the above is a perfect solution, but I think it's a lot better than what we have now

  2. #2
    Enlightened Sage
    Join Date
    Feb 2012
    Location
    Finland
    Posts
    894
    World
    Newfoundland
    The issue is that for example both the Christmas tree and Observatory issues were clearly reported already during test phase, weeks before hitting the live servers. The same applies to many other issues. The reward system would not help anything if the issues are not even being looked at even with the current system. It's even possible that reward system would just cause more harm as people would go after rewards and begin to report everything, even old issues and create so much "noise" that the relevant issues to the latest changes would be lost.

  3. #3
    Glorious Graduate
    Join Date
    Jan 2018
    Location
    Scotland
    Posts
    125
    World
    Newfoundland
    I was told by a member of support that test and live are two totally separate systems and that even if it works on test it might not work live..
    ( words altered from original twitter answer as not allowed to pass on messages from any BB staff )

  4. #4
    Erudite Pioneer
    Join Date
    Feb 2012
    Location
    England
    Posts
    77
    World
    Newfoundland
    thats even worse then Mannerheim than I'd realised - so just poor quality control and a lack of respect for the customer/players

  5. #5
    Community Manager
    Forum Explorer BB_Torkav's Avatar
    Join Date
    Jan 2019
    Posts
    316
    World
    Newfoundland
    I'd just like to point out that the Christmas Tree has been much improved with the [Change Log] 19/03/19 and the Observatory is almost fully functional now (only the Quartermaster Generals need a fix).

  6. #6
    Town Councillor
    Join Date
    Aug 2014
    Posts
    618
    World
    Sandycove
    Quote Originally Posted by BB_Torkav View Post
    I'd just like to point out that the Christmas Tree has been much improved with the [Change Log] 19/03/19 and the Observatory is almost fully functional now (only the Quartermaster Generals need a fix).
    Sorry, but "almost fully functional" in this case is almost as good as completely broken cause if my troops get stuck in QM landing loop what good is it that my other generals arrived earlier?

  7. #7
    Jolly Advisor Kriegor's Avatar
    Join Date
    Jan 2015
    Posts
    195
    World
    Newfoundland
    Quote Originally Posted by Mannerheim View Post
    The issue is that for example both the Christmas tree and Observatory issues were clearly reported already during test phase, weeks before hitting the live servers.
    And the issue is easy to recreate. So testing was never needed from us, it was childsplay to recreate.

    And still it got released.

  8. #8
    Guide of the Month Ruler of the Land Nogbad's Avatar
    Join Date
    Dec 2011
    Location
    Darkest Dorset
    Posts
    1,660
    World
    Newfoundland
    Afraid we used to get rewards for testing in the past, but it didn't make any difference to the bugs going live, and at the time BB seemed more bothered about "stress testing", ie: performance hits as number of players increased rather than what the new content did to the game.
    Then during 1 particular "reign", bug reports went unanswered and then batch moved to the "No Bug" section at the end of that test phase completely unaddressed and horrible things went live at an alarming rate. Really undermined the whole point of TSOTesting, it just became a playground for those who couldn't/wouldn't buy gems in the real game, even worse just playing on Test left stuff in cache which then interfered with the smooth running on the live servers, I ended up playing it in a sandbox until giving it up as a bad job.
    We love our new CM.

    Newfoundland: 20th November 2011 to 25th November 2014. RIP
    It was good while it lasted.

  9. #9
    Erudite Pioneer
    Join Date
    Feb 2012
    Location
    England
    Posts
    77
    World
    Newfoundland
    Appreciate that Torkav, and I do admit it's a huge improvement. Thats what I love about you guys, we can talk to you and you do take on board the comments.

  10. #10
    Dedicated Scribe sparkz's Avatar
    Join Date
    Nov 2011
    Location
    Poland / Finland
    Posts
    489
    World
    Newfoundland
    Quote Originally Posted by Torquemarda View Post
    It's clear that insufficient testing occurs, and given BB's relative size it's not surprising as it's tough to test every possible combination.
    If a software company employs competent people, those people should be aware of testing methodologies and should not resort to testing every possible combination.

    From the technical perspective vast majority of this games functionality is not even complex, meaning that poor testing can only be explained by deliberate negligence, not insufficient resources.

    So why not harness the power of the community
    Because its irrational to expect someone whos unpaid, has no prior experience and is not bound by anything like a contract obligation to do it PROPERLY.

    __
    Another thing is what people probably dont know and in the era of all those early access versions of the game might very well not expect it : its not customers obligation to assure the product is of proper quality, that obligation lies on the company that is trying to deliver it and expects to make money out of it.

    Any decent company only includes some customers in the testing when the product is done, working properly and they are going to verify if it matches customers expectation (and possibly do some last minute changes in that regard), in the big software world involving customers in primary testing is a notion as ridiculous as involving real drivers in car crash tests.

Reply to Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Ubisoft uses cookies to ensure that you get the best experience on our websites. By continuing to use this site you agree to accept these cookies. More info on our privacy.