Just as Simon Cowell knows his music, and Bake Off judge Paul Hollywood knows his cakes, so award-winning gardening legend Jim Buttress knows his onions.

And his melons, aubergines, carrots, radish and runner beans.

The plain-speaking horticulturalist, former Royal gardener and current RHS Britain in Bloom judge is now also judge in BBC2’s new six-part series The Big Allotment Challenge, and he pulls no punches judging harvests produced by contestants on their made-for-TV allotments Filmed in a Victorian walled garden on the Mapledurham Estate in Oxfordshire, nine pairs of keen gardeners have spent months planning, planting and nurturing. Given their own greenhouses, they were handed particular vegetables, fruit and flowers to grow, as well as facing a number of additional weekly challenges including flower arranging and chutney-making, judged by floral arrangement expert Jonathan Moseley and preserves specialist Thane Price.

The series, presented by Fern Britton, was filmed last year from early spring until late summer, when Jim then judged the produce, from blemish-free radishes to perfect sweet peas. So how harsh was he with this judging?

“I was once nicknamed Judge Dread but you don’t have to be hard, as long as you’re fair and consistent in what you do,” he insists. “You don’t have to hurt people but you can tell them, ‘This ain’t good enough’. Just be fair, be honest and give people advice as to why they didn’t win or they could have done better.”

Much of the advice he gives in this series is about the weather-related problems faced by competitors, because last spring was particularly cold.

“Last year, March and April were awful. Light levels were appalling, we had a lot of cold weather and many people were ‘caught cold’. Stuff was put out which wasn’t hardy enough. The one thing you’ll never beat is nature. Then Mr Pest and Mr Disease comes along. It happens to everybody. They had to find a way around that.

“The most difficult thing is the timing. People who grow stuff in the garden generally don’t have a deadline. Each week we set them a task, whether vegetables or flowers, and if they didn’t have them ready then they didn’t have an exhibit. Luckily they’d grown twice as much as they needed to guarantee they had something.”

The subsequent hot weather in summer helped the growth catch up, but then it required constant watering and some produce needed slowing down.

The second strand of the competition, which is growing flowers, also put up its own problems, Jim says.

“Thrift was a menace last year with gladioli. They get the mottling vein. When the judge is looking at the exhibit, whatever it is, it’s the overall impression that matters.

The Big Allotment Challenge starts on BBC2 on Tuesday at 8pm.