Speaking at the World Economic Forum in Davos, Oliver said Canada had taken aggressive stimulative measures in past years that had led to big deficits, but added that the goal was always to bring the budget back into balance.

"We are going to be in balance this fiscal year," Oliver said, referring to the upcoming 2015/16 budget that is due to be released in April.

(Reporting by Noah Barkin)