The Prime Minister has defended his flagship policy in a speech to social entrepreneurs in
Mr Cameron rejected criticism that the concept was "too vague" and a "cover for cuts", insisting it was central to the "social recovery" the country needed.
He said: "This is my absolute passion.
"I think it's a different way of governing, a different way of going about trying to change our country for the better, and it's going to get every bit of my passion and attention over the five years of this Government."
Mr Cameron described the Government's deficit-reduction programme as only his "duty".
He went on: "What is my mission, what is it I am really passionate about? "It is actually social recovery as well as economic recovery, and I think we need social recovery because as I've said lots of times in the past, there are too many parts of our society that are broken.
"Whether it's broken families or whether it's some communities breaking down or whether it's the level of crime, the level of gang membership, whether it's problems of people stuck on welfare unable to work, whether it's the sense that some of our public services don't work for us, we do need a social recovery to mend the broken society and to me that is what the Big Society is all about."
He said people needed to "take more responsibility" and "act more responsibly".
The Government's response to any problem was only ever "half the answer", he said.
The Government will bolster the scheme with a series of new initiatives, including a £100m transition fund to help charities and social enterprises bid for new government contracts to provide services.
Read Mark Kleinman's blog on the Big Society Bank
A Big Society bank will provide working capital for successful applicants and issue ISAs and pensions. It will be funded by £400m from dormant bank accounts and £200m from high street banks.
David Cameron also took on Labour critics who claim the initiative is a figleaf for spending cuts.
He has attacked "years and years of big government" taking away "more and more things that people should and could be doing for themselves."
The Prime Minister said: "Our society is broken and we need to fix it - and the Big Society will help us do that.
"I think our broken society all comes back to one word - responsibility. Too many people have stopped taking responsibility for their lives and the people around them."
The move comes amid growing criticism of David Cameron's Big Society plans.
Former Conservative Cabinet minister David Mellor called the initiative a "lead balloon".
The Archbishop of York, Dr John Sentamu, said investment in public services was needed if the Big Society was to flourish.