People don't owe you non-aggression if they covet what you have. Only Government instituted by the Human Community can provide you protection from aggression. Only the Community Governance can support common values against the intrusion of internal greed or outside force.
Government instituted by Community can also use the Common Resources of the Community to provide Guaranteed food, shelter, medical care, and skill training[education] in order for the individual to have the freedom to refuse any job they do not wish to do.
That is what Life, Liberty and the pursuit of happiness is. It is not about absolute rules. It is about choice. I choose Freedom from Desperation for all citizens. Only Freedom from desperation for life essentials can lead to true Liberty for all.