Building self-worth is something that happens in childhood, and relies on people and events outside of you, whereas building self-esteem is a culmination of all the years of self-worth, and is something that relies on how you feel about yourself. 
Then ego comes in and tries to spoil the road to high self-esteem, but there are ways to build and nurture all three so that you can tackle life a lot easier when the challenges present themselves.