Do you feel guilty about wanting what you want? Do you feel that you’re asking for too much?
If you don’t want to manifest your desire for the reasons you deem noble yet you are unhappy and would only be happy living your desire, remove the guilt and only accept what you truly desire.
If you love it, it’s worth having in your life. No matter what you manifest, someone will (or, might) always criticize you so you might as well manifest your true heart’s desires. When you know that, guilt simply no longer has a place in your world.