If you build about two more of ANYTHING, you're gonna go negative in crops and you'll cease growing food.. and then you're pretty much fucked.

So... get your crops built up a little bit.

You're gonna have to upgrade your main building, and build a barracks before you can start building dudes. And army dudes take a few resources too. Not to mention each will take up a few crops, further reducing your crop production.

I'm seriously thinking crops should be an every other improvement type of thing. At least in the beginning, before you can start farming the other poor folk.