You've nothing to worry about.
As Peter notes, you do have the option of pressing EV mode immediately after you press the start button, which as we move towards summer should at least get out of the driveway and moving a bit even after an overnight stop.
If you do this during the day, say within an hour of previously using the car, you may find it stays on for a lot longer - potentially up to a mile or so.
If you don't press it, the engine will come on largely to help heat the car and so on (thus disabling EV as an option for a while). The duration of this will decrease in the summer (and you'll notice consumption going up) because the car does not need as long to heat up (ahem, that's not exactly the technical reason but it's more or less what's going on!)
There is an argument that it is unwise to use the EV button; the vehicle does automatically apply EV when it is most appropriate to do so, so by forcing it you may in fact cost battery life later when you would really be better having it. That said, I must say I generally press it immediately on start-up!
Hope that makes some sense.