The preterite is used for a completed event in the past. A birth is seen as a single completed event, so the preterite is the normal tense here.
This is much more natural here than the present tense nace, which would mean is born / is being born in a different context.
Because with ayer, standard Spanish normally uses the preterite, not the present perfect.
In Spain Spanish, a useful contrast is:
So ayer strongly points to nació, not ha nacido.
You can absolutely say Nació ayer if the context already makes it clear who you mean. Spanish often drops the subject when it is understood.
So both are possible:
But saying just Bebé nació ayer without la would not sound natural in normal Spanish.
Yes. Spanish word order is more flexible than English.
These are all possible:
The version you have, La bebé nació ayer, is a very natural, neutral order.