van means of here.
So:
This is a very common Afrikaans structure:
English often has two options:
Afrikaans usually uses the van structure more naturally in cases like this.
Yes. That is also grammatical.
Afrikaans often allows a time expression to come first for emphasis. When that happens, the verb still stays in second position:
Both are correct. The second version gives a bit more emphasis to yesterday.
It is grammatical, but in everyday speech many speakers would more naturally say:
Die baba is gister gebore.
That means The baby was born yesterday.
Your original sentence is more literal:
Die geboorte van die baba was gister.
= The birth of the baby was yesterday.
So the given sentence is fine, but it sounds a little more formal or noun-based than the more everyday verb-based version.
Because Afrikaans nouns usually do not change form in the way nouns do in some other languages.
In this sentence:
Afrikaans does not have a case system like German, and nouns generally do not change depending on their role in the sentence. That makes structures like this simpler for English speakers.