You'll need some VBA code to do this. In the Subform's BeforeInsert
event you could put code like
Private Sub Form_BeforeInsert(Cancel as Integer)
If DCount("*", "[tblChild]", "[LinkField] = " & [LinkField]) > 10 Then
MsgBox "Only ten records are allowed"
Cancel = True
End If
End Sub