Yes. If two people send messages to each other using "inconsistent" email addresses, there won't be a match.
For example, if you send a SecretAdmirer message to someone while using the email address "person@email.com" for yourself, and they respond by sending a SecretAdmirer message to you while using the email address "person123@email.com" for you-- our database won't recognize a match, even if both of those are real email addresses.
That's why you should send your SecretAdmirer messages using the email address for yourself that your admirer would most likely use to send to you. Also, if you receive a SecretAdmirer message at one address, be sure to use that same address to send your SecretAdmirer message(s) in response.