If you have already applied for the Social Security number before you try to open a bank account, you should take a copy of the receipt notice with you. The receipt notice can serve as additional documentation that can help establish your identity. As soon as you receive your SSN, you should inform your bank.