If Amazon moved into consumer banking, they would likely be the low cost alternative to consumer banks, given the company's track record of lowering costs for consumers.

"The disruption is a big threat for the industry," said Gerard du Toit, a partner at Bain & Co., adding that banks are deciding whether to participate in Amazon's potential disruption or compete with it.