Why more Wall Street firms are growing worried