Promises and Pitfalls of Black-Box Concept Learning Models