Black people
By that time, the majority of black people in the United States were native-born, so the use of the term "African" became problematic. Though initially a source of pride, many blacks feared that the use of African as an identity would be a hindrance to their fight for full citizenship in the US. They also felt that it would give ammunition to those who were advocating repatriating black people back to Africa. In 1835, black leaders called upon Black Americans to remove the title of "African" from their institutions and replace it with "Negro" or "Colored American". A few institutions chose to keep their historic names, such as the African Methodist Episcopal Church. African Americans popularly used the terms "Negro" or "colored" for themselves until the late 1960s.

Q: What group decided to keep the "African" in their name?
the African Methodist Episcopal Church