It is narrated with true chains of narrators in Qurbul-Asnaad...
And it does not beseem the believers that they should go forth all together; why should not then a company from every party from among them go forth that they may apply themselves to obtain understanding in religion, and that they may warn their people when they come back to them that they may be cautious? (Sura Tawbah 9:122) The Imam said that this command has made it a must for you to approach and to inquire from us. But it has not compelled us to give you a reply.
The narrator says that he submitted that: You have been appointed so that we may ask you. Then I understood that when the position will be known to us we will ask him whatever we like. Hearing this, the Imam said: You have been ordered to ask us but we are not bound to reply or not to reply.
Saffar has in Basairud Darajat, dealt with this subject, through thirty reliable sources quoted Zurarah and Allamah Hilli has in Kashaful Haqq narrated after going through twelve Tafsirs quoted from the commentary of Muhammad bin Moosa Shirazi who is a Ahle Sunnat scholar, the words of Ibne Abbas that the Ahle Dhikr are Muhammad, Ali, Fatima, Hasan and Husain (a.s.) only.
They are Ahle Dhikr (People of remembrance), Ahle Ilm (People of knowledge), Ahle Aql (People of intellect) and only they are Ahlul Bayt (a.s.) and the mines of divine message and angels visit them. By Allah, He has given the name ‘Momin’ (believer) to the Muslims due to the dignity of Amirul Momineen (a.s.).