Cannot Retrieve all Indexes on HighQ

Hello Team,

 

We are experiencing an issue retrieving all document indexes from HighQ via API. The objective is to retrieve all active HighQ site names along with their respective file‑level details (metadata only). An earlier implementation successfully retrieved the full dataset; however, since around July 2025, the same approach no longer returns complete results. Running the existing solution without modification retrieves only ~3,000 documents, while the business confirms there are approximately 30,000 documents stored in HighQ. After refactoring the implementation to use async functions, the number of retrieved indexes increased to 8,000+, but the results remain incomplete.

 

The integration currently relies on the following HighQ API endpoints:

 

 

 

 

Key observations from testing:

  • Not retrieving the actual count of site details on HighQ
  • Using Workato as an orchestration tool results in rate limit error, likely due to the volume of API calls

 

Could you please advise what is the best way for us to get all the indexes from HighQ(Site info and their respective files info only ) and save them in our local database