Cannot Retrieve all Indexes on HighQ

Hello Team,

 

We are experiencing an issue retrieving all document indexes from HighQ via API. The objective is to retrieve all active HighQ site names along with their respective file‑level details (metadata only). An earlier implementation successfully retrieved the full dataset; however, since around July 2025, the same approach no longer returns complete results. Running the existing solution without modification retrieves only ~3,000 documents, while the business confirms there are approximately 30,000 documents stored in HighQ. After refactoring the implementation to use async functions, the number of retrieved indexes increased to 8,000+, but the results remain incomplete.

 

The integration currently relies on the following HighQ API endpoints:

 

 

 

 

Key observations from testing:

  • Not retrieving the actual count of site details on HighQ
  • Using Workato as an orchestration tool results in rate limit error, likely due to the volume of API calls

 

Could you please advise what is the best way for us to get all the indexes from HighQ(Site info and their respective files info only ) and save them in our local database

  • 0
    Thomson Reuters Thomson Reuters staff member

    Hi Girish,

    We are looking into it.

    Thank you.

  • 0
    Thomson Reuters Thomson Reuters staff member
    in reply to Krishna Teja .

    Hi Girish,

    Kindly confirm that all 30,000 files are located exclusively in the active site and that none originate from archived sites?

    Thank you.

  • Hi Krishna,

    Yes, I can confirm that the 30,000 documents are associated with the active sites.

  • +1
    Thomson Reuters Thomson Reuters staff member
    in reply to Girish Govind

    Hi Girish,

    We observed that no limit parameter was passed in the provided endpoint. According to the Swagger documentation, if the limit is not specified, the API returns only 100 records by default. To retrieve all data, the limit parameter must be set to -1.



    Note: The process starts by retrieving the parent folder details along with the files directly present in the parent folder. Then, all child folders within the parent folder must be identified. Since a child folder can contain both files and additional child folders, this process must be repeated recursively for every level of the folder hierarchy. Files must be retrieved at each level until there are no further child folders. Following this hierarchical and recursive approach across all sites ensures complete and accurate results.

    For Example:

    Hierarchical Site–Folder Structure (Concept Explanation)

    • The system contains multiple sites.
    • Each site has a root / parent folder.
    • Every folder (at any level) can contain:
      • Files
      • Sub‑folders
    • This structure is recursive and can continue to any depth

    Endpoint Responsibilities

    For every folder, the same two endpoints are used:

    • /files

      • Returns all files directly inside the current folder.

    • /items

      • Returns all sub‑folders (child folders) of the current folder.


    Note: Ensure that appropriate permissions are in place for all sites, folders, and files, as insufficient access may not return the entire files we required.

    For reference: https://www.thomsonreuters.com/en-gb/help/highq/files-module/files-admin/files-administration-settings


    If you require any further assistance, please log a ticket using the following link: highq-support@thomsonreuters.com


    Thank you.

  • Hi Krishna,

    Should I add the parameter limit=-1 on the api below or add them on the others as well?

    "">collaborate.ocorian.com/.../sites

  • +1
    Thomson Reuters Thomson Reuters staff member
    in reply to Girish Govind

    Hi Girish,

    For the site endpoint, you can leave the limit parameter as the default value. However, for the other endpoints specifically files and folders you should explicitly set the limit = -1 to ensure all records are retrieved.

    Thank you.

  • Hi Krishna, 
    Is there a way for us to know how many files are present on HighQ system in total so that we can have an idea  if we are getting the correct number entries?

  • 0
    Thomson Reuters Thomson Reuters staff member
    in reply to Girish Govind

    Hi Girish,

    Unfortunately, there isn’t an API available to retrieve the total count of all files across the HighQ system in single response.
    However, you may consider reviewing file counts at individual site and folder levels to help estimate and validate the numbers.

    Thank you.