Adding a request to OpenAI in a .NET console application

I developed a .NET8 console application that crawls documentation (for example, an API provider) to find pages containing content relevant to my query. The algorithm works as follows:

1. Initialization

   • The queue starts with the main URL and the depth of the crawl.

   • Processed URLs are tracked and responses are collected.

2. Crawling Pages

   • A URL is extracted from the queue, and the page is loaded (or from cache).

   • HTML is cleaned and text is extracted.

3. Request to OpenAI

   • A prompt is formed: the original prompt + the content of the page.

   • A request is sent to OpenAI with a JSON schema.

   • The response is cached and parsed into a structured form.

4. Collecting Responses

   • Each response is attached to the source URL.

   • Results are logged and accumulated.

5. Following Links

   • Internal links are searched for and added to the queue (if depth allows).

6. Completion

   • All responses are saved to the file api_search_result.txt in the "Documents" folder.

   • The file is automatically opened after completion.

What needs to be done:
Before saving all responses, another request to OpenAI needs to be added, which filters the results (responses) that do not match my filtering prompt (I will provide it later). The request should also be made using structured output, that is, with a JSON schema. (The first request, which is already implemented in this algorithm, also uses this approach; if you haven't worked with SO, you will easily understand it by example.)

In your response, please indicate:

1. Do you have experience using structured output in the OpenAI API?

2. What is your comfortable hourly rate?
   (I ask for the future, as new features are planned to be added to this project)