ManualTrigger Automate

Target Audience

• Developers looking to automate the process of extracting API documentation from various services.
• Data Analysts who need to gather and analyze API operations from multiple sources.
• Product Managers who want to understand the API capabilities of services they are evaluating.
• Technical Writers who need to compile API documentation for user manuals or help guides.
• Businesses that require an efficient way to manage and document API integrations.

Problem Solved

This workflow addresses the challenge of manually researching and extracting API documentation from various online sources. It automates the process of:

• Searching for relevant API documentation based on provided service names.
• Scraping webpage content to extract useful information about APIs.
• Organizing and storing this information systematically in a Google Sheet for easy access and further analysis.

Workflow Steps

1. Manual Trigger: The workflow starts when the user clicks the 'Test workflow' button.
2. Fetch Pending Research: It retrieves a list of services pending research from a Google Sheet.
3. Web Search: For each service, it performs a web search to find relevant API documentation.
4. Scrape Webpage Contents: The workflow scrapes the contents of the search results to filter out irrelevant pages and stores useful information.
5. Check for Results: It checks if any results were found and processes them accordingly.
6. Extract API Operations: It extracts API operations from the scraped content using a language model (Google Gemini).
7. Store Extracted Data: The extracted API operations are stored in a Google Sheet for future reference.
8. Generate Custom Schema: If applicable, it generates a custom JSON schema from the collected API operations and uploads it to Google Drive.
9. Error Handling: The workflow includes error handling to manage any issues during the scraping or extraction processes, updating the Google Sheet with the status of each operation.