Automated Company Data Extraction and Summary Generation

This workflow is ideal for:

• Data Analysts looking to automate the process of extracting and summarizing company data from Indeed.
• Recruiters who want to gather insights from job postings efficiently.
• Business Intelligence Professionals needing to integrate data from various sources into Airtable for better analysis.
• Developers interested in using n8n for building automated workflows with AI capabilities.
• Marketing Teams that require summarized competitor insights for strategic planning.

This workflow addresses the challenge of manually gathering and summarizing job-related data from Indeed, which can be time-consuming and prone to errors. By automating the process, users can:

• Save significant time by automating data extraction and summarization.
• Ensure accuracy in the data collected through structured API requests.
• Enable faster decision-making with summarized insights delivered directly to their systems.

1. Manual Trigger: The workflow starts when the user clicks ‘Test workflow’.
2. Set Bright Data Zone: Defines the Bright Data zone for web scraping.
3. Airtable Integration: Retrieves links to Indeed company pages from Airtable.
4. Conditional Check: If the link field is not empty, proceed to the web request.
5. Perform Indeed Web Request: Makes a POST request to the Bright Data API to unlock the Indeed page.
6. Markdown to Textual Data Extraction: Converts the markdown response into textual data for easier processing.
7. Summarization: Uses Google Gemini to summarize the extracted data.
8. AI Agent Formatting: The Indeed Expert AI Agent formats the search results.
9. Convert Markdown to HTML: Converts the summarized markdown into HTML format.
10. Webhook Notification: Sends the HTML response to a designated webhook for further processing or storage.