CluedIn.Crawling.HubSpot

CluedIn crawler for HubSpot.

---

Overview

This repository contains the code and associated tests for the HubSpot crawler.

Usage

NuGet Packages

To use the HubSpot crawler and provider with the CluedIn server you will have to add the following NuGet packages to the Providers.csproj project file:

Install-Package CluedIn.Crawling.HubSpot

Install-Package CluedIn.Crawling.HubSpot.Core

Install-Package CluedIn.Crawling.HubSpot.Infrastructure

Install-Package CluedIn.Provider.HubSpot

The NuGet packages specified are available on the internal development feed.

Debugging

To debug the HubSpot Provider/Crawler:

• Clone the CluedIn.Crawling.HubSpot repository
• Open Crawling.HubSpot.sln in Visual Studio
• Rebuild All
• Copy DLL and PDB files from \**\bin\debug\net452 to the servers ServerComponents folder
• Run CluedIn backend server using .\build.ps1 run
• In Visual Studio with the HubSpot crawler solution open, use Debug -> Attach to Process on CluedIn.Server.ConsoleHostv2.exe
• In the UI, add a new configuration for the HubSpot provider and invoke Re-Crawl

Working with the Code

Load Crawling.HubSpot.sln in Visual Studio or your preferred development IDE.

Running Tests

A mocked environment is required to run integration and acceptance tests. The mocked environment can be built and run using the following Docker command:

docker-compose up --build -d

Use the following commands to run all Unit and Integration tests within the repository:

dotnet test .\Crawling.HubSpot.sln --filter Unit
dotnet test .\Crawling.HubSpot.sln --filter Integration

To run Pester acceptance tests

invoke-pester

To review the WireMock HTTP proxy logs

docker-compose logs wiremock

References

• HubSpot

Tooling

• Docker
• Pester
• WireMock