Skip to content

🍽 framework to integrate StartupRadar's data into your systems (CRM, Spreadsheets, Task Managers)

Notifications You must be signed in to change notification settings

startupradar/ingestion

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

An overview of StartupRadar's ingestion framework

Ingestion framework for StartupRadar

This repository provides a framework to ingest StartupRadar data into your own systems. Adaption to most use cases should be possible with only a few lines of code.

What Ingestion does for you:

  • fetches new startups from our startup API through a variety of methods
  • compares all startups against already stored startups
  • creates new deals or updates existing ones

With this tool, you can easily implement the following use cases:

  • create a new CRM deal for every unseen startup on StartupRadar
  • create a new comment for every competitor to a portfolio startup
  • add a comment on every deal that gets mentioned in the news

Supported Backends

Backends are the places where existing deals can be found and where new deals can get stored. So if a new startup pops up, this is where it's stored.

File-based:

  • CSV: a CSV file with a row for each startup

CRMs (coming soon):

  • Pipedrive
  • Hubspot
  • Affinity
  • Salesforce
  • Attio

Others (coming soon):

  • Airtable: check against and push new rows to airtable
  • Slack: push new startups as slack messages
  • Asana: add a task for each new startup
  • Trello: add a card for each new startup

Implementing your own storage backend is possible as well.

How new startups can be discovered

This tool provides easy access to the API and its features. New startups can currently be discovered in two ways. Firstly, via the Discovery endpoints of the API. These endpoints provide daily fresh discoveries, e.g. startups from academia or startups in the press. Secondly, by checking similar startups for a given list of startups, e.g. going through all your existing deals and adding newly discovered, related startups, or by going through your portfolio and adding similar startups.

Installation and usage

  • install by cloning this repository
  • create a virtual environment and activate it
  • install its requirements: pip install -r requirements.txt
  • edit the config.py file to match your desired workflow

Workflow examples

The example below shows you how to set up your worflow inside config.py.

import os

from core.api import DISCOVERY_ENDPOINTS, DiscoveryEndpointSource, SimilarStartupsSource
from core.workflow import CSVWorkflow

API_KEY = os.environ['STARTUPRADAR_API_KEY']

#
# set up default workflow
#

# find startups with the discovery endpoints
# and by checking the related domains of startupradar.co
sources = [
    # use all discovery endpoints
    *[DiscoveryEndpointSource(de) for de in DISCOVERY_ENDPOINTS],
    # add list of related domains
    SimilarStartupsSource(["startupradar.co"]),
]

# create a workflow which
# - uses these sources
# - pushes new results into CSVs inside the out folder
WORKFLOW = CSVWorkflow(sources, ".out/")

Changelog

2022-12-17

  • initial publication

About

🍽 framework to integrate StartupRadar's data into your systems (CRM, Spreadsheets, Task Managers)

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages