feat: field mapping and custom schema #207

hvinder · 2023-08-28T04:31:15Z

Description

allow defining schema for unified fields
move default mapping to db from model
allow overriding default mapping to CRM fields by customers
allow overriding default mapping to CRM fields by connections
allow customers to select what fields can be overridden
support custom fields
support custom objects

Fixes # (issue)
#200 #201

Type of change

New feature (non-breaking change which adds functionality)
This change requires a documentation update

How Has This Been Tested?

Test all the objects and crms

Checklist:

My code follows the style guidelines of this project
I have performed a self-review of my code
I have commented my code, particularly in hard-to-understand areas
I have made corresponding changes to the documentation
My changes generate no new warnings
I have added tests that prove my fix is effective or that my feature works
New and existing unit tests pass locally with my changes
Any dependent changes have been merged and published in downstream modules

Pre and post deployment activities

run seed command to populate root schema mapping
setup redis

vercel · 2023-08-28T04:31:19Z

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
revert-client	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Oct 2, 2023 2:09pm

packages/backend/helpers/flattenObj.ts

packages/backend/index.ts

packages/backend/helpers/crm/transform/transformSchemaMapping.ts

* feat: processing ui * feat: immplememt sse and redis pubsub * feat: read sse data to render failed ui * minor changes * feat: api to fetch mappable details and crm object properties * feat: api to create connection field mapping * feat: add custom field mapped to connection schema * feat: reallly basic ui for std field mapping * feat: reallly basic ui for custom field mapping * feat: add styling * fix: fix add btn order * feat: check for t_id in sse msg; send private token for calling further apis * feat: save mappings on click * feat: fix ui * feat: show done screen * feat: mark form dirty if empty fields * feat: show done stage if config doesnt exist * chore: fix pr comments * chore: use temp tenant token for auth; ui fixes * chore: fix dropdown caret; redis timeout * chore: pubsub fix * chore: cleanup * chore: cleanup * chore: resolve conflicts

* prisma migration to add field mapping schemas * seed hs note model (unverified) * seed hs note model (verified) * seed hs note model * transform note acc to schema mapping * (approach 2) transform note acc to schema field mapping * (approach 2) seed all note fields and fix single note structure * minor fix * common func to transform field mapping to model * disunify using field mapping * allow connections to override field mapping * support custom objects in schema; show custom fields as additional * add winston and morgan logger * Field mapping for contact; support custom field mapping to custom crm field * add field mapping config * common unify and disunify methods * seed contact field mapping * use lodash get to transform nested mappings * unify and disunify for contact * disunify based on account config * unify and disunify for company * unify and disunify for deal * unify and disunify for event * unify and disunify for lead * unify and disunify for task * unify and disunify for user * minor refactor * handle 2 level nesting and fix mapping * make target field optional; multi level nesting * fix * fix * fix obj merge * fix pipedrive get format * preprocess * preprocess unify and disunify * disunify postprocess * flatten before disunify * pipedrive fix contact create * minor fixes * fix pipedrive lead disunify * chore: add account id to morgan logs * chore: cleanup * chore: cleanup * chore: cleanup * feat: ui for field mapping (revertinc#242) * feat: processing ui * feat: immplememt sse and redis pubsub * feat: read sse data to render failed ui * minor changes * feat: api to fetch mappable details and crm object properties * feat: api to create connection field mapping * feat: add custom field mapped to connection schema * feat: reallly basic ui for std field mapping * feat: reallly basic ui for custom field mapping * feat: add styling * fix: fix add btn order * feat: check for t_id in sse msg; send private token for calling further apis * feat: save mappings on click * feat: fix ui * feat: show done screen * feat: mark form dirty if empty fields * feat: show done stage if config doesnt exist * chore: fix pr comments * chore: use temp tenant token for auth; ui fixes * chore: fix dropdown caret; redis timeout * chore: pubsub fix * chore: cleanup * chore: cleanup * chore: resolve conflicts * feat: add remove mapping btn and divider * fix: fix logger * chore: cleanup * chore: move endpoints to fern * update yarn.lock * fix issues * add hubspot create custom properties api --------- Co-authored-by: jatin <sandilya.jatin@gmail.com>

hvinder self-assigned this Aug 28, 2023

hvinder added the feature label Aug 28, 2023

hvinder marked this pull request as draft August 28, 2023 04:33

vercel bot deployed to Preview August 29, 2023 08:24 View deployment

vercel bot deployed to Preview September 1, 2023 04:57 View deployment

vercel bot had a problem deploying to Preview September 1, 2023 05:14 Failure

vercel bot had a problem deploying to Preview September 6, 2023 09:34 Failure

vercel bot had a problem deploying to Preview September 6, 2023 09:56 Failure

vercel bot had a problem deploying to Preview September 6, 2023 17:02 Failure

vercel bot had a problem deploying to Preview September 7, 2023 10:44 Failure

vercel bot had a problem deploying to Preview September 7, 2023 10:45 Failure

vercel bot had a problem deploying to Preview September 8, 2023 10:01 Failure

vercel bot had a problem deploying to Preview September 12, 2023 07:40 Failure

hvinder marked this pull request as ready for review September 12, 2023 07:41

vercel bot had a problem deploying to Preview September 12, 2023 07:45 Failure

vercel bot had a problem deploying to Preview September 12, 2023 07:57 Failure

vercel bot deployed to Preview September 12, 2023 13:10 View deployment

vercel bot deployed to Preview September 12, 2023 14:44 View deployment

jatinsandilya reviewed Sep 25, 2023

View reviewed changes

packages/backend/helpers/flattenObj.ts Show resolved Hide resolved

jatinsandilya reviewed Sep 25, 2023

View reviewed changes

packages/backend/index.ts Outdated Show resolved Hide resolved

vercel bot deployed to Preview September 25, 2023 06:15 View deployment

jatinsandilya reviewed Sep 26, 2023

View reviewed changes

packages/backend/helpers/crm/transform/transformSchemaMapping.ts Outdated Show resolved Hide resolved

vercel bot deployed to Preview September 26, 2023 13:36 View deployment

vercel bot had a problem deploying to Preview September 27, 2023 06:37 Failure

vercel bot had a problem deploying to Preview September 27, 2023 06:42 Failure

vercel bot had a problem deploying to Preview September 27, 2023 07:10 Failure

vercel bot had a problem deploying to Preview September 27, 2023 08:31 Failure

vercel bot had a problem deploying to Preview September 29, 2023 06:27 Failure

prisma migration to add field mapping schemas

9d76060

hvinder and others added 15 commits October 2, 2023 12:04

disunify postprocess

6afaefd

flatten before disunify

2ba43d1

pipedrive fix contact create

930e213

minor fixes

73e7b51

fix pipedrive lead disunify

eb3dd88

chore: add account id to morgan logs

f01765c

chore: cleanup

46c0428

chore: cleanup

f6cd051

chore: cleanup

17cd4fa

feat: add remove mapping btn and divider

5165a5c

fix: fix logger

10d9533

chore: cleanup

655502e

chore: move endpoints to fern

44ac756

update yarn.lock

fad4f9f

jatinsandilya force-pushed the feat/field-mapping branch from cbdd00f to fad4f9f Compare October 2, 2023 06:40

vercel bot deployed to Preview October 2, 2023 06:42 View deployment

fix issues

bca170d

vercel bot deployed to Preview October 2, 2023 11:13 View deployment

jatinsandilya approved these changes Oct 2, 2023

View reviewed changes

add hubspot create custom properties api

3aa4dba

vercel bot deployed to Preview October 2, 2023 14:09 View deployment

jatinsandilya merged commit 94d20c6 into main Oct 2, 2023
2 checks passed

jatinsandilya deleted the feat/field-mapping branch December 15, 2023 09:09

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: field mapping and custom schema #207

feat: field mapping and custom schema #207

hvinder commented Aug 28, 2023 •

edited by jatinsandilya

vercel bot commented Aug 28, 2023 •

edited

feat: field mapping and custom schema #207

feat: field mapping and custom schema #207

Conversation

hvinder commented Aug 28, 2023 • edited by jatinsandilya

Description

Type of change

How Has This Been Tested?

Checklist:

Pre and post deployment activities

vercel bot commented Aug 28, 2023 • edited

hvinder commented Aug 28, 2023 •

edited by jatinsandilya

vercel bot commented Aug 28, 2023 •

edited