Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add deep-merge util #1503

Merged
merged 14 commits into from Sep 23, 2020
Merged

Conversation

naseemkullah
Copy link
Member

@naseemkullah naseemkullah commented Sep 5, 2020

Which problem is this PR solving?

Short description of the changes

  • Create a utility in and export from the core package to be shared across packages to deep merge two objects.

Signed-off-by: Naseem <naseem@transit.app>
@codecov
Copy link

codecov bot commented Sep 5, 2020

Codecov Report

Merging #1503 into master will increase coverage by 0.48%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master    #1503      +/-   ##
==========================================
+ Coverage   92.69%   93.18%   +0.48%     
==========================================
  Files         152      156       +4     
  Lines        4409     4857     +448     
  Branches      846      987     +141     
==========================================
+ Hits         4087     4526     +439     
- Misses        322      331       +9     
Impacted Files Coverage Δ
...ackages/opentelemetry-core/src/utils/deep-merge.ts 100.00% <100.00%> (ø)
packages/opentelemetry-plugin-http/src/utils.ts 97.42% <0.00%> (ø)
packages/opentelemetry-plugin-http/src/http.ts 97.88% <0.00%> (ø)
packages/opentelemetry-plugin-https/src/https.ts 100.00% <0.00%> (ø)

@naseemkullah
Copy link
Member Author

naseemkullah commented Sep 5, 2020

Thanks for comments @vmarchaud, ready for re-review.

Signed-off-by: Naseem <naseem@transit.app>
@naseemkullah naseemkullah force-pushed the deep-merge-util branch 2 times, most recently from 9092761 to 55f6cba Compare September 5, 2020 10:40
Naseem added 2 commits September 5, 2020 06:48
Signed-off-by: Naseem <naseem@transit.app>
Signed-off-by: Naseem <naseem@transit.app>
@naseemkullah naseemkullah changed the title feat: add deep-merge utl feat: add deep-merge util Sep 8, 2020
Copy link
Member

@dyladan dyladan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Did this implementation come from somewhere that we might need to include the original license, or was it written from scratch?

Comment on lines 16 to 29
export function deepMerge(
target: Record<string, any>,
source: Record<string, any>
) {
const merged = target;
for (const prop in source) {
if (typeof source[prop] === 'object' && source[prop] !== null) {
merged[prop] = deepMerge(target[prop], source[prop]);
} else {
merged[prop] = source[prop];
}
}
return merged;
}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This function does no sort of cycle checking, which could cause an infinite CPU loop. This needs at the very least to be documented, but it might be nice to actually do some cycle checking. You don't need to do anything fancy like a Floyd's algorithm, but a simple maxDepth optional parameter that defaults to 10 or something and decrements each time you recurse might be a good sanity check.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, TIL

maxDepth param added... Can you provide a scenario where this could happen btw?

@obecny
Copy link
Member

obecny commented Sep 8, 2020

whats happened to previous version of this function I think it had more cases and code.
simple example

deepMerge({a: [4, 5, 6]}, { a: [3]})
// should be {a: [3,4,5,6]} but it returns [3,5,6]
deepMerge({a: 1}, {a: {c: 1}})
// should be {a: {c: 1}} but it returns {a: 1}

@dyladan
Copy link
Member

dyladan commented Sep 9, 2020

whats happened to previous version of this function I think it had more cases and code.
simple example

deepMerge({a: [4, 5, 6]}, { a: [3]})
// should be {a: [3,4,5,6]} but it returns [3,5,6]

The code comments state that arrays should be replaced, not merged. In this case, I would expect {a: [3] }.

@naseemkullah
Copy link
Member Author

whats happened to previous version of this function I think it had more cases and code.
simple example

deepMerge({a: [4, 5, 6]}, { a: [3]})
// should be {a: [3,4,5,6]} but it returns [3,5,6]

The code comments state that arrays should be replaced, not merged. In this case, I would expect {a: [3] }.

Right, the comments are misleading, @obecny is correct.

@naseemkullah
Copy link
Member Author

Did this implementation come from somewhere that we might need to include the original license, or was it written from scratch?

Was based off what I saw in a blog post, not sure which, I found this and this which both have the custom function this is based off of, it may have been one of these. It was changed quite a bit though. Shall I attribute them?

Naseem added 2 commits September 10, 2020 00:09
…ride primtive target props

Signed-off-by: Naseem <naseem@transit.app>
Signed-off-by: Naseem <naseem@transit.app>
@naseemkullah
Copy link
Member Author

ready for re-review @obecny @dyladan

…g own properties only

Signed-off-by: Naseem <naseem@transit.app>
for (const [prop, value] of Object.entries(source)) {
if (bothPropsAreArrays(target, source, prop)) {
merged[prop] = [];
merged[prop] = value;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why do you set it first as an array and then override it with value ? If the last line
merged[prop] = value;
should win then this condition is not needed as it is exactly the same action as else so you could simplify it to

if (bothPropsAreObjects(target, source, prop)) {
} else {
}

unless this is a bug and should be fixed differently.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure about this one, as it stands the merged[prop] at that time holds the target array as a value, but we want it to hold the source object's value however (as this util will replace arrays entirely). i.e. we want to replace its array value entirely, that's why i reset it first, unless there is a function to replace arrays I am unaware of?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

but you are assigning to merged[prop] 2 different values - one after another so it doesn't make sense to overrride it first with array ([]) and then with value

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah yes thanks. the initialization does seem unnecessary. I thought [4] merged into [1,2,3] would result in [4,2,3] without the initialization but does not seem to be the case.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed, PTAL

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok so now just last concern, you have here 3 conditions

  1. if (bothPropsAreArrays(target, source, prop)) {
  2. } else if (bothPropsAreObjects(target, source, prop)) {
  3. else

Condition 1 and 3 returns the same, so as I mentioned at the beginning you can simplify it to

if (bothPropsAreObjects(target, source, prop)) {
} else {
}

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ah right, so I tried that, in in fact both props being arrays does satisfy bothPropsAreObjects, in that case we do get the [4] merged into [1,2,3] resulting in [4,2,3] .

The alternative would be to have the function be bothPropsAreObjectsButNotArrays or something less verbose that depicts that

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you prefer a bothPripsAreObjectsButNotArrays approach or the order-being-important 3 case approach as is now?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

a ok then that makes sense now if arrays are being detected also as an objects, I would leave it as it is then, just add comment that the first condition is needed t prevent array being parsed as objects, thx

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I just refactored the if statement to make it apparent without comment, PTAL

packages/opentelemetry-core/src/utils/deep-merge.ts Outdated Show resolved Hide resolved
Naseem added 2 commits September 22, 2020 08:51
Signed-off-by: Naseem <naseem@transit.app>
Signed-off-by: Naseem <naseem@transit.app>
Naseem added 2 commits September 22, 2020 09:09
…es both props being objects but requires different logic

Signed-off-by: Naseem <naseem@transit.app>
Copy link
Member

@obecny obecny left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

packages/opentelemetry-core/src/utils/deep-merge.ts Outdated Show resolved Hide resolved
Signed-off-by: Naseem <naseem@transit.app>
@dyladan dyladan added the enhancement New feature or request label Sep 23, 2020
@dyladan dyladan merged commit 7831bd6 into open-telemetry:master Sep 23, 2020
@naseemkullah naseemkullah deleted the deep-merge-util branch April 9, 2021 18:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants