Skip to content
This repository was archived by the owner on Nov 7, 2025. It is now read-only.
This repository was archived by the owner on Nov 7, 2025. It is now read-only.

Private model training (DP-SGD) with sparse features #1370

Open

Description

@Lufe44

Hello,

Private model training has been recently mentioned here. One of the privacy considerations is to include DP in the training loop through DP-SGD.

There are cases when DP-SGD would make the training process considerably slower as it destroys the sparsity of the gradients calculated during backprop, rendering impossible to use optimization techniques that rely on such sparsity. This is usually the case when some features are categorical features or working with embedding tables in the case of LLMs. I am aware there is research around this topic to remedy it, although it is not clear from the explainer linked above if this is something that has been considered in the context of Protected Audience API.

Are there any techniques that are being considered to face this or thoughts about this topic?

Thanks

Activity

  1. csharrison commented on Dec 18, 2024

    @csharrison
    Contributor

    Hi @Lufe44. Thank you very much for the feedback. It is useful to know that this is a concern.

    Yes we are aware of some techniques to preserve sparsity in DP-SGD, e.g. https://arxiv.org/abs/2404.10881, and indeed we are exploring supporting these kinds of techniques in the private model training infrastructure. However, since we are in the research phase we aren't able to make any commitments yet to whether it will be feasible for us to support.

    Did you have any specific approaches you wanted us to consider?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions