New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add another function of feedForwardWithKey to support features mask #4984

Closed
qihuagao opened this Issue Apr 26, 2018 · 1 comment

Comments

Projects
None yet
2 participants
@qihuagao
Copy link

qihuagao commented Apr 26, 2018

Issue Description

SparkDl4jMultiLayer currently has the function:

/**
     * Feed-forward the specified data, with the given keys. i.e., get the network output/predictions for the specified data
     *
     * @param featuresData Features data to feed through the network
     * @param batchSize    Batch size to use when doing feed forward operations
     * @param <K>          Type of data for key - may be anything
     * @return             Network output given the input, by key
     */
    public <K> JavaPairRDD<K, INDArray> feedForwardWithKey(JavaPairRDD<K, INDArray> featuresData, int batchSize) {
        return featuresData.mapPartitionsToPair(new FeedForwardWithKeyFunction<K>(sc.broadcast(network.params()),
                        sc.broadcast(conf.toJson()), batchSize));
    }

It's useful for output result of spark rdd, but it's lack of mask of input feature now. hopefully it's should be quickly to implement it.

@AlexDBlack AlexDBlack self-assigned this Apr 30, 2018

AlexDBlack added a commit that referenced this issue Apr 30, 2018

AlexDBlack added a commit that referenced this issue May 1, 2018

@lock

This comment has been minimized.

Copy link

lock bot commented Sep 22, 2018

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

@lock lock bot locked and limited conversation to collaborators Sep 22, 2018

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.