How to load and view your data? #15

tastyminerals · 2017-07-19T08:52:52Z

After reading through all the interesting technicalities on what the facets is I decided to try it on one of my datasets and realized that I still don't know how to load and view the data? Is there a normal tutorial that basically says: if you have a dataset D, do a, b and c, voilà ?

venkatesh-1729 · 2017-07-19T11:11:49Z

Here you go for facets dive:

from IPython.core.display import display, HTML
import pandas as pd

from sklearn.datasets import load_boston
boston_data = load_boston()

df = pd.DataFrame(boston_data['data'], columns=boston_data['feature_names'])
jsonstr = df.to_json(orient='records')

HTML_TEMPLATE = \
    """
        <link rel="import" href="/nbextensions/facets-dist/facets-jupyter.html">
        <facets-dive id="elem_id" height="600"></facets-dive>
        <script>
          var data = {jsonstr};
          document.querySelector("#elem_id").data = data;
        </script>
    """
html = HTML_TEMPLATE.format(jsonstr=jsonstr)
display(HTML(html))

fils · 2017-07-19T11:52:55Z

Is there a similar example on how to download, build and view via a web browser? I was able to install bazel and rebuild for Jupyter, but not seeing a path to build and run in a browser. Any help appreciated, this looks useful to me and others I know. Thanks.

jameswex · 2017-07-19T13:39:25Z

Right now the best examples of how to embed the visualizations into a website are the demo pages (https://pair-code.github.io/facets/index.html and https://pair-code.github.io/facets/quickdraw.html). The code for those pages can be found in this project's gh-pages branch (https://github.com/PAIR-code/facets/tree/gh-pages)

The basic idea is that you can build facets.html with "bazel build facets:facets" from the top-level directory. Then that facets.html can be imported into another page (such as the index.html and quickdraw.html from the gh-pages branch) and the and polymer elements can then be used in that page.

In the future, we can create some documentation clarifying this.

tastyminerals · 2017-07-19T13:49:57Z

These are not examples but a showcase of facets visualization features. I understand examples as instructions on how to use the toolkit locally.

Right now there is too much work to get it up and running tbo and it is easier (for me at least) to shove my data into prewritten R script and plot it. Unless I have a very high need to analyze the dataset samples in the very detail.

anna-mo · 2017-07-28T02:44:36Z

@jameswex i was puzzled by that i had build facets.html，and index.html also imports it, but not only the examples of the index.html did not display but the function of upload csv files didn't work, i'm curious what should i do to make the index.html work smoothly on my computer locally.

rahulkhul · 2017-10-06T04:24:12Z

@jameswex , I have python implementation of facets, but sometime graph are not visible with the same, but if I try from https://pair-code.github.io/facets/, it works fine and load faster for any size of dataset. could you please let me know, how we can solve the problem.

jameswex · 2017-10-11T18:06:54Z

@rahulkhul Do you have an example dataset that it is failing with, along with an ipython notebook that shows the issue? Which facets visualization are you seeing this problem with?

Are there are errors in the browser debugging console?

rahulkhul · 2017-10-11T18:45:54Z

Hello James, I have followed documentation provided on facets github repository, and build custom function which works on django server. Main dataset preparation thing in python : from facets_overview.generic_feature_statistics_generator import GenericFeatureStatisticsGenerator import pandas as pd import base64 data = pd.read_csv(csv_file_path) facets_dive_data = data.transpose().to_dict().values() df = pd.DataFrame(facets_dive_data) proto = GenericFeatureStatisticsGenerator().ProtoFromDataFrames([{'name': 'test', 'table': df}]) protostr = base64.b64encode(proto.SerializeToString()).decode("utf-8") HTML_TEMPLATE = """{protostr}""" facets_overview = HTML_TEMPLATE.format(protostr=protostr) HTML page: I have imported facets_jupyter.html and importing the function into main index.html <link rel="import" href="{% static 'facets-jupyter.html' %} " rel="stylesheet"> Used two div for separate data visualisation for dive and overview as below: <div class="tab-pane active" id="test"> <facets-overview id="elem"></facets-overview> </div> <div class="tab-pane active" id="test"> <facets-dive></facets-dive> </div> And passing dataset values from javascript as below : <script> const vis = document.querySelector('facets-dive'); vis.data = [{% for item in facets_dive_data %} {%for k, v in item.items%} { '{{k}}' : '{{v}}' }, {%endfor%} {%endfor%}] document.querySelector("#elem").protoInput ="{{facets_overview}}"; </script> This is working for all dataset( data from csv is converted into required format with pandas.) but for few dataset, its not working. If i try to upload the same csv from https://pair-code.github.io/facets/ , its working fine. I am not able to debug the problem. Hope you got my concern. Please let me know if my implementation is wrong and provide me some guidelines. Thanks. Rahul khul.

…

On Wed, Oct 11, 2017 at 11:37 PM, James Wexler ***@***.***> wrote: @rahulkhul <https://github.com/rahulkhul> Do you have an example dataset that it is failing with, along with an ipython notebook that shows the issue? Which facets visualization are you seeing this problem with? Are there are errors in the browser debugging console? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#15 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AECP0Sva1jTfqZYfXFBbmVJKW69qcs-aks5srQPFgaJpZM4OcbBo> .

jameswex · 2017-10-12T15:11:12Z

Would you be willing to share a csv on which this works and one on which it doesn't work? That would help me debug your issue. Let me know. Thanks!

rahulkhul · 2017-10-12T15:34:57Z

Yes sure.PFA. Sometimes python implementation gives error for boolean values too. And the input csv will gives correct result if I upload it on https://pair-code.github.io/facets/. but it is not giving result (blank graph) if ran through python implementation. My implemented code seems to be good as it gives correct result same as https://pair-code.github.io/facets/, but sometimes blank result for some dataset. Can we have same implementation as https://pair-code.github.io/facets/ in python ? Please let me know, If I am wrong. Thanks. Rahul Khul.

…

On Thu, Oct 12, 2017 at 8:41 PM, James Wexler ***@***.***> wrote: Would you be willing to share a csv on which this works and one on which it doesn't work? That would help me debug your issue. Let me know. Thanks! — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#15 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AECP0eoE-batUHEWkW3if1UfFMqi8RCiks5sriwbgaJpZM4OcbBo> .

jameswex · 2017-10-12T15:57:15Z

I don't see the attached files in the issue. Can you email the csvs to james.[my last name]@gmail.com? Thanks.

romulomadu-zz · 2017-12-13T17:02:50Z

What is the jupyter HTML template for this one?

jameswex · 2017-12-14T17:49:48Z

@romulomadu What is the question exactly?

For Facets Overview comparing the two datasets in your screenshot, the code to do that is in the example ipynb notebook file in the facets_overview directory.

mg1075 · 2017-12-30T00:28:05Z

@jameswex > In the future, we can create some documentation clarifying this.
That would be much appreciated.
I am getting nowhere fast trying to install all the different dependencies, etc., just to set things up (e.g., bazel on windows)0, and then for how to run and view in a web browser, I seem to be hopping all over the place, searching for instructions and finding tidbits here and there.

stenpiren · 2018-06-28T08:19:56Z

same here @mg1075 !

richard5334 · 2018-07-27T08:20:31Z

Facets is great to quickly visualize data except... only the most advance user will manage to get it installed/working.

I wish it would be made available the same way tensorboard is. With tensorboard, it's as simple as typing a single command. The only easy alternative to get quickly going in Facet is to directly use the example demo at https://pair-code.github.io/facets/

jameswex · 2018-07-27T12:42:39Z

Check out the new section on using Facets in Google Colaboratory (a free jupyter-based notebook environment): https://github.com/PAIR-code/facets#usage-in-google-colabratoryjupyter-notebooks and the sample notebook here: https://colab.research.google.com/drive/1QrcuNHJnL3TBzcFV-0yw6y3wWmSWv_gM

You can use facets dive and overview on csv or pandas dataframes with no need for any installations. Just a few commands in the notebook.

shirareznik · 2018-07-31T08:00:06Z

Hi,
I understand how to do everything with text or numeric data, but in what format I may add images to the csv?
(i.e.- how may I implement something similar to the "draw" data- but show my own images instead of faces?)
I want to add a "high dimensional" feature to the csv (some kind of an image).

Many thanks!

jameswex · 2018-08-06T19:12:20Z

The image data can't be added to the CSV, but with Facets Dive you can add an atlas image which contains thumbnail images for line in the csv, which is what we did for the draw data.

PR #137 is about to merge in a tool to help create this atlas image for any dataset you have, and then the atlas image can be provided to dive as the atlasUrl parameter as seen here: https://github.com/PAIR-code/facets/tree/master/facets_dive#sprite-properties

brandondutra mentioned this issue Jul 20, 2017

Make python code pip-installable #8

Closed

totto90 mentioned this issue Aug 14, 2017

How to display visualization outise of Jupyter and webserver #52

Open

makroid mentioned this issue Oct 17, 2017

Specify url #72

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

How to load and view your data? #15

How to load and view your data? #15

tastyminerals commented Jul 19, 2017 •

edited

venkatesh-1729 commented Jul 19, 2017

fils commented Jul 19, 2017

jameswex commented Jul 19, 2017 •

edited

tastyminerals commented Jul 19, 2017 •

edited

anna-mo commented Jul 28, 2017

rahulkhul commented Oct 6, 2017 •

edited

jameswex commented Oct 11, 2017

rahulkhul commented Oct 11, 2017 via email •

edited

jameswex commented Oct 12, 2017

rahulkhul commented Oct 12, 2017 via email •

edited

jameswex commented Oct 12, 2017 •

edited

romulomadu-zz commented Dec 13, 2017

jameswex commented Dec 14, 2017

mg1075 commented Dec 30, 2017

stenpiren commented Jun 28, 2018

richard5334 commented Jul 27, 2018

jameswex commented Jul 27, 2018

shirareznik commented Jul 31, 2018

jameswex commented Aug 6, 2018

How to load and view your data? #15

How to load and view your data? #15

Comments

tastyminerals commented Jul 19, 2017 • edited

venkatesh-1729 commented Jul 19, 2017

fils commented Jul 19, 2017

jameswex commented Jul 19, 2017 • edited

tastyminerals commented Jul 19, 2017 • edited

anna-mo commented Jul 28, 2017

rahulkhul commented Oct 6, 2017 • edited

jameswex commented Oct 11, 2017

rahulkhul commented Oct 11, 2017 via email • edited

jameswex commented Oct 12, 2017

rahulkhul commented Oct 12, 2017 via email • edited

jameswex commented Oct 12, 2017 • edited

romulomadu-zz commented Dec 13, 2017

jameswex commented Dec 14, 2017

mg1075 commented Dec 30, 2017

stenpiren commented Jun 28, 2018

richard5334 commented Jul 27, 2018

jameswex commented Jul 27, 2018

shirareznik commented Jul 31, 2018

jameswex commented Aug 6, 2018

tastyminerals commented Jul 19, 2017 •

edited

jameswex commented Jul 19, 2017 •

edited

tastyminerals commented Jul 19, 2017 •

edited

rahulkhul commented Oct 6, 2017 •

edited

rahulkhul commented Oct 11, 2017 via email •

edited

rahulkhul commented Oct 12, 2017 via email •

edited

jameswex commented Oct 12, 2017 •

edited