Make demo notebook runnable in Colab

[leemthompo]

Summary:

• Upload dataset directly in notebook
• Create index with mappings
• Ignore docs that fail to index
• Group imports and installs

Related work:

This is a more simplistic approach to #604

Preview in Colab

Visual diff

(Just the opening section — no changes to the actual examples)

[pquentin]

Thanks! LGTM.

Great work here on understanding what was needed to run on Colab and not doing more than necessary while still producing a great result.

I'm seeing ids like lswztIsBt5-t_OatRvrU in places like lswztIsBt5-t_OatRvrU instead of monotically increasing ids, and I'd like to know why, but it's not blocking IMO.

[leemthompo]

Should be good now using

def generate_actions(data):
    for idx, entry in enumerate(data, start=0):  # Use monotonically increasing IDs starting from 0
        yield {
            "_index": FLIGHTS_INDEX_NAME,
            "_id": idx,  # Use the current index as the document ID
            "_source": entry
        }

[pquentin]

Thanks! Much better. It's indeed how the tests do it (well the use Panda's itterrows, but that's the same).