How to prevent generating internal links in resulting markdown

[dmurat]

I want to prevent the generation of internal links (links starting with #) in the markdown. In previous crawl4ai versions (e.g. 0.4.1) I used html2textparam for this like in

crawl_result = await crawler.arun(
            url=url,
            html2text={
                "skip_internal_links": True,    # Skip internal (links starting with #) links rendering
                "unicode_snob": False,          # Do convert HTML entities to Unicode
            },
            cache_mode=CacheMode.BYPASS,
            verbose=True,
        )

Unfortunately, in version 0.4.247, the html2text config option is not supported anymore. How can I skip internal links rendering now?

Is there any particular reason why the html2text config was removed?

Tnx

[dmurat]

With the latest version (0.4.247), all html2text options can be provided via the markdown_generator option. Here is an example from the author: #402 (comment)