{"repo":"adbar/trafilatura","free":true,"listed":false,"github":"https://github.com/adbar/trafilatura","clone":"git clone https://github.com/adbar/trafilatura.git","description":"Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML","language":"Python","stars":6647,"topics":["article-extractor","corpus-builder","corpus-tools","crawler","html-to-markdown","html2text","llm","news-aggregator","news-crawler","nlp","rag","readability","rss-feed","scraping","tei","text-cleaning","text-extraction","text-mining","text-preprocessing","web-scraping"],"license":"Apache-2.0","category":"data_extraction","readme_excerpt":"# Trafilatura: Discover and Extract Text Data on the Web\n\n
\n\n![\"Trafilatura](\"https://raw.githubusercontent.com/adbar/trafilatura/master/docs/trafilatura-logo.png\")
\n\n
\n\n[](https://pypi.python.org/pypi/trafilatura)\n[](https://pypi.python.org/pypi/trafilatura)\n[](http://trafilatura.readthedocs.org/en/latest/?badge=latest)\n[](https://codecov.io/gh/adbar/trafilatura)\n[](https://pepy.tech/project/trafilatura)\n[](https://aclanthology.org/2021.acl-demo.15/)\n\n
\n\n![\"Demo](\"https://raw.githubusercontent.com/adbar/trafilatura/master/docs/trafilatura-demo.gif\")
\n\n
\n\n\n## Introduction\n\nTrafilatura is a cutting-edge **Python package and command-line tool**\ndesigned to **gather text on the Web and simplify the process of turning\nraw HTML into structured, meaningful data**. It includes all necessary\ndiscovery and text processing components to perform **web crawling,\ndownloads, scraping, and extraction** of main texts, metadata and\ncomments. It aims at staying **handy and modular**: no database is\nrequired, the output can be converted to commonly used formats.\n\nGoing from HTML bulk to essential parts can alleviate many problems\nrelated to text quality, by **focusing on the actual content**,\n**avoiding the noise** caused by recurring elements like headers and footers\nand by **making sense of the data and metadata** with selected information.\nThe extractor strikes a balance between limiting noise (precision) and\nincluding all valid parts (recall). It is **robust and reasonably fast**.\n\nTrafilatura is [widely used](https://trafilatura.readthedocs.io/en/latest/used-by.html)\nand integrated into [thousands of projects](https://github.com/adbar/trafilatura/network/dependents)\nby companies like HuggingFace, IBM, and Microsoft Research as well as institutions like\nthe Allen Institute, Stanford, the Tokyo Institute of Technology, and\nthe University of Munich.\n\n\n### Features\n\n- Advanced web crawling and text discovery:\n - Support for sitemaps (TXT, XML) and feeds (ATOM, JSON, RSS)\n - Smart crawling and URL management (filtering and deduplication)\n\n- Parallel processing of online and offline input:\n - Live URLs, efficient and polite processing of download queues\n - Previously downloaded HTML files and parsed HTML trees\n\n- Robust and configurable extraction of key elements:\n - Main text (common patterns and generic algorithms like jusText and readability)\n - Metadata (title, author, date, site name, categories and tags)\n - Formatting and structure: paragraphs, titles, lists, quotes, code, line breaks, in-line text formatting\n - Optional elements: comments, links, images, tables\n\n- Multiple output formats:\n - TXT and Markdown\n - CSV\n - JSON\n - HTML, XML and [XML-TEI](https://tei-c.org/)\n\n- Optional add-ons:\n - Language detection on extracted content\n - Speed optimizations\n\n- Actively maintained with support from the open-source community:\n - Regular updates, feature additions, and optimizations\n - Comprehensive documentation\n\n\n### Evaluation and alternatives\n\nTrafilatura consistently outperforms other open-source libraries in text\nextraction benchmarks, showcasing its efficiency and accuracy in\nextracting web content. The extractor tries to strike a balance between\nlimiting noise and including all valid parts.\n\nFor more information see the [benchmark section](https://trafilatura.readthedocs.io/en/latest/evaluation.html)\nand the [evaluation readme](https://github.com/adbar/trafilatura/blob/master/tests/README.rst)\nto run the evaluation with the latest data and packages.\n\n\n#### Other evaluations:\n\n- Most efficient open-source library in *ScrapingHub*'s [article extraction benchmark](https://github.com/scrapinghub/article-extraction-benchmark)\n- Best overall tool according to [Bien choisir son outil d'extraction de contenu à partir du Web](https://hal.archives-ouvertes.fr/hal-02768510v3/document)\n (Lejeune & Barbaresi 2020)\n- Best single tool by ROUGE-LSum Mean F1 Page Scores in [An Empirical Comparison of Web Content Extraction Algorithms](https://webis.de/downloads/publications/papers/bevendorff_2023b.pdf)\n (Bevendorff et al. 2023)\n\n\n## Usage and documentation\n\n[Getting started with Trafilatura](https://trafilatura.readthedocs.io/en/latest/quickstart.html)\nis straightforward. For more information and detailed guides, visit\n[Trafilatura's documentation](https://trafilatura.readthedocs.io/):\n\n- [Installation](https://trafilatura.readthedocs.io/en/latest/installation.html)\n- Usage:\n [On the command-line](https://trafilatura.readthedocs.io/en/latest/usage-cli.html),\n [With Python](https://trafilatura.readthedocs.io/en/latest/usage-python.html),\n [With R](https://trafilatura.readthedocs.io/en/latest/usage-r.html)\n- [Core Python functions](https://trafilatura.readthedocs.io/en/latest/corefunctions.html)\n- Interactive Python Notebook: [Trafilatura Overview](docs/Trafilatura_Overview.ipynb)\n- [Tutorials and use cases](https://trafilatura.readthedocs.io/en/latest/tutorials.html)\n\nYoutube playlist with video tutorials in several languages:\n\n- [Web scraping tutorials and how-tos](https://www.youtube.com/watch?v=8GkiOM17t0Q&list=PL-pKWbySIRGMgxXQOtGIz1-nbfYLvqrci)\n\n\n## License\n\nThis package is distributed under the [Apache 2.0 license](https://www.apache.org/licenses/LICENSE-2.0.html).\n\nVersions prior to v1.8.0 are under GPLv3+ license.\n\n\n### Contributing\n\nContributions of all kinds are welcome. Visit the [Contributing\npage](https://github.com/adbar/trafilatura/blob/master/CONTRIBUTING.md)\nfor more information. Bug reports can be filed on the [dedicated issue\npage](https://github.com/adbar/trafilatura/issues).\n\nMany thanks to the\n[contributors](https://github.com/adbar/trafilatura/graphs/contributors)\nwho extended the docs or submitted bug reports, features and bugfixes!\n\n\n## Context\n\nThis work started as a PhD project at the crossroads of linguistics and\nNLP, this expertise has been instrumental in shaping Trafilatura over\nthe years. Initially launched to create text databases for research purposes\nat the Berlin-Brandenburg Academy of Sciences (DWDS and ZDL units),\nthis package continues to be maintained but its future depends on community support.\n\n**If you value this software or depend on it for your product, consider\nsponsoring it and contributing to its codebase**. Your support\n[on GitHub](https://github.com/sponsors/adbar) or [ko-fi.com](https://ko-fi.com/adbarbaresi)\nwill help maintain and enhance this popular package.\n\n*Trafilatura* is an Italian word for [wire\ndrawing](https://en.wikipedia.org/wiki/Wire_drawing) symbolizing the\nrefinement and conversion process. It is also the way shapes of pasta\nare formed.\n\n### Author\n\nReach out via ia the software repository or the [contact\npage](https://adrien.barbaresi.eu/) for inquiries, collaborations, or\nfeedback. See also social networks for the latest updates.\n\n- Barbaresi, A. [Trafilatura: A Web Scraping Library and Command-Line\n Tool for Text Discovery and\n Extraction](https://aclanthology.org/2021.acl-demo.15/), Proceedings\n of ACL/IJCNLP 2021: System Demonstrations, 2021, p. 122-131.\n- Barbaresi, A. \"[Generic Web Content Extraction with Open-Source\n Software](https://hal.archives-ouvertes.fr/hal-02447264/document)\",\n Proceedings of KONVENS 2019, Kaleidoscope Abstracts, 2019.\n- Barbaresi, A. \"[Efficient construction of metadata-enhanced web\n corpora](https://hal.archives-ouvertes.fr/hal-01371704v2/document)\",\n Proceedings of the [10th Web as Corpus Workshop\n (WAC-X)](https://www.sigwac.org.uk/wiki/WAC-X), 2016.\n\n\n### Citing Trafilatura\n\nTrafilatura is widely used in the academic domain, chiefly for data\nacquisition. Here is how to cite it:\n\n[](https://aclanthology.org/2021.acl-demo.15/)\n[](https://doi.org/10.5281/zenodo.3460969)\n\n``` shell\n@inproceedings{barbaresi-2021-trafilatura,\n title = {{Trafilatura: A Web Scraping Library and Command-Line Tool for Text Discovery and Extraction}},\n author = \"Barbaresi, Adrien\",\n booktitle = \"Proceedings of the Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: System Demonstrations\",\n pages = \"122--131\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2021.acl-demo.15\",\n year = 2021,\n}\n```\n\n\n### Software ecosystem\n\nJointly developed plugins and additional packages also contribute to the\nfield of web data extraction and analysis:\n\n![\"Software](\"https://raw.githubusercontent.com/adbar/htmldate/master/docs/software-ecosystem.png\")
\n\nCorresponding posts can be found on [Bits of\nLanguage](https://adrien.barbaresi.eu/blog/tag/trafilatura.html).\n\nImpressive, you have reached the end of the page: Thank you for your\ninterest!\n","default_branch":"master","files":1157,"tree":[".coveragerc",".gitattributes",".github/FUNDING.yml",".github/workflows/codeql.yml",".github/workflows/tests.yml",".gitignore",".readthedocs.yaml","CITATION.cff","CONTRIBUTING.md","HISTORY.md","LICENSE","MANIFEST.in","README.md","docs/Makefile","docs/Trafilatura_Overview.ipynb","docs/background.rst","docs/compendium.rst","docs/conf.py","docs/corefunctions.rst","docs/corpus-data.rst","docs/crawls.rst","docs/deduplication.rst","docs/docs_tests.py","docs/downloads.rst","docs/dwds-count-exportieren.jpg","docs/dwds-exportieren.jpg","docs/dwds-treffer-exportieren.jpg","docs/evaluation.rst","docs/gui-screenshot.png","docs/index.rst","docs/installation.rst","docs/make.bat","docs/quickstart.rst","docs/robots.txt","docs/settings.rst","docs/software-ecosystem.png","docs/sources.rst","docs/tests.rst","docs/trafilatura-demo.gif","docs/trafilatura-logo.png","docs/troubleshooting.rst","docs/tutorial-dwds.rst","docs/tutorial-epsilla.rst","docs/tutorial0.rst","docs/tutorial1.rst","docs/tutorial2.rst","docs/tutorials.rst","docs/url-management.rst","docs/usage-api.rst","docs/usage-cli.rst","docs/usage-gui.rst","docs/usage-python.rst","docs/usage-r.rst","docs/usage.rst","docs/used-by.rst","pyproject.toml","tests/README.rst","tests/__init__.py","tests/baseline_tests.py","tests/cache/adac.de.kindersitze.html","tests/cache/austria.info.radfahren.html","tests/cache/basicthinking.de.tweets.html","tests/cache/befifty.montauk.html","tests/cache/blog.python.org.html","tests/cache/blog.wordpress.com.diverse.html","tests/cache/bmjv.de.konsum.html","tests/cache/boingboing.net.millenials.html","tests/cache/brandenburg.de.homo-brandenburgensis.html","tests/cache/brigitte.de.ikigai.html","tests/cache/buchperlen.wordpress.com.html","tests/cache/caktusgroup.com.django.html","tests/cache/cdu-fraktion-erfurt.de.waldorfschule.html","tests/cache/changelog.blog.zwischenbilanz.html","tests/cache/chineselyrics4u.com.zhineng.html","tests/cache/chip.de.beef.html","tests/cache/chip.de.tests.html","tests/cache/cnet.de.schutz.html","tests/cache/computerbase.de.htc.html","tests/cache/correctiv.org.zusage.html","tests/cache/crazy-julia.de.tipps.html","tests/cache/creativecommons.at.faircoin.html","tests/cache/creativecommons.org.html","tests/cache/de.creativecommons.org.endlich.html","tests/cache/demokratiewebstatt.at.luft.html","tests/cache/denkanstoos.com.2012.html","tests/cache/die-partei.net.luebeck.html","tests/cache/dw.com.colonial.html","tests/cache/dw.com.uncork.html","tests/cache/ebrosia.de.zinfandel.html","tests/cache/en.wikipedia.org.tsne.html","tests/cache/erp-news.info.interview.html","tests/cache/fairkom.eu.about.html","tests/cache/faz.net.streaming.html","tests/cache/franceculture.fr.idees.html","tests/cache/franziska-elea.de.vuitton.html","tests/cache/futurezone.at.lyft.html","tests/cache/github.blog.spiceland.html","tests/cache/gofeminin.de.abnehmen.html","tests/cache/gregoryszorc.com.python3.html","tests/cache/gruen-digital.de.jahrestagung.html","tests/cache/heise.de.lithium.html","tests/cache/hundeverein-kreisunna.de.html","tests/cache/iloveponysmag.com.barbour.html","tests/cache/incurvy.de.wellness.html","tests/cache/internet-law.de.pseudonymen.html","tests/cache/jolie.de.adele.html","tests/cache/jovelstefan.de.gefallt.html","tests/cache/knowtechie.com.rally.html","tests/cache/kulinariaathome.com.mandelplätzchen.html","tests/cache/lady50plus.de.sekre.html","tests/cache/landwirt.com.sensortechnik.html","tests/cache/lanouvellerepublique.fr.martin.html","tests/cache/laviedesidees.fr.evaluation.html","tests/cache/lemire.me.json.html","tests/cache/love-hina.ch.0409.html","tests/cache/luxuriousmagazine.com.polo.html","tests/cache/luxuryhaven.co.hyatt.html","tests/cache/majkaswelt.com.fashion.html","tests/cache/meedia.de.freenet.html","tests/cache/mercurynews.com.2023.01.16.letters-1119.html","tests/cache/mixed.de.vrodo.html","tests/cache/modepilot.de.duschkopf.html","tests/cache/moritz-meyer.net.vreni.html","tests/cache/nationalgeographic.co.uk.goats.html","tests/cache/nature.com.telescope.html","tests/cache/ndr.de.podcastcoronavirus140.html","tests/cache/netzpolitik.org.abmahnungen.html","tests/cache/novalanalove.com.ear-candy.html","tests/cache/otto.de.twoforfashion.html","tests/cache/pcgamer.com.skyrim.html","tests/cache/phys.org.tool.html","tests/cache/piratenpartei-mv.de.grundeinkommen.html","tests/cache/plentylife.blogspot.pamela-reif.html","tests/cache/pluralsight.com.python.html","tests/cache/psl.eu.luniversite.html","tests/cache/rechtambild.de.kochbuch.html","tests/cache/reuters.com.parasite.html","tests/cache/rnz.de.witzel.html","tests/cache/rs-ingenieure.de.tragwerksplanung.html","tests/cache/salon.com.emissions.html","tests/cache/sauvonsluniversite.com.spip.html","tests/cache/schleifen.ucoz.de.briefe.html","tests/cache/scmp.com.playbook.html","tests/cache/shingon-reiki.de.schamanismus.html","tests/cache/simplyscience.ch.erdoel.html","tests/cache/skateboardmsm.de.dormhagen.html","tests/cache/sonntag-sachsen.de.emanuel.html","tests/cache/soundofscience.fr.1927.html","tests/cache/speicherguide.de.schwierige.html","tests/cache/spektrum.de.engelbart.html","tests/cache/spiegel.de.albtraum.html","tests/cache/spreeblick.com.habeck.html","tests/cache/stackoverflow.com.rust.html","tests/cache/stuttgart.de.html","tests/cache/sueddeutsche.de.flixtrain.html","tests/cache/telemedicus.info.rezension.html","tests/cache/theguardian.com.academics.html","tests/cache/theplanetarypress.com.forestlands.html","tests/cache/theverge.com.ios13.html","tests/cache/threatpost.com.android.html","tests/cache/toralin.de.schmierfett.html","tests/cache/vancouversun.com.microsoft.html","tests/cache/vice.com.amazon.html","tests/cache/viehbacher.com.steuerrecht.html","tests/cache/wehranlage-horka.de.887.html","tests/cache/wikimediafoundation.org.turkey.html","tests/cache/womencantalksports.com.top10.html","tests/cache/zeit.de.zugverkehr.html","tests/cli_tests.py","tests/conftest.py","tests/deduplication_tests.py","tests/downloads_tests.py","tests/eval/0a12df42d1764095989ab078ee0f940b.html","tests/eval/0a24692a9ea846c1819bd6a5f92a8874.html","tests/eval/0a29620f9c4347758c146ed06dab6f3e.html","tests/eval/0a3108e507c54157a95fe7a1338f5e9c.html","tests/eval/0a4a8ab61c054192b1ec70cc3570cf45.html","tests/eval/0a6291ebbce449b3b04256b43c73e39d.html","tests/eval/0a962f6bcd5649f7a7e6effa338df80d.html","tests/eval/0ac0531f1f0543f4a3f68159e5fd1875.html","tests/eval/0af99c85f22b451a93a75bbf99ac412e.html","tests/eval/0afd671fc2b64f3caa83a91537e8d343.html","tests/eval/0b4609a864eb4fa0bbcb2b395f6be9eb.html","tests/eval/0b5db24739704283849ca3ed20ce09d4.html","tests/eval/0b66696af800472190a76b26faa845d4.html","tests/eval/0b96fc66e2c94f45a1b923ec9a31fcf2.html","tests/eval/1000things.at-Wellnessoasen.html","tests/eval/100noticias.com-millones.html","tests/eval/1337kultur.de.picard.html","tests/eval/1hundetagebuch.wordpress.com.langer.html","tests/eval/24horas.cl-segundo.html","tests/eval/24ora.com-internationalschol.html","tests/eval/2gewinnt.wordpress.com.uns.html","tests/eval/5min.at-Villachs.html","tests/eval/7mind.de.grenzen.html","tests/eval/90min.de-Bundesliga-Tabelle.html","tests/eval/Angus Barbieri. Nie jadł przez 382 dni - Menway w INTERIA.PL.html","tests/eval/Dezubekizacja – reaktywacja. Czyli daty mają znaczenie - Dziennik.pl.html","tests/eval/Eurocash rusza z Innowacyjną Platformą Handlu - Handel dystrybucja.html","tests/eval/Eurostat_ Polska z najniższym bezrobociem w całej UE.html","tests/eval/Finowie odkrywają wino _ Res Publica Nowa.html","tests/eval/Ile jest warta godzina pracy_ W tych krajach praca popłaca - Forsal.pl.html","tests/eval/Jest zgoda PE na umowę handlową między UE a Londynem.html","tests/eval/Journalistenwatch.com-Ladensterben.html","tests/eval/KATAPULT-Magazin.de-parteien.html","tests/eval/Koncesjonowana opozycja -Leszek Jażdżewski - Liberté!.html","tests/eval/Lebensmittelpraxis.de-Stadtzentrum.html","tests/eval/Maciej Krzysztoszek rzecznik prasowy Amica menedżer komunikacji zewnętrznej.html","tests/eval/Nowa Zelandia_ płatny urlop dla rodziców poronionego dziecka. Jak to wygląda w Polsce_ — Klub Jagielloński.html","tests/eval/OnlineMarketing.de-Instagram.html","tests/eval/Ostbelgiendirekt.be-ARD-Doku.html","tests/eval/Osthessen-news.de-Buergermeisterwahl.html","tests/eval/Popkultur.de-Schauspieler.html","tests/eval/Raptastisch.net-Seitenhieb.html","tests/eval/Rosjanie sugerują natychmiastowe odcięcie Polski od gazu - Energetyka24.html","tests/eval/Rosyjskie zamachy w Czechach – kontekst krajowy, implikacje, perspektywy.html","tests/eval/SW1.News-Heimat.html","tests/eval/Solarserver.de.solarthermisches kraftwerk dubai.html","tests/eval/Sprzeciw wobec ataków na Fundację Lux Veritatis – RadioMaryja.pl.html","tests/eval/Tageswoche.ch-weg.html","tests/eval/Unijne fundusze coraz bliżej. Sejm zagłosował _za_ - Polityka - rp.pl.html","tests/eval/Volksstimme.ch-loehne.html","tests/eval/Winda w chmurach _ Obyczaje _ Dwutygodnik _ Dwutygodnik.html","tests/eval/Windows 10 od lipca przestanie obsługiwać Adobe Flash.html","tests/eval/_Ziemniaki na szóstej, surówka na dziesiątej_. Jak pomagać, żeby nie zaszkodzić_ [PORADNIK W PIGUŁCE].html","tests/eval/abc13.com-Copperfield.html","tests/eval/abc7news.com-Napa.html","tests/eval/abenteuer-astronomie.de.plejaden.html","tests/eval/abookshelffullofsunshine.blogspot.com.interview.html","tests/eval/achgut.com-coronalage.html","tests/eval/achtundvierzig.hypotheses.org.822.html","tests/eval/aclu.org-grades.html","tests/eval/acpjournals.org.3075.html","tests/eval/ad-magazin.de.wellness.html","tests/eval/advents-shopping.de.weihnachtsmaerkte.html","tests/eval/aerobuzz.de-bremen.html","tests/eval/agrarheute.com.abfallholz.html","tests/eval/ahlen.de.reparaturcafe.html","tests/eval/aktion-hummelschutz.de.hummeln.html","tests/eval/alacarte.at-purzelbaum.html","tests/eval/alexander-klier.net.zeitphilosophie.html","tests/eval/alexanderlasch.wordpress.com.sprachgeschichte.html","tests/eval/alpin.de-freeride.html","tests/eval/amazedmag.de.meinleben.html","tests/eval/ambito.com-paritarias.html","tests/eval/amnesty.de-waffensysteme.html","tests/eval/anarc.at.cdpath.html","tests/eval/anchor.ch.lanka.html","tests/eval/andreabottlinger.wordpress.com.arent.html","tests/eval/angelmagazin.de-schmerzen.html","tests/eval/anglerboard.de-rute.html","tests/eval/antary.de.wireshark.html","tests/eval/anwaltniemeyer.de.index.html","tests/eval/aoc.media.archaisme.html","tests/eval/apolut.net-Sonja-Silberhorn.html","tests/eval/arbeit-und-arbeitsrecht.de.urlaub.html","tests/eval/arbeitsagentur.de-arbeitsmarkt.html","tests/eval/archiv.krimiblog.de.2895.html","tests/eval/archive.modabot.de.serkan.html","tests/eval/archive.ordnungsrausch.com.orga-life.html","tests/eval/archive.org-travaillent.html","tests/eval/archive.org.bewegliche-lettern.de.typography.html","tests/eval/archive.org.dimido.de.marketing.html","tests/eval/archive.org.dzs-clan.de.html","tests/eval/archive.org.he.xinhuanet.com.25340717.html","tests/eval/archive.org.juergenheitmann.com.aggression.html","tests/eval/archive.org.medialepfade.de.medienpaedagogin.html","tests/eval/archive.org.muffinrezept.net.grundrezept.html","tests/eval/archive.org.nesselsetzer.wordpress.com.antipoden.html","tests/eval/archive.org.przepisy.pl.pierogi.html","tests/eval/archive.org.rent-a-pastor.com.hochzeitslokation.html","tests/eval/archive.org.steinzeitwissen.de.werkzeuge.html","tests/eval/archive.org.stol.it.berlusconi.html","tests/eval/archive.org.swap-stop.org.shuji.html","tests/eval/archive.org.the-pain.net.silkroad.html","tests/eval/archive.org.time4talks.com.kinos.html","tests/eval/archive.org.tv-orange.de.future.html","tests/eval/archive.org.welpenkaufen24.de.html","tests/eval/archive.peptalks.de.schulnoten.html","tests/eval/arsnova.thm.de.frag.html","tests/eval/arteradio.com-nuls.html","tests/eval/assabah.com.tn.article.html","tests/eval/aussengedanken.de.feuerholz.html","tests/eval/auswaertiges-amt.de-Italien.html","tests/eval/auto-motor.at-hyundaitest.html","tests/eval/auto-presse.de-minisuv.html","tests/eval/auto-wirtschaft.ch-camping.html","tests/eval/auto.oe24.at-golfchina.html","tests/eval/autohaus.de-skode.html","tests/eval/automobilwoche.de-VW-Betriebsversammlung.html","tests/eval/autonews.ch-Tesla.html","tests/eval/autosprint.ch-pistenstopp.html","tests/eval/autozeitung.de-adblue.html","tests/eval/awo.org-Menschenrechte.html","tests/eval/axios.com.future.html","tests/eval/backen.de.maulwurfkuchen.html","tests/eval/backenmachtgluecklich.de.zitronenkuchen.html","tests/eval/badische-zeitung.de-Wohnungssuche.html","tests/eval/baechli-bergsport.ch-lawinen.html","tests/eval/bafa.de-mineraloelabsatz.html","tests/eval/bahamaslocal.com-atlantis.html","tests/eval/baike.baidu.com.tanya.html","tests/eval/banyuetan.org.1000200033136171577956287380194268_1.html","tests/eval/barbadostoday.bb-contest.html","tests/eval/battery-news.de.ultium-cells.html","tests/eval/bauemotion.de-schneereampflicht.html","tests/eval/baumeister.de.sportzentrum.html","tests/eval/baumev.de.Transformationslabor.html","tests/eval/bayrische-bembel.de.504.html","tests/eval/bbc.com.52241221.html","tests/eval/bdzv.de.eliasson.html","tests/eval/be.ch-impfen.html","tests/eval/beige.de.suedfrankreich.html","tests/eval/bergsteigen.com-skibergsteigen.html","tests/eval/berkutschi.com-willingen.html","tests/eval/berliner-feuerwehr.de-Ehrenzeichen.html","tests/eval/bettycrocker.com.pineapple.html","tests/eval/bewusster-leben.de.hope.html","tests/eval/beyssonmanagement.com.innovation.html","tests/eval/bfn.de-verden.html","tests/eval/bfs.de-radon.html","tests/eval/biathlon-antholz.it-jubeln.html","tests/eval/biathlonword.com-chinesisch.html","tests/eval/bibliothek2null.de.mai.html","tests/eval/bigdata.ypart.eu.datenerhebung.html","tests/eval/bike-magazin.de-strava.html","tests/eval/biobiochile.cl-gremios.html","tests/eval/bka.de-messengerdienste.html","tests/eval/blinker.de-Rostock.html","tests/eval/blog.amp.dev.axios.html","tests/eval/blog.gaijinpot.com.chikan.html","tests/eval/blog.mondediplo.net.turpitude.html","tests/eval/blog.teufel.de.leistung.html","tests/eval/bloghaus.hypotheses.org.2320.html","tests/eval/blogoff.de.i-htm.html","tests/eval/bmas.de-anforderungen.html","tests/eval/bmbf.de.energiewende.html","tests/eval/bmel.de-zukunftsforum.html","tests/eval/bmfsfj.de-praesidentschaft.html","tests/eval/bmwi.de-neubau.html","tests/eval/bmz.de-schulze.html","tests/eval/bondyblog.fr.paris-8.html","tests/eval/bos-fahrzeuge.info-haubenfahrzeuge.html","tests/eval/bostonherald.com-Brothel-catering.html","tests/eval/boxen.de-staatsanwaltschaft.html","tests/eval/boxen1.com-ring-rückkehr.html","tests/eval/brandeins.de.wahresIch.html","tests/eval/brasil247.com-militares.html","tests/eval/breakingbelizenews.com-paho.html","tests/eval/bsi.de-ki.html","tests/eval/btv.de-spuren.html","tests/eval/buero-hoppe.de.baumgutachten.html","tests/eval/bummfilm.de.über.html","tests/eval/bumsbutzener-gumpfen.blogspot.com.tach-auch.html","tests/eval/bund-naturschutz.de-habeck.html","tests/eval/bund.net-hermlin.html","tests/eval/bundesfeuerwehrverband.at-eröffnet.html","tests/eval/bundeskanzleramt.gv.at-bundesminsterin.html","tests/eval/bundespolizei.de-Belarus.html","tests/eval/bundespraesident.de.20030331.html","tests/eval/bundesrat.de-erinnerungen.html","tests/eval/bunterepublik.wordpress.com.talstrasse.html","tests/eval/business-punk.com.fitness.html","tests/eval/businessjargons.com.leadership.html","tests/eval/californiaglobe.com.amazon.html","tests/eval/campino2k.de.uberspace.html","tests/eval/campograndenews.com.br-adolescente.html","tests/eval/careelite.de-flaechenverbrauch.html","tests/eval/caritas.de-Präsidentin.html","tests/eval/caymancompass.com-prison.html","tests/eval/cbsnews.com.carolina.html","tests/eval/cducsu.de-wasserstoff.html","tests/eval/chabermu.wordpress.com.expertenwissen.html","tests/eval/chadim.net.schreibstil.html","tests/eval/changenow.de.loibl.html","tests/eval/chefkoch.de.mandarinen.html","tests/eval/chemie.de.spin-off.html","tests/eval/chemietechnik.de.forschungsgruppe fuer biotechnologie.html","tests/eval/chip.de.bestcrypt.html","tests/eval/chocolate.com.pregnant.html","tests/eval/chorknaben-ulm.de.geschichte.html","tests/eval/cicero.de.pandemie.html","tests/eval/citylimits.org-Nycha.html","tests/eval/clarin.com-albertofernandez.html","tests/eval/cleanthinking.de.oranger-wasserstoff.html","tests/eval/coaching-magazin.de.transgenerationales-coaching.html","tests/eval/colours-of-the-soul.alhelm.net.html","tests/eval/columbus-entdeckt.de.trolls.html","tests/eval/comparis.ch.autofinanzierung.html","tests/eval/confidencial.com-ortega.html","tests/eval/coopbuddy.de.bee.html","tests/eval/cooperativa.cl-presidente.html","tests/eval/corkbeo.ie.level.html","tests/eval/correio24horas.com.br-PMS.html","tests/eval/correiobraziliense.com.br-poderes.html","tests/eval/couchstyle.de.vintage.html","tests/eval/courgage-online.de.HIV.html","tests/eval/creativecommons.ch.wie.html","tests/eval/creeny.wordpress.com.nebelsuppe.html","tests/eval/critical.com.pa-amador.html"],"storefront":"/r/adbar","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/adbar/trafilatura/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}