TokenMill

All

21 repositories

common-crawl-utils
Public
Various Common Crawl utilities in Clojure.
clojure clojure-library warc common-crawl cdx-api
Clojure
•
Other
•1•6•2•1•Updated Dec 5, 2023Dec 5, 2023
dictionary-annotator
Public
Fast and configurable UIMA dictionary annotator.
nlp csv dictionary ruta dkpro annotators
Java
•
Other
•0•7•1•2•Updated Apr 17, 2023Apr 17, 2023
crawling-framework
Public
Easily crawl news portals or blog sites using Storm Crawler.
storm scraping crawling vaadin java elasticsearch crawler crawling-framework storm-crawler
Java
•
Other
•4•20•10•11•Updated Nov 15, 2022Nov 15, 2022
unsupervised-keyphrase-extraction
Public
EmbedRank: Unsupervised Keyphrase Extraction using Sentence Embeddings (official implementation)
Python
•
Apache License 2.0
•88•0•0•0•Updated Sep 8, 2021Sep 8, 2021
beagle
Public
Beagle helps you identify keywords, phrases, regexes, and complex search queries of interest in streams of text documents.
java nlp clojure lucene luwak stemming stream-search stored-query-engine real-time-search
Clojure
•
Other
•3•52•13•0•Updated Jun 30, 2021Jun 30, 2021
clojure-graalvm-aws-lambda-template
Public
Leiningen template for AWS Lambda custom runtime with GraalVM native image compiled Clojure projects.
docker clojure aws-lambda graalvm lein-template aws-lambda-clojure aws-lambda-custom-runtime
Clojure
•
Other
•2•45•4•0•Updated Oct 5, 2020Oct 5, 2020
doccano
Public
Open source text annotation tool for machine learning practitioner.
Python
•
MIT License
•1.7k•0•0•0•Updated Jul 15, 2020Jul 15, 2020
gf-wordnet
Public
A WordNet in GF
Grammatical Framework
•11•0•0•0•Updated Mar 1, 2020Mar 1, 2020
openccg
Public
OpenCCG library for parsing and realization with CCG
Java
•
Other
•45•0•0•0•Updated Oct 24, 2019Oct 24, 2019
beagle-performance-benchmarks
Public
Performance benchmarks for the Beagle library, and comparisons with other stored-query solutions.
Clojure
•
Other
•0•1•0•0•Updated Oct 1, 2019Oct 1, 2019
snowball
Public
Snowball version of the Porter stemmer for the Lithuanian language.
nlp snowball stemmer porter-stemmer lithuanian-language
Other
•3•7•0•0•Updated Sep 4, 2019Sep 4, 2019
docx-utils
Public
Easily work with .docx files from Clojure (a wrapper on Apache POI library).
clojure docx poi clojars
Clojure
•
MIT License
•4•12•5•0•Updated Sep 4, 2019Sep 4, 2019
es-utils
Public
Clojure helper functions for Elasticsearch.
elasticsearch clojure
Clojure
•
Other
•0•1•1•0•Updated Sep 4, 2019Sep 4, 2019
crawling-framework-example
Public
Demonstration on how to use the Crawling Framework to setup a simple science news crawler and store results in ElasticSearch. Use this configuration to set up your own crawler.
elasticsearch crawler crawling-framework storm-crawler
Java
•
Other
•0•3•0•0•Updated Sep 4, 2019Sep 4, 2019
docker-images
Public
Docker configurations, images, and examples of Dockerfiles for various TokenMill products and projects.Official source for Docker configurations, images, and examples of Dockerfiles for TokenMill products and projects
docker clojure graalvm dockerfiles docker-images docker-configurations
Dockerfile
•
Other
•0•5•1•0•Updated Sep 4, 2019Sep 4, 2019
fast-url-access-checker
Public
Easily run HTTP GET requests against a list of URLs to check their HTTP status.
java clojure http-redirect url-cleaning http-status url-checker
Clojure
•
Other
•4•12•4•0•Updated Sep 4, 2019Sep 4, 2019
timewords
Public
Multilingual library to easily parse date strings to java.util.Date objects.
java natural-language-processing clojure date-time date-parser parsing
Clojure
•
Other
•1•30•6•0•Updated Sep 4, 2019Sep 4, 2019
spaCy
Public
💫 Industrial-strength Natural Language Processing (NLP) with Python and Cython
Python
•
MIT License
•4.4k•0•0•0•Updated Jul 2, 2019Jul 2, 2019
faraday
Public
DynamoDB client for Clojure
Clojure
•
Eclipse Public License 1.0
•84•0•0•0•Updated Jun 3, 2019Jun 3, 2019
metadata-detector
Public archive
Library to detect metadata from html files.
HTML
•
Apache License 2.0
•0•0•1•0•Updated Dec 16, 2016Dec 16, 2016
ltlangpack
Public archive
Tools for Lithuanian language processing
Shell
•7•15•0•0•Updated Jun 15, 2016Jun 15, 2016