Small things I've learned that aren't easy to find in docs or by googling, mostly about Spark and data tools.
My page is inspired by Simon Willison’s great TIL blog and Julia's TIL.
Some small things I've learned that aren't easy to find in docs or by googling.
Mosaic - Databricks' H3 library is going through a rebrand after buying MosaicML and Databricks finding that it makes more sense to build things into the product directly.
thanks for reading. new posts: substack · rss
About two weeks over the winter holidays, millions of recorded player positions and six models. The features I added raised precision from 48% to 75%.
Levenshtein couldn't tell “fish” from “fishing”, so I ran DuckDB's jaro_similarity inside a PySpark pandas_udf to match two datasets. Cursed, but it got better fuzzy matching.
