Stories by marklit

I spent $2 and crawled 64% of IPv4's WHOIS data in 2 hours

33x Faster Queries on Google Cloud's Dataproc Using Facebook's Presto

Mass IPv4 WHOIS Collection with Django and Kafka on AWS EC2

AWS S3 vs. HDFS with 1B NYC Taxi Rides

A Billion NYC Taxi Rides on Google's Dataproc and Facebook's Presto

50-node Presto Cluster Crunching 1.1B NYC Taxi Trips on AWS EMR

A Billion NYC Taxi Rides on Google's BigQuery

Bulk IPv4 WHOIS with Hadoop and Python

A Billion NYC Taxi Rides in PostreSQL

A Billion NYC Taxi Rides in Elasticsearch

Spark SQL vs. Presto w/ 1 Billion Taxi Rides on Amazon EMR

A Billion Taxi Rides on Amazon EMR Running Presto

Kafka Producer Latency with Large Topic Counts

A Billion Taxi Rides in Hive and Presto

A Billion NYC Taxi and Uber Rides in AWS Redshift

Facebook's Presto, Parquet and AirBNB's Airpal Up and Running

Millions of Songs on AWS Redshift

Hadoop Up and Running

Popular Airline Passenger Routes from 29K Wikipedia Articles

Recommendation engine built using Apache Spark and Python

1
2
3
4
5
6