Untied Squared ReLU
A transformer experiment comparing two ReLU branches with squared ReLU.
I work on machine learning and software.
A transformer experiment comparing two ReLU branches with squared ReLU.
An assistant for exploring statistics from UN and public data sources.
A tool for searching U.S. trademarks and reviewing possible conflicts.
A small app for comparing nanoGPT training logs.
I run machine learning experiments and build applications with TypeScript, React, Python, SQL, and language models.