Upper and lower memory capacity bounds of transformers for next-token prediction
Madden, L; Fox, C; Thrampoulidis, C. Upper and lower memory capacity bounds of transformers for next-token prediction. arXiv preprint arXiv:2405.13718, 2024
CV
Education
- Ph.D in Version Control Theory, GitHub University, 2018 (expected)
- M.S. in Jekyll, GitHub University, 2014
- B.S. in GitHub, GitHub University, 2012
Work experience
- Spring 2024: Academic Pages Collaborator
- Github University
- Duties includes: Updates and improvements to template
- Supervisor: The Users
- Fall 2015: Research Assistant
- Github University
- Duties included: Merging pull requests
- Supervisor: Professor Hub
- Summer 2015: Research Assistant
- Github University
- Duties included: Tagging issues
- Supervisor: Professor Git
Skills
- Skill 1
- Skill 2
- Sub-skill 2.1
- Sub-skill 2.2
- Sub-skill 2.3
- Skill 3
Publications
Study of the Edge of Stability in Deep Learning
Fox, C. A Study of the Edge of Stability in Deep Learning. Master's Thesis, 2023
Deep Learning of Immune Cell Differentiation
Maslova, A; Ramirez, R; Ma, K; Schmutz, H; Wang, C; Fox, C; Ng, B; Benoist, C; Mostafavi, S; The Immunological Genome Project. Deep Learning of Immune Cell Differentiation. Proceedings of the National Academy of Sciences of the United States of America, 2020
Talks
Conference Proceeding talk 3 on Relevant Topic in Your Field
Conference proceedings talk at Testing Institute of America 2014 Annual Conference, Los Angeles, CA
Talk 2 on Relevant Topic in Your Field
Talk at London School of Testing, London, UK
Tutorial 1 on Relevant Topic in Your Field
Tutorial at UC-Berkeley Institute for Testing Science, Berkeley CA, USA
Talk 1 on Relevant Topic in Your Field
Talk at UC San Francisco, Department of Testing, San Francisco, California
Teaching
Service and leadership
- Currently signed in to 43 different slack teams