Page 1 of 1

Brainbase Labs \ AI Researcher Interview Questions

Below are 2 of the interview questions we ask in our AI Researcher interviews at Brainbase Labs. These have so far stumped researchers from OpenAI, Deepmind, HRT, JS, Scale, Uber and more. If you can answer both of them sufficiently well you will be given an expedited interview and likely an offer to join us.

Information

Your name

*

Your email

*

Questions

1. Convince yourself that you can re-parametrize attention as a nearest-neighbor lookup in a learned embedding space. What kernel is this lookup using? Is this the optimal kernel for all use cases?

*

2. For a transformer are the tokens for "1" and "2" the same distance from each other as tokens for "53" and "54"? If not, when would this be a problem? How would you fix it?

*