Searching For Anomalies with Foundation Models

This is a joint seminar with Institute for Physics of Intelligence (iπ), UTokyo

Anomaly detection relaxes the assumptions of how new physics should look and extends the reach of what we can discover. However, interpreting the data and estimating backgrounds remains a challenge. In this new work, we investigate anomalous events selected by the OmniLearned Foundation model across different model sizes, performing a full analysis using CMS Open Data. Surprisingly, models of different sizes, trained on the same data with the same loss functions, select entirely different collisions. In particular, the large OmniLearned model (500M parameters) selects events that are not well described by our background model.