Latest in AI and developer tools

Today's trail

updated 29m ago

Last hour Today

Pulse · theneurondaily.com

theneurondaily.com · Nov 1

😺 Publishers sell ads only AI agents see

PLUS: OpenAI firings, a $1,000 mosquito laser and Gemini’s file editor.

Pulse

Top picks this weekarXiv

arXiv

Oct 29

Elucidating the Design Space of LM Data Attribution

Data attribution methods for Language Models (LMs) are typically evaluated using downstream tasks like fact retrieval. However, existing evaluations vary multiple dataset properties simultaneously, making it impossible to isolate exactly why an attribution algorithm fails. To diagnose these failures, we explore the design space of LLM data attribution, with a primary focus on evaluation. We introduce the Controlled Attribution Benchmark (CATT) for fact tracing, in which we fine-tune LLMs on entirely fictitious knowledge, providing unambiguous ground truth for attribution. This synthetic setup allows us to systematically alter one dataset configuration at a time, such as document redundancy and lexical distractors. With this configurable evaluation, we demonstrate that redundancy and distractors consistently degrade attribution performance. Rather than proposing a new estimator, we examine two design choices that are underexplored: the loss used to compute gradients and how per-token attribution scores are aggregated into a document score. We find that the true causal evidence within a training document is highly localized, but standard methods dilute this evidence into noise by…

Top picks

All arXiv Hugging Face GitHub Hacker News

Latest Top this week

arXiv

Oct 28

A Gradient based Adversarial Augmentation Framework for Mitigating Unlearnable Datasets

Unlearnable data methods (ULD) protect public data from unauthorized model training by adding imperceptible perturbations that create a learning shortcut. A deep neural network can exploit the shortcut learning path to minimize training loss without learning generalizable…

arXiv

Oct 28

Data Amount Heterogeneity Improves Performance in Federated Learning for Neuroimaging

Federated Learning (FL) allows for secure analysis of distributed data without data sharing. We and others have successfully applied FL to neuroimaging tasks, such as Alzheimer's disease classification from structural magnetic resonance imaging (MRI). FL trains a deep learning…

arXiv

Oct 28

B2P-Corr: Batch-to-Population Gradient Estimators for Non-Decomposable Correlation Losses

Correlation metrics such as the Pearson Correlation Coefficient (PCC) and Concordance Correlation Coefficient (CCC) are standard regression metrics and learning objectives, but their non-decomposable nature poses a challenge for stochastic optimization. Since these metrics…

arXiv

Oct 28

Replaying the Same Gradients at a Different $\varepsilon$: A Registered Test of the Fixed-Trajectory Account of Adam's $\varepsilon$ for One Rare Row

Adam divides every update by the square root of a running average of squared gradients plus a small constant, epsilon. For an output-embedding row whose token is rare, which we call the probe row, raising epsilon can be read as shrinking that row's steps by arithmetic alone. We…

This week in Multimodal

This week

Get the morning digest

Today's trail

Pulse

Top picks

Today's trail

This week in Multimodal

Most active this week

Rising tools