Disk is full but du disagrees: find deleted files that are still open
df says the filesystem is full, du cannot find the data. Usually a process still holds a file that was already deleted, most often a log.
lsof +L1
+L1 lists open files with a link count below one, which means deleted. The SIZE/OFF column shows how much space each one holds.
Restarting the process frees the space. If a restart is not an option, truncate the file through its descriptor, using the PID and FD from the lsof output:
: > /proc/<pid>/fd/<fd>