Disk warning: The file system is full

Issue: Your server file system's disk space is full and you get such email from cPanel:

The file system /dev/sda3, which is mounted at /usr, has reached warn status because it is 93% full.
Server: server.yourserver.com
Primary IP: XXX.XX.XX.XX
Notification Type: diskwarn
Filesystem: /dev/sda3
Mount Point: /usr
Percentage Full: 93%

Fix: One solution of this issue is straightforward but tedious procedure that you can increase the disk space value at the mount point /usr. But, before that one simple fix you can try. You can check whether logs are consuming more space as sometimes logs are not rotating in the server. If so, you can delete/remove the old logs and enable the log rotation to resolve the issue.

In my case, I could see that system logs present under the directory "/usr/share/locale/" were consuming the 12 GB space in the server. I have moved the system log file to different file system having much space available. You can also delete the logs if its not usable by you.

Then, I enabled log rotation for system logs by adding it in the logrotate configuration file.

Added line in /etc/logrotate.d/syslog to enable log rotation:

/usr/share/locale/zun/LC_MESSAGES/temp

/bin/kill -HUP `cat /var/run/rsyslogd.pid 2> /dev/null` 2> /dev/null || true

Then you need to restart rsyslog service. You would see a major decrease in the disk space usage on your file system now.





Comments

  1. Rodrigo4/26/2016 9:47 pm

    Thanks. It solved my problem. The issue I identified was a DOS attack with DNS queries. Each denied DNS query was logged (More than 200/second) by rsyslog, which was causing log files to be very big (13GB)

    ReplyDelete

Post a Comment

Popular posts from this blog

SVN: File remains in conflict

This error occurs when you didn't update the SVN and try to commit changes or, someone has made changes to this file that are conflicting with your changes. There are two ways to handle this situation. Either, you can revert back the changes you want to commit and then, update the SVN and after that make the changes again and commit. The other way is, you need to resolve the conflicted files one by one. You can keep all the conflicted files in a folder and resolved it at once. >> Revert the changes steps: svn revert . -R svn up >> Resolve the conflicted files: svn resolved <file_name>
Read more

HowTo: Enable extended logging for exim

When troubleshooting mail or attempting to discover the source of spam originating from your server, it is often useful to enable extended Exim logging. You can enable extended logging for exim though your shell prompt as well as through WHM interface. I am giving the steps for both ways one by one: 1. Through shell prompt: 1. Open exim.conf 2) Find this: hostlist auth_relay_hosts = * 3) After hostlist auth_relay_hosts = * add the following: log_selector = +address_rewrite +all_parents +arguments +connection_reject +delay_delivery +delivery_size +dnslist_defer +incoming_interface +incoming_port +lost_incoming_connection +queue_run +received_sender +received_recipients +retry_defer +sender_on_delivery +size_reject +skip_delivery +smtp_confirmation +smtp_connection +smtp_protocol_error +smtp_syntax_error +subject +tls_cipher +tls_peerdn 4) The final result should look like this hostlist auth_relay_hosts = * log_selector = +address_rewrite +all_parents +arguments +connecti
Read more

12 tweakings for WHM/cPanel to speed up WordPress

   1. Turning Mailman off – WHM >> Server Configuration >>  Tweak Settings and turning it off    2. Number of minutes between mail server queue runs (default is 60) – Setting it 120    3. Default catch-all/default address behavior for new accounts” to fail    4. Boxtrapper Spam Trap and SpamAssassin Spam Box delivery – off    5. Analog Stats – off    6. Conserve Memory at the expense of using more cpu/diskio – turn on    7. WHM >> Service Configuration >> FTP Server Configuration – Check ‘no’ to ‘allow anonymous logins and ‘no’ to ‘anonymous uploads’    8. WHM >> cPanel >> Manage Plugins – install spamdconf – then go to ‘Setup Spamd Startup Configuration’ – select option 2 ‘Maximum Children” to 2′    9. Run your cron jobs at off peak hours.   10. Install e Accelerator PHP accelerator (Recompile Apache with eAccelerator)   11. Compiling Apache with mod_deflate Gzip Module   12. Running Apache with the thread-based “Worker” MPM
Read more