This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
FAQ
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
New Article

How to check if cassandra is corrupted on Managed node?

bharat_pitta
Dynatrace Guide
Dynatrace Guide

on ‎03 Jan 2023 02:43 AM

Question

How to check if Cassandra is corrupted on the Managed node?

Answer

  • Open the Cassandra log file, usually located in :/opt/dynatrace-managed/cassandra/log/cassandra.log
  • Check if there are any corrupted messages in logs like those below
ERROR [CompactionExecutor:544] 2019-02-19 13:26:55,920 CassandraDaemon.java:231 - Exception in thread Thread[CompactionExecutor:544,1,main]
org.apache.cassandra.io.sstable.CorruptSSTableException: Corrupted: /metricsDisk/cassandra/ruxitdb/Ts2Final01Min-967699b0f56011e7ad0403861a5cb15c/ruxitdb-Ts2Final01Min-ka-356332-Data.db
ERROR [CompactionExecutor:566] 2019-02-19 13:30:20,207 CassandraDaemon.java:231 - Exception in thread Thread[CompactionExecutor:566,1,main]
org.apache.cassandra.io.sstable.CorruptSSTableException: Corrupted: /metricsDisk/cassandra/ruxitdb/Ts2Volatile01Min-960efe40f56011e7ad0403861a5cb15c/ruxitdb-Ts2Volatile01Min-ka-65282-Data.db
ERROR [CompactionExecutor:564] 2019-02-19 14:05:25,489 CassandraDaemon.java:231 - Exception in thread Thread[CompactionExecutor:564,1,main]
org.apache.cassandra.io.sstable.CorruptSSTableException: Corrupted: /metricsDisk/cassandra/ruxitdb/Ts2Final01Min-967699b0f56011e7ad0403861a5cb15c/ruxitdb-Ts2Final01Min-ka-345130-Data.db
  • Corrupted files where the filename contains Ts are not critical, since only time-series data is involved (like the sample from above).
  • Corrupted files where the filename contains Me are critical since configuration data is involved. An example of such file name would be following
/var/opt/dynatrace-managed/cassandra/ruxitdb/Me2Data-0763a420293b11e8946add4c85a31f71/ruxitdb-Me2Data-tmp-ka-202976-Data.db

In such cases, Cassandra must be repaired!

Note timezone in Cassandra logs is the local time of the host Cassandra is running at

Labels:
Version history
Last update:
‎03 Jan 2023 02:43 AM
Updated by:
Dynatrace Guide
Comments
ChadTurner
DynaMight Legend
DynaMight Legend
‎10 Jan 2023 01:25 PM

Thank you @bharat_pitta for this troubleshooting tip/trick 🙂 

0 Kudos
andre_vdveen
DynaMight Champion
DynaMight Champion
‎07 Jun 2023 04:48 PM

Hi @bharat_pitta 

I assume the log file is debug.log and not cassandra.log? I only see system.log, debug.log and launch.log in the default /opt/dynatrace-managed/cassandra/log/ directory 🙂

It looks like debug.log is the one that would contain the info you mentioned.