GithubHelp home page GithubHelp logo

xquintana / dumpreport Goto Github PK

View Code? Open in Web Editor NEW
46.0 1.0 14.0 558 KB

Console application that creates an HTML report from a Windows user-mode dump file, using WinDBG or CDB debuggers. Although it's been mainly designed for crash dump analysis of Windows applications developed in C++, it can also be used to read hang dumps or .Net dumps.

License: MIT License

C# 100.00%
windbg windbg-scripts dump-analysis crash-reporting crash-dump analysis windows dump

dumpreport's Introduction

DumpReport

DumpReport is a console application that creates a report as an HTML file from a Windows user-mode dump, using WinDBG or CDB debuggers.
It shows the call stack of all threads, the exception details (if any), the modules loaded in the process as well as the environment details of the target machine.
Since it's a command-line application, it can also be called by a script so, for example, the report can be sent by e-mail or published on the intranet.
Although it's been mainly designed to analyze crash dumps of Windows applications developed in C++ (managed and/or unmanaged), it can also be used to read hang dumps or .Net dumps.

How it works

Basically, the application sends scripts to the debugger and reads the output files in order to extract the information and write it in an HTML file.

The Report

The report has the following appearance:

Report

It begins with the time and date the report was generated.
Then follow details about the dump file (creation time, path and bitness), the process and the environment of the target machine:

  • CLR Version: Version of the loaded .Net Framework (only for dumps with managed code).
  • Command Line: Shows the full command line of the process being debugged, including the arguments.
  • Process Id: Id that the process was using.
  • Computer Name: Name of the target machine.
  • User Name: The Windows username that was running the process.
  • Operating System: Windows version of the target machine.
  • Environment Variables: The values of the environment variables at the target machine may help figuring out the cause of the crash.
  • Loaded Modules: A detailed list of the loaded modules (address range, timestamp, path, version, etc). It also indicates whether the corresponding PDB file could be loaded during debugging.

Since the lists of the environment variables and loaded modules are usually long, these sections show collapsed by default, but they can be unfolded by clicking on the '+' button:

Environment Variables Loaded Modules

In case an exception has been found, it is reported in the section 'Exception Information' showing the faulting thread.
Thread details include: thread id (hex and decimal value), instruction pointer (RIP/EIP for 64/32 bits, resp.) and the call stack.
Each frame of the stack indicates the module, function and, if available, the source file and line number.

The last section shows all threads grouped by call stack.
They appear collapsed by default. Click on the '+' button to display a particular call stack, or use the buttons 'Expand All' and 'Collapse All'.

Optionally, frames with source files under a specific root folder can be shown emphasized (in bold, by default).
This can be useful to easily distinguish the frames that belong to our own application.

Command-line arguments

Execute DumpReport without arguments to display the help.
Arguments are passed in the form '/ARGUMENT value'

Usage:

DumpReport /DUMPFILE dump_file [/PDBFOLDER pdb_folder] [/REPORTFILE html_file] [/SHOWREPORT value] [/QUIET value]

/DUMPFILE:   Full path of the dump file to read.
/PDBFOLDER:  (optional) Folder containing the corresponding PDBs.
             If not specified, PDB files are expected to be in the dump's folder.
/REPORTFILE: (optional) Full path of the HTML report file. It can also be specified in the config file.
             By default, a file named 'DumpReport.html' is created in the execution folder.
/SHOWREPORT: (optional) If the value is 1, the report automatically opens in the default browser.
/QUIET:      (optional) If 1, the console window does not show progress messages.

Example:

DumpReport /DUMPFILE "C:\dump\crash.dmp" /PDBFOLDER "C:\dump" /SHOWREPORT 1

If the dump file is the only argument, the call can be simplified as follows:

DumpReport "C:\dump\crash.dmp"

In this case, it is also possible to drag and drop the dump directly onto the executable.

Any value containing spaces must be enclosed in double quotes ("").

Providing the PDB files is not necessary but allows to show the source files and line numbers in the call stack traces.

The location of the debuggers to use and other options must be specified in the XML configuration file, as explained in the next section.

Errors are displayed in the console window and also added to the report, provided that at least the report file could be created.

Please note that the debugger may take several minutes to process the dump, especially if PDB files are to be downloaded.

Configuration file

The settings are stored in a configuration file named DumpReportCfg.xml, which must be located together with the executable.
This file can be created by typing:

DumpReport /CONFIG CREATE

It must be edited in order to specify the location of the debuggers. The rest of the parameters can be left as default.
Some parameters like the PDB folder or the output file name can be overriden by the command line.

Xml nodes

The nodes and attributes in the configuration file are:

  • Config: Main node.
  • Debugger: Supported debuggers are WinDbg.exe and CDB.exe.
    • exe64: Full path of the 64-bit version debugger.
    • exe32: Full path of the 32-bit version debugger.
    • timeout: Maximum number of minutes to wait for the debugger to finish.
  • Pdb:
    • folder: Folder containing the PDB files. If not specified, PDB files are expected to be in the same location as the dump file.
  • Style:
    • file: Full path of a custom CSS file to use.
  • Report:
    • file: Full path of the report file to be created.
    • show: If set to 1, the report will be displayed automatically in the default browser.
  • Log:
    • folder: Folder where the debugger log files will be created. If not specified, log files are created in the same location as the dump file. The name of the log files is the name of the dump file appended with '.log'
    • clean: Indicates whether the log files should be deleted after being processed.
  • SymbolCache:
    • folder: Folder to use as symbol cache. If not specified, the debugger will use its default symbol cache (e.g, "C:\ProgramData\dbg")
  • SourceCodeRoot:
    • folder: The report will emphasize the frames whose source file's path contains this folder.

At least one of the attributes exe64 or exe32 must not be empty. If it is expected to process dumps of 32 bits on 64-bit computers, it is recommended to set both.

This information can be displayed in the console by typing:

DumpReport /CONFIG HELP

Quick set-up

These are the minimum steps to generate a report from a crash dump of your application:

  • Create a folder and copy there the DMP file, the PDB file(s) of your application, and the DumpReport executable.
  • Open a console window in that folder and type: DumpReport /CONFIG CREATE
  • Open the newly created file DumpReportCfg.xml in a text editor.
  • In case of a 64-bit dump, fill in the field exe64 with the full path of your WinDBG or CDB 64-bit executable.
  • In case of a 32-bit dump, fill in the field exe32 with the full path of your WinDBG or CDB 32-bit executable.
  • Save the XML and close the editor.
  • To generate the report, type DumpReport your_dump_file.dmp or drag'n'drop the DMP file onto DumpReport.exe.
  • After a while (it could take up to a few minutes depending on the dump) an HTML report will be created in the same folder (it should also open in your default browser automatically).

From here on, you can customize the report generation as described in this document.

About dump bitness

Dumps of 32-bit processes running on 64-bit computers should be captured using tools able to generate 32-bit dumps, such as ProcDump, ADPlus, DebugDiag,.. or the 32-bit Task Manager located in C:\Windows\SysWOW64.
Otherwise, the resulting report may be incomplete or inaccurate.

If both 32-bit and 64-bit debuggers are set, the application chooses the one to use according to the dump bitness.
If only the 64-bit debugger is set, 32-bit dumps are processed by automatically switching the debugger's processor mode to 32-bit.

Exception detection

The application reads the exception record stored in the dump. Depending on the tool used to generate the dump, this exception record may not be useful. For example, Task Manager stores a 'Break Instruction' exception. In this case, the application tries to retrieve a more meaningful exception record by launching the debugger again with a new script. This script is based on specific data from the call stacks which may not always be available.
If the proper exception record cannot be found out, the faulting thread is deduced by searching for specific functions in the call stacks, such as 'KiUserExceptionDispatcher' or 'RtlDispatchException'.

Code structure

This application has been developed in C# (Visual Studio 2017).
The main modules are:

  • Config. Retrieves and validates the parameters from the configuration file and the command-line interface.
  • Program. It's the entry point of the application. It launches the debugger, which creates a log file divided into sections to be parsed.
  • Parser. A Parser object parses a section of the debugger's log file and stores the extracted data. The base class implements a method to collect the lines to parse, and declares an abstract method to parse them. Each derived class knows how to parse a specific section in the log. For example, the ModuleParser is in charge of parsing the section where the loaded modules are listed.
  • Report. Encapsulates methods to write HTML code from the information stored in the Parser objects.
  • LogManager. Reads the debugger's output file and distributes the lines of each section among the corresponding Parser objects. Once all lines are assigned, it makes the Parser objects do their job. Finally, it passes the extracted information to the Report object in order to fill in the report.
  • Resources. Contains resources such as the help text to show in the console window, JavaScript and CSS code used by the report, as well as the debugger scripts.

Main debugger script

This section shows the main debugger script, used to retrieve information about the target machine environment, threads and loaded modules. It can be found in the file Resources.cs, among other auxiliary scripts.

.logopen /u "{LOG_FILE}"
||
{PROGRESS_STEP}
.lines -e
.foreach (module {lm1m} ) { .if ($sicmp(""${module}"",""wow64"") == 0) { .load soswow64; .echo WOW64 found; .effmach x86;  } }
.effmach
.time
.cordll -ve -u -l
.chain
.echo > !eeversion
{PROGRESS_STEP}
!eeversion
.echo >>> TARGET INFO
!envvar COMPUTERNAME
!envvar USERNAME
.echo PROCESS_ID:
|.
.echo TARGET:
vertarget
!peb
.echo >>> MANAGED THREADS
{PROGRESS_STEP}
!Threads
.echo >>> MANAGED STACKS
.block { ~* e !clrstack }
.echo >>> EXCEPTION INFO
{PROGRESS_STEP}
.exr -1
.echo EXCEPTION CONTEXT RECORD:
.ecxr
.echo EXCEPTION CALL STACK:
~#
kv n
.echo >>> HEAP
{PROGRESS_STEP}
!heap
.echo >>> INSTRUCTION POINTERS
{PROGRESS_STEP}
.block { ~* e ? {INSTRUCT_PTR} }
.echo >>> THREAD STACKS
{PROGRESS_STEP}
~* kv n
.echo >>> LOADED MODULES
{PROGRESS_STEP}
lmov
{PROGRESS_STEP}
.echo >>> END OF LOG
.logclose

Notes:

  • {LOG_FILE} is replaced with the debugger's log file name.
  • {PROGRESS_STEP} is replaced with a command that allows to keep track of the progress, or removed if the progress messages are disabled.
  • {INSTRUCT_PTR} is replaced with the Instruction Pointer register's name (RIP or EIP, depending on the dump bitness).
  • The effective machine is changed to x86 if the module wow64.dll is found. This only applies when debugging a 64-bit dump of a 32-bit process.
  • 'echo' commands are used to define sections and simplify the parsing of the log.

How to extend the report

You can show additional information in the report by adding commands to the main script. These are the main steps:

  • In file Resources.cs, insert a new section in the main debugger script using the echo command. Section names must begin with ">>> ". For example:
    .echo >>> MY SECTION

  • Next, add the debugger commands that produce the information you need.

  • In file Parser.cs, create a new Parser class that inherits from Parser (e.g: class MyParser : Parser).

  • Add to the new class the necessary member variables that will hold the extracted data.

  • Implement the Parse() method by iterating through the lines of the new section in the log file and using regular expressions to extract the data and store it in the member variables. You can take other Parse() methods as an example.

  • In the LogManager class, declare and instantiate a member variable of the new class and declare a const string with the name of the new section. For example:

    const string MY_SECTION = ">>> MY SECTION";
    MyParser myParser = new MyParser();

  • In the method LogManager.MapParsers(), add a new entry in the map that associates Parser objects with section names (m_parsers). See example below. It is important to add this line following the section order.

    m_parsers.Add(MY_SECTION, myParser);

  • Add a method to the Report class (e.g: Report.WriteMySection(...)) with the data to show as input argument. There you must format the input data as HTML and write it to the report using the stream member variable.

  • Finally, in the LogManager.WriteReport() method, call report.WriteSectionTitle() with the title of the new section and report.WriteMySection() passing the data to display.

Custom report style

The style of the report is defined by a default CSS code embedded into the HTML file.
However, it is possible to embed a custom CSS file instead.
This file must be specified in the file attribute of the node <Style> in the configuration file.

The styles that can be modified are:

  • body: Default style for the HTML document.
  • h1: Title header.
  • h2: Section header.
  • button: Default button style.
  • toggle-button: Style of the expand/collapse button (+/-)
  • toggle-header: Auxiliary table that contains a toggle button and a label that describes an area that can be expanded or collapsed.
  • report-table: Style for tables showing thread stacks, loaded modules or environment variables. By default, a striped style is used.
  • sourcecode-frame: Stack frame associated to the source code root (bolded by default).
  • thread-id: Style for the thread identifier and instruction pointer.

This information can be displayed in the console by typing:

DumpReport /STYLE HELP

Run the following command to create a sample CSS file (style.css):

DumpReport /STYLE CREATE

Requirements

  • Windows 7 or above.
  • .Net Framework v4.5 or above.
  • WinDBG or CDB debugger. It can be installed by selecting 'Debugging Tools for Windows' from the Windows SDK installer dialog.

Tested with debugger versions 10.0.16299.91, 10.0.17134.12 and 10.0.22000.194.

Optional debugger extensions

When debugging 32-bit managed dumps captured in a x64 host, it is recommended to install the soswow64 extension from here.
Copy soswow64.dll into the winxp subfolder of the x86 version of the debugger.
NOTE: This extension seems to have stopped working properly at least from version 10.0.19041.685.

Download

The executable can be downloaded from here.

License

This project is licensed under the MIT License - see the LICENSE file for details

History

1.3

  • The debugger version is displayed in the console.
  • The dump creation time was not properly converted to UTC+0.
  • Fixed some errors while parsing call stacks with newer debugger versions.
  • The application returns 1 on failure and 0 on success.

1.2

  • Fixed a bug when the quiet mode was enabled.

1.1

  • Added progress messages.
  • The timestamps of the loaded modules are also expressed in UTC time.

1.0

  • First version

dumpreport's People

Contributors

painh avatar wizzardmaker avatar xquintana avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.