Tutorial #1 : What is Reverse Engineering

What is reverse engineering?

Reverse engineering is the process of taking a compiled binary and attempting to recreate (or simply understand) the original way the program works. A programmer initially writes a program, usually in a high-level language such as C++ or Visual Basic (or God forbid, Delphi). Because the computer does not inherently speak these languages, the code that the programmer wrote is assembled into a more machine specific format, one to which a computer does speak. This code is called, originally enough, machine language. This code is not very human friendly,  and often times requires a great deal of brain power to figure out exactly what the programmer had in mind.

What is reverse engineering used for?

Reverse engineering can be applied to many areas of computer science, but here are a couple of generic categories;

  • Making it possible to interface to legacy code (where you do not have the original code source).
  • Breaking copy protection (ie. Impress your friends and save some $$).
  • Studying virii and malware.
  • Evaluating software quality and robustness.
  • Adding functionality to existing software.

The first category is reverse engineering code to interface with existing binaries when the source code is not available. I will not be discussing this much, as it is boring.

The second category (and the biggest) is breaking copy protection. This means disabling time trials, defeating registration, and basically everything else to get commercial software for free. This we will be discussing at great length.

The third category is studying virus and malware code. Reverse engineering is required because not a lot of virus coders out there don’t send instructions on how they wrote the code, what it is supposed to accomplish, and how it will accomplish this (unless they are really dumb). This is a pretty exciting field, but requires a great deal of knowledge. We will not discuss this much until later on.

The fourth category is evaluating software security and vulnerabilities. When creating large (think Windows Operating Systems), reverse engineering is used to make sure that the system does not contain any major vulnerabilities, security flaws, and frankly, to make it as hard as possible to allow crackers to crack the software.

The final category is adding functionality to existing software. Personally, I think this is one of the most fun. Don’t like the graphics used in your web design software? Change them. Want to add a menu item to encrypt your documents in your favorite word processor? Add it. Want to annoy your co-workers to no end by adding derogatory message boxes to Windows calculator? Let’s do it. This we will be getting into later in the series.

What knowledge is required?

As you can probably guess, a great deal of knowledge is necessary to be an effective reverse engineer. Fortunately, a great deal of knowledge is not necessary to ‘begin’ reverse engineering, and that’s where I hope to come in. That being said, to have fun with reversing and to get something out of these tutorials you should at least have a basic understanding of how program flow works (for example, you should know what a basic if…then statement does, what an array is, and have at least seen a hello world program). Secondly, becoming familiar with Assembly Language is highly suggested; You can get thru the tutorials without it, but at some point you will want to become a guru at ASM to really know what you are doing. In addition, a lot of your time will be devoted to learning how to use tools. These tools are invaluable to a reverse engineer, but also require learning each tool’s shortcuts, flaws and idiosyncrasies. Finally, reverse engineering requires a significant amount of experimentation; playing with different packers/protectors/encryption schemes, learning about programs originally written in different programming languages (even Delphi), deciphering anti-reverse engineering tricks…the list goes on and on. At the end of this tutorial I have added a ‘further reading’ section with some suggested sources. If you really want to get good at reversing, I highly suggest you do some further reading.

What kinds of tools are used?

There are many different kinds of tools used in reversing. Many are specific to the types of protection that must be overcome to reverse a binary. There are also several that just make the reverser’s life easier. And then some are what I consider the ‘staple’ items- the ones you use regularly. For the most part, the tools fit into a couple categories:

1. Disassemblers

Disassemblers attempt to take the machine language codes in the binary and display them in a friendlier format. They also extrapolate data such as function calls, passed variables and text strings.  This makes the executable look more like human-readable code as opposed to a bunch of numbers strung together. There are many disassemblers out there, some of them specializing in certain things (such as binaries written in Delphi). Mostly it comes down to the one your most comfortable with. I invariably find myself working with IDA (there is a free version available http://www.hex-rays.com/), as well as a couple of lesser known ones that help in specific cases.

2. Debuggers

Debuggers are the bread and butter for reverse engineers. They first analyze the binary, much like a disassembler  Debuggers then allow the reverser to step through the code, running one line at a time and investigating the results. This is invaluable to discover how a program works. Finally, some debuggers allow certain instructions in the code to be changed and then run again with these changes in place. Examples of debuggers are Windbg and Ollydbg. I almost solely use Ollydbg (http://www.ollydbg.de/), unless debugging kernel mode binaries, but we’ll get to that later.

3. Hex editors

Hex editors allow you to view the actual bytes in a binary, and change them. They also provide searching for specific bytes, saving sections of a binary to disk, and much more. There are many free hex editors out there, and most of them are fine. We won’t be using them a great deal in these tutorials, but sometimes they are invaluable.

4. PE and resource viewers/editors

Every binary designed to run on a windows machine (and Linux for that matter) has a very specific section of data at the beginning of it that tells the operating system how to set up and initialize the program. It tells the OS how much memory it will require, what support DLLs the program needs to borrow code from, information about dialog boxes and such. This is called the Portable Executable, and all programs designed to run on windows needs to have one.

In the world of reverse engineering, this structure of bytes becomes very important, as it gives the reverser needed information about the binary. Eventually, you will want to (or need to) change this information, either to make the program do something different than what it was initially for, or to change the program BACK into something it originally was (like before a protector made the code really hard to understand). There are a plethora of PE viewers and editors out there. I use CFF Explorer (http://www.ntcore.com/exsuite.php) and LordPE (http://www.woodmann.com/collaborative/tools/index.php/LordPE), but you can feel free to use whichever you’re comfortable with.

Most files also have resource sections. These include graphics, dialog items, menu items, icons and text strings. Sometimes you can have fun just by looking at (and altering ;)   ) the resource sections. I will show you an example at the end of this tutorial.

5. System Monitoring tools

When reversing programs, it is sometimes important (and when studying virii and malware, of the utmost importance) to see what changes an application makes to the system; are there registry keys created or queried? are there .ini files created? are separate processes created, perhaps to thwart reverse engineering of the application? Examples of system monitoring tools are procmon, regshot, and process hacker. We will discuss these later in the tutorial.

6. Miscellaneous tools and information

There are tools we will pick up along the way, such as scripts, unpackers, packer identifiers etc. Also in this category is some sort of reference to the Windows API. This API is huge, and at times, complicated. It is extremely helpful in reverse engineering to know exactly what called functions are doing.

7. Beer.

So Let’s Get On With It, Already!

Even though we are starting with very little knowledge, I did want to give you at least a little taste of reversing in this first tutorial. I have included a resource viewer/edit in this tutorial (see the Files folder) called XN Resource Editor. It is freeware. Basically, this program allows you to see the resource section in an exe file, as well as modify these resources. I have found that you can have an awful lot of fun with these- they allow you to change the menus, icons, graphics, dialogs, you name it, in programs. Let’s try one ourselves…

First, run XN. Click on the load icon on top, and click over to Windows\System32\ and load calc.exe (you’re default windows location may vary.) You should see a bunch of folders available:

You can see that there are folders for Bitmaps (any graphics the program displays), Menu (the top menu items), Dialog (dialog boxes, along with text and buttons), String Table, IconGroup etc. You should feel free to mess around with these things. Just make sure to save it as a different file (you would hate to have to re-install windows just for the dumb calculator). In particular, try this:

Click on the plus next to Menu. You will then see a folder with a number as a name. This is the ID that windows will use to access this resource in the program. Open this folder as well. You should now see an icon for “English (United States)” or something like this. If you click on this you will see a diagram of what the menu will look like (you can even click around- it works just like a real menu).

Now, click on the menu option “Scientific”. The Caption field should change to “&Scientific”. The ampersand is there to tell you what the ‘Hot-Key’ is, in this case ‘S’. If instead we wanted the ‘e’ to be the hot-key, it would look like this “Sci&entific”. So already, don’t like the built in hot-key’s for calc? Just change them!! But let’s do something different.In the Caption field, replace the &Scientific with “&Nerd”. This will now change the menu option to “Nerd” and use the hot-key ‘N’ (I looked through the other options in the menu to make user no other menu option used ‘N’ as a hot-key).  You should do this for all of the menu entries. Now, go up to File (in XN Resource) and choose “Save As…” Save your new version of calc to a different name (and preferably a different location) and then run it.

Of course, you don’t have to stop there. In order to drive my coworkers nuts, I changed all of the numbers in their calcs.

As you can see, the sky’s the limit.

Till next time…


ps. Thanks go out to Lena151, for showing me the way, A.S.L., snaker, Qwerton and Jibz for showing me the secrets, and Olly , Yoda-mmi, uCF and Colin Wilson for giving me the tools.

Further Reading

1. Assembly Language. Assembly Language For Intel Based Computers

is the de-facto book on it . You can also check out some web sites that offer a tremendous amount of downloads , instruction, sample code, and help

. Another good resource is “The Art of Assembly”. I will be including this in one of the next tutorials, but you can also download it here.

2. The PE file structure. One of the best resources is from Microsoft themselves: “An in-depth look into the Win32 Portable Executable File Format

“. Another good document (with lots of pretty pictures) is “PE File Structure

“.   It is a downloadable PDF.

3. Windows Operating System Internals. The de-facto book is “Microsoft Windows Internals

” by Mark Russinovich. It’s about as exciting as women’s baseball, but it is THE resource.

4. Cracking tutorials. http://www.Tuts4You.com is the place to be.

Original link: http://thelegendofrandom.com/blog/archives/7

Download : http://thelegendofrandom.com/files/tuts/R4ndom_tutorial_1.zip


  1. Vinh says:

    Chào a kienmanowar. Trong một số tài liệu của a có đề cập đến chữ “nhảy”, em chưa hiểu từ này, mong anh reply sớm. Thank a

  2. kienmanowar says:

    @Vinh: Cụ thể em đang đề cập đến tài liệu nào :), có thông tin thì anh mới giải thích được.


  3. Vinh says:

    Em không ngờ người bận rộn như anh mà reply em nhanh như thế, em rất vui.
    Em chỉ mới tìm hiểu về Ollydbg và Assembly nên cũng đang vọc vạch tí tài liệu của anh.
    Em đề cập ở phần MANUAL UNPACK ACTIVEMARK 5.31 nhé:
    — Bước 2 anh bảo nhảy đến địa chỉ 005D4000, em cho nhảy thì đến bước 3 luôn, và làm sao anh xác định được địa chỉ “005D4000”, anh không hề nói rõ.
    — Và một bước sau đó có đoạn anh ghi “Set 1 Hardware, on Execution tại 00719593”, em mò mẫm mãi không hiểu chỗ này, chẳng có lệnh nào trong Ollydbg ghi như vậy cả, em thấy giống chỉ là “Breakpoint->Hardware,on execution.

  4. kienmanowar says:


    Cài tutor em đề cập đã rất lâu rồi nên anh cũng ko thể nhớ được, cơ bản tutor cũng đó không phải anh viết mà là WhyNotBar viết. Để giải thích cho em hiểu cặn kẽ thì cũng khó, cơ bản như sau
    – Tác giả dùng PEiD để phát hiện xem packer là gì, sau đó dùng plugin để tìm thử xem OEP (điểm bắt đầu thực hiện code của chương trình) ở đâu. Địa chỉ tìm được là 00719593. Lấy địa chỉ này trừ đi địa chỉ ImagBase (thường là 00400000): 00719593 – 00400000 = 00319593. Từ giá trị có được để đoán xem địa chỉ này thuộc section nào. Trong bài có nói nó thuộc section .text. Nhảy đến section text ở đây là tác giả thực hiện Patch chương trình để nhảy tới Section .text là 005D4000. Do tác giả đã cho run chương trình và attach vào OllyDBG rồi mới thực hiện Patch, nên khi đến Section .text sẽ cho phép tìm ra các IAT mà chương trình sử dụng.
    – Set 1 Hardware, on Execution tại 00719593: Em có thể nhấn chuột phải vào địa chỉ đó rồi chọn để Set BP hoặc em có thể gõ lệnh HE 00719593 (với điều kiện em có commandbar plugin).

    PS: Mới tìm hiểu em không nên đọc tài liệu liên quan đến unpack mà nên tập trung vào ASM, PE File format, luyên crackme v..v..


  5. Vinh says:

    Cảm ơn anh rất nhiều, có lẽ anh nói đúng, học phần ngọn không phải là một cách hay, mình nên bắt đầu từ gốc trước.
    Em đang là SV năm 1 thôi ạ, em với kinh qua C và C++, em nắm khá là vững 2 món này. Anh có thể tổng hợp giùm em một số tài liệu (có link từng cái luôn thì quá tốt ạ) mình cần đọc và nắm được trước khi thực hiện loạt tut của anh được không ạ. Em vừa search tài liệu: “PE File Format” anh có nói, tìm trên hva và blog anh, đều báo lỗi, tự nhiên thấy buồn quá. Tài liệu Tiếng Việt về RCE chắc chỉ mỗi anh viết, ít người viết quá, tìm ra hầu hết là Tiếng Anh (chưa biết gì mà đọc Tiếng Anh là toi ngay).

  6. kienmanowar says:

    Thời anh và ngay cả bây giờ cũng chỉ có tài liệu tiếng Anh thôi :). Tài liệu tiếng Việt cũng là tự viết hoặc dịch lại từ tài liệu tiếng Anh. Vậy nên cách tốt nhất không gì khác là phải biết tiếng Anh.
    – Tài liệu PE file format thì ở bài này: https://kienmanowar.wordpress.com/2009/03/07/pe-tutorials/. Link thì anh cập nhật lại để em download: http://www31.zippyshare.com/v/39283932/file.html.
    – Về OllyDBG em có thể tìm hiểu thông qua các bài viết của anh cũng như của nhiểu tác giả khác.
    – Tìm hiểu về ASM thì ngoài các kiến thức về các lệnh cơ bản ra em có thể thảm kháo bài viết của các tác giả sau:
    1. http://arteam.accessroot.com/arteam/site/download.php?view.173 (Win32 Assembler Coding for Crackers )
    2. http://win32assembly.programminghorizon.com/tutorials.html (Win32 Assembly Tutorials)
    – Tài liệu của lena151: https://kienmanowar.wordpress.com/2013/07/13/lena151s-tutorials/
    – v..v…


  7. Vinh says:

    – Cảm ơn anh nhiều. Đây là lĩnh vực khó và đòi hỏi kiên trì, không biết em sẽ đi đến đâu nữa. Để thời gian tới em thử kinh qua tài liệu Tiếng Anh xem thử nó như thế nào, hi vọng là đủ kiên nhẫn:)
    – Anh xem lại giúp em tài liệu của anh lena151 với ạ, em tải về không được, nó còn báo có virus nữa.

  8. kienmanowar says:

    Nếu không đủ kiên nhẫn thì anh nghĩ em nên từ bỏ việc theo đuổi nghành CNTT nói chung cũng như RCE nói riêng. Bên cạnh các kiến thức trên thì kĩ năng mềm cũng là điều bắt buộc cần phải có. Ví dụ: với từ khóa gợi ý từ ai đó thì việc đầu tiên mình phải google.
    Tut của lena151 em cứ download bình thường, chính thống thì download tại tuts4you, cảnh báo virus thì bỏ qua đi. Nếu sợ em có thể thực hiện trên máy ảo.


  9. Vinh says:

    Cảm ơn anh vì tất cả.

  10. kienmanowar says:

    Không có gì em :). Đơn giản vì kiến thức là vô hạn 😛 và quan trọng là mình có đam mê hay không 😀


  11. Vu Duong says:

    Anh kienmanowar ơi! cho em hỏi xíu nhé! Tut về OllyDbg của anh có thực hành được trên windows 8.1 64 bit được không? mọi tut khác em thực hành đều ok nhưng đến tut 9 thì em làm nó không giống như trong tut!

  12. kienmanowar says:

    Hi em,

    Khuyến nghị là nên thực hành trên máy ảo sử dụng Windows XP nhé. Trên các máy cài đặt Win7/Win8 thì anh không rõ 🙂


  13. Vu Duong says:

    dạ! e cảm ơn anh nhiều! e cũng thực hành trên máy ảo XP thì thấy bình thường! Một lần nữa cảm ơn anh vì bộ tut quá tuyệt vời! hi hi!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s