headline »

6 Tips for Data Visualization from a Floral Designer

March 26, 2015 – 7:35 am |

You never know where you will find inspiration. This past weekend I attended the NC Museum of Art Art in Bloom Festival.  The idea is that local floral designers use a museum masterpiece to draw inspiration for a floral design. [More: WRAL video about event] It was incredible to see how someone could paint with flowers. Turns out there are many Art in Bloom events like …

Read the full story »
BI Tools

Tips and tricks for building information maps, OLAP cubes, reports, and dashboards

BI Admin

Learn your way around a SAS BI installation.

Visual Analytics

Learn your way around the SAS Visual Analytics tool

Coding & Data

Extract, transform, and load your data into the SAS BI toolset

Stored Processes

Create and design stored processes like a rock star

Coding & Data, Data Visualization »

SAS Coding: Use Flowcharts to Learn Inherited SAS Code

March 2, 2015 – 8:00 am | 5 Comments

library_of_congress_00439rI’m a visual person – I always need a picture. As a consultant, many times I’m given a thumb drive full of code and asked to make modifications.  When you are on a project with me, you’ll grow weary of hearing me say “Can you draw it?” Something magical happens for me when I see a flow or see an idea.

One of the most confusing projects I ever worked on required completely re-writing a job that had more than 100,000 lines of code and had grown out of control over a 5 year period.  I’ve come to see this situation as an industry hazard. For SAS Global Forum 2011 I wrote a paper called Plate of Spaghetti Anyone? about learning someone’s else code.  I created a flowchart for the code before I started but it was impossible to read. It was so impossible, we finally started taking requirements from the code and tossed  most of the code in the Unix trash can.

For the remake,  I created many flowcharts with my good friend MS Visio. It helped the managers understand what was going to happen. The person who came behind me most likely thought the process was confusing but received more documentation than I did about what the code was designed to do and how the flow worked. It was a good learning experience for me as well. Now the first thing I do is start creating flowcharts when I’m handed code or even requirements documents.

Really when you think about it, flowcharts are just another example of data visualization. You are creating a drawing from words to show how the data flows through the program and quickly communicate the data transformation.

Here’s what I learned from drawing and reading a gazillion flowcharts for SAS programs.

It’s Not Always 1:1 Relationship with Code

It’s useless to map SAS programs in a flowchart step by step. Unless the program has macro code in it, any logic statements are usually within a data step or perhaps a PROC SQL statement. When I have tried to do it in the past, I realized that the diagram usually looked like the following one and rarely explained anything other than it took a lot of steps to get where it was going.

sas program flow chart

Click for a larger view

The above example really could be any one of 10,000 SAS programs.  All it really shows is the actual steps the programmer used but it doesn’t really help you understand why the dataset was created.  You really just know it was taken from a data source, changed in some way, sorted and given to an information map. You could have guessed that much before you looked at the flowchart!  In this example, the logic is all occurring in the data step.  This is why programs that map the steps are useless for understanding the code.

Now consider what happens when we actually plot the purpose or the logic of the same program.  We can see where the 3 steps are used but now we understand that we are determining if the customer orders are on time by business unit. It outputs the results to a table ready for an information map – this is a simple example because an information map could have complete these steps. [You can create info maps from code – did you know that?]

flowchart_02

 

Flowcharts that Make You Groan Like Broken-down Machinery

Here’s an example of a flowchart that  breaks all the rules of communicating a process quickly and with ease.  I did find this on the Web but it’s not important who did it or what it’s really about – you can learn from the example.

flowchart_04a

Where does it start and when does it end?

Use indicators that show where the process starts and ends. Users need to understand what causes the process to start and when it ends. Remember the person reading the chart doesn’t have any idea how it works so they don’t know where the user or data enters the process. I start at the upper left corner for no reason other than that’s how most people read text on a page.

It’s helpful if you use the same shapes everyone else does – like a process is a box, a decision is a diamond – you get the idea. Check Wikipedia for more flowcharting basics.

Check your logic!

Study this flow chart – notice that the same steps are there twice and it’s based on if the child comes to the appointment.  Why not have the person review the records and then determine if the child is present?  It would only have to be there once.   If the child shows up 95% of the time – do the chart from that perspective.  Think of your SAS program the same way, what is the main logic path. You want to show how you handle exceptions but typically your program is about handling what is right. When the chart wraps around itself the main path is not clear.  This is a smaller chart so there are probably less consequences, but complicated logic could make this really confusing.  Try to avoid having your logic wrap around the page – use more pages instead.  Remember you are trying to communicate clearly not save a PDF page.

Be consistent!

Have your decision points always go the same way. Its confusing when the Yes is sometimes going down and sometimes going to the side.  Change the question to make the logic flow the same way.  In this chart, only one Yes actually goes down so the reader can be tricked.  Many flowchart professionals say the “Yes” or “True” always goes down – I say just be consistent.

Flowcharts You Love Like Your Momma’s Cookin’

Ok – it’s my flowchart – of course we love it! It’s the flow for my macro that check the batch log and sends an email based on what happened.  Here’s how I might have done the flowchart for the code. Notice that you never see a SAS word like data step, proc sql, and so on.

flowchart_03

Click for larger image

 

Notice that the logic inside Step A is a little more complicated so I expanded that into a second chart.  This is an example of how to handle a larger process when you have multiple paths that need explanation.

<

Never miss a post!

Get the latest BI Notes post in your Inbox when a new post is released! Click here for free subscription. You email address is kept private and you can unsubscribe anytime. Go ahead ... join us!

Wanted! SAS Rustlers Unite at #SASGF15 #TweetUp

February 22, 2015 – 12:23 pm | 9 Comments

In April 2015, SAS users travel across the world to the SAS Global Forum in Dallas, Texas – yes the legendary Wild West.  If you are arriving early at the conference (maybe for a workshop or to take a certification exam) – then you’re invited to a special and exclusive event.
 

#SASGF15 Tweeps Unite!
This is an informal, pre-conference gathering for tweeps on Saturday 25th April at 8 PM at the conference hotel. …

Administration: What Demons Are at Your Command?

October 28, 2014 – 12:10 pm | 4 Comments
Charleston Cemetary

In the US, Halloween is celebrated by young children dressing up as ghouls, ghosts, and demons of other sorts.  I think the original idea of costumes was to be the scarier demon, which means if I look like a bad ass demon then maybe the truly bad ass demons will run away in fright. This made me wonder What do I truly find scary? Turns out it is not graveyards, …

Which population method should I use for my SAS prompt?

April 13, 2014 – 9:31 am | Comments Off
sas dynamic prompts

During our Debugging and Tuning SAS Stored Processes session, an attendee asked “Why would I choose a dynamic versus static prompt for my stored process?” It was a good question because the choice might make a difference in the stored process speed. Here’s some guidelines.
What are the different Population Methods?
Stored Processes take user input through a prompt to provide custom output.  Consider the following three …

Building a SAS Stored Process Log

February 24, 2014 – 7:14 am | 9 Comments
Stored Process Log

As a SAS stored process developer, a question sometimes pokes its way into my head: “Are people using the stored processes I write?”  In fact, really I have four questions:

What stored processes are being used? 
Who is using them?
When are they being used?
How are they using them?

I realized what I’ve been missing.  I need a SAS stored process log.
If It Works for a Macro…
As a macro programmer …

#SASGF14: You’re Invited to a TweetUp!

February 10, 2014 – 6:50 pm | 2 Comments
2014 sas global forum tweetup

Hello, G’Day, Hola, Hej, Bonjour, Hallo! In March 2014, SAS users travel across the world to the SAS Global Forum in Washington, DC.  If you are arriving early at the conference – then you’re invited to a special and exclusive event.

Tweeps Unite!
This is an informal, pre-conference gathering for tweeps on Saturday 22th March at 8 PM at the conference hotel. Yes, a #SASGF14 #TweetUp  for people to meet their followers face-to-face …