Forums for the Business Analyst

 
  Modern Analyst Forums  Business and Sy...  Structured Anal...  Best way to graph/draw an ETL data flow
Previous Previous
 
Next Next
New Post 1/17/2014 11:08 AM
User is offline blasto
1 posts
No Ranking


Best way to graph/draw an ETL data flow 
Modified By Chris Adams  on 1/21/2014 12:37:51 PM)

 I am re-posting this stackoverflow question on behalf of a poster -http://stackoverflow.com/questions/21193833/best-way-to-graph-an-etl-data-flow 

I found the following Version 1 in one of our detailed design documents. If I were going to create it, I would have probably displayed it as shown in Version 2

However, I'm thinking that there probably is a more common standard way of showing the flow of data by programs acting on it and that, while I prefer version 2, it probably is unnconventional and non-standard.

In Version 1, programs are shown as boxes. In Version 2, programs are depicted as arrows indicating that they are moving data from one table to another.

Q: What is the better more accepted way? Sequence Diagrams? If Sequence Diagrams were used, I think it wouldn't show the flow of data from one table to the next as well...

Version 1:

 

Version 2:

 

 
New Post 2/28/2014 2:12 PM
User is offline A
1 posts
No Ranking


Re: Best way to graph/draw an ETL data flow 

This has been up for a while, but I'll take a swing at it.  Years ago when I did ETL work (Business Objects, SSIS), we would model our flows before working them up.  Your flows certainly work, but one suggestion I might make is to differentiate the process flow from the data flow.  The goal is to make sure people (especially those who come after you to maintain the job!) can understand and follow the diagram.  I simplified your items and didn't model the EAST process flow, but you'll figure out what you want to do.

 
Previous Previous
 
Next Next
  Modern Analyst Forums  Business and Sy...  Structured Anal...  Best way to graph/draw an ETL data flow

Community Blog - Latest Posts

There are big differences between data exploration versus data presentation. And you need to be aware of these differences as you're creating data stories and data presentations. Let’s start by defining our terms: Data exploration means the deep-dive analysis of data in search of new insights. Data presentation means...
Is Agile a reason to avoid documentation? I bet this question shows up again and again while working with product requirements. On one side, we have got long specifications, complicated diagrams, mystical technical design, too many prototypes and pretty obvious for engineers user guides (do we really need so much?). On the other side, can we actual...
The cloud-native application development has helped enterprises all around the globe reduce time-to-market, enhance performance, and develop agility and flexibility. Several enterprises are achieving these results by migrating their systems or traditional monolithic applications to the cloud. But to gain from the real benefits of cloud technology, ...

 






 

Copyright 2006-2022 by Modern Analyst Media LLC