Forums for the Business Analyst

 
  Modern Analyst Forums  Business and Sy...  Structured Anal...  Best way to graph/draw an ETL data flow
Previous Previous
 
Next Next
New Post 1/17/2014 10:08 AM
User is offline blasto
1 posts
No Ranking


Best way to graph/draw an ETL data flow 
Modified By Chris Adams  on 1/21/2014 12:37:51 PM)

 I am re-posting this stackoverflow question on behalf of a poster -http://stackoverflow.com/questions/21193833/best-way-to-graph-an-etl-data-flow 

I found the following Version 1 in one of our detailed design documents. If I were going to create it, I would have probably displayed it as shown in Version 2

However, I'm thinking that there probably is a more common standard way of showing the flow of data by programs acting on it and that, while I prefer version 2, it probably is unnconventional and non-standard.

In Version 1, programs are shown as boxes. In Version 2, programs are depicted as arrows indicating that they are moving data from one table to another.

Q: What is the better more accepted way? Sequence Diagrams? If Sequence Diagrams were used, I think it wouldn't show the flow of data from one table to the next as well...

Version 1:

 

Version 2:

 

 
New Post 2/28/2014 1:12 PM
User is offline A
1 posts
No Ranking


Re: Best way to graph/draw an ETL data flow 

This has been up for a while, but I'll take a swing at it.  Years ago when I did ETL work (Business Objects, SSIS), we would model our flows before working them up.  Your flows certainly work, but one suggestion I might make is to differentiate the process flow from the data flow.  The goal is to make sure people (especially those who come after you to maintain the job!) can understand and follow the diagram.  I simplified your items and didn't model the EAST process flow, but you'll figure out what you want to do.

 
Previous Previous
 
Next Next
  Modern Analyst Forums  Business and Sy...  Structured Anal...  Best way to graph/draw an ETL data flow

Community Blog - Latest Posts

I have always loved cooking. I learned from my Grandma June and her kitchen was her sanctuary, a small, warm sunlit space filled with jars of spices, stacks of cookbooks, and the comforting smell of something always on the stove or baking in the oven. Grandma June was as great a cook as she was a teacher to me. She never followed a recipe “to...
Now, I know, I don’t know what kind of new intro BPO may require, but at least I can promise you upfront that I have something different to say about Business Process Outsourcing or simply BPO. What is it? This hasn't been a call center job or a sales job as we all think. It is a mammoth profile, and firms are grappling to ge...
Leveraging Blockchain Technology for Enhanced Data Security in Business Operations
In an age where data breaches and cyberattacks are becoming more frequent and sophisticated, businesses are searching for robust solutions to safeguard their data. Blockchain technology has emerged as a promising tool in this quest, offering a way to secure data with unparalleled reliability. Although initially known for powering cryptocurrencies l...

 






 

Copyright 2006-2025 by Modern Analyst Media LLC