Forums for the Business Analyst

 
  Modern Analyst Forums  Business and Sy...  Structured Anal...  Best way to graph/draw an ETL data flow
Previous Previous
 
Next Next
New Post 1/17/2014 12:08 PM
User is offline blasto
1 posts
No Ranking


Best way to graph/draw an ETL data flow 
Modified By Chris Adams  on 1/21/2014 12:37:51 PM)

 I am re-posting this stackoverflow question on behalf of a poster -http://stackoverflow.com/questions/21193833/best-way-to-graph-an-etl-data-flow 

I found the following Version 1 in one of our detailed design documents. If I were going to create it, I would have probably displayed it as shown in Version 2

However, I'm thinking that there probably is a more common standard way of showing the flow of data by programs acting on it and that, while I prefer version 2, it probably is unnconventional and non-standard.

In Version 1, programs are shown as boxes. In Version 2, programs are depicted as arrows indicating that they are moving data from one table to another.

Q: What is the better more accepted way? Sequence Diagrams? If Sequence Diagrams were used, I think it wouldn't show the flow of data from one table to the next as well...

Version 1:

 

Version 2:

 

 
New Post 2/28/2014 3:12 PM
User is offline A
1 posts
No Ranking


Re: Best way to graph/draw an ETL data flow 

This has been up for a while, but I'll take a swing at it.  Years ago when I did ETL work (Business Objects, SSIS), we would model our flows before working them up.  Your flows certainly work, but one suggestion I might make is to differentiate the process flow from the data flow.  The goal is to make sure people (especially those who come after you to maintain the job!) can understand and follow the diagram.  I simplified your items and didn't model the EAST process flow, but you'll figure out what you want to do.

 
Previous Previous
 
Next Next
  Modern Analyst Forums  Business and Sy...  Structured Anal...  Best way to graph/draw an ETL data flow

Community Blog - Latest Posts

Leveraging Blockchain Technology for Enhanced Data Security in Business Operations
In an age where data breaches and cyberattacks are becoming more frequent and sophisticated, businesses are searching for robust solutions to safeguard their data. Blockchain technology has emerged as a promising tool in this quest, offering a way to secure data with unparalleled reliability. Although initially known for powering cryptocurrencies l...
Building software products that solve actual customer concerns and generate business success is not an easy fit. Product executives battle strong competition, tight timelines, and high expectations, all while seeking to offer value. While success gives the opportunity to showcase approaches and frameworks, the reality is that building excellent pro...
Business Impact Analysis(BIA): Assessing the Potential Impact of a Cybersecurity Incident on Business Operations
In today’s highly interconnected society, businesses depend on technology even more than before. While offering opportunities for innovation and creativity, businesses are exposed to various cybersecurity threats that can disrupt operations, damage reputation, and result in substantial financial losses. It is crucial to carry out a comprehens...

 



Upcoming Live Webinars




 

Copyright 2006-2025 by Modern Analyst Media LLC