INNORIX in Practice / Server & Cloud-to-Cloud Transfer
When one team's day ends, another is waiting for that day's data.
Follow 24 hours of data that starts in Seoul, passes through the working days of Europe and the US, and comes back to Seoul.
As Seoul wraps up its working day, Frankfurt is in the middle of its morning. A few hours later, New York starts a new day.
Each team works different hours and uses different servers and clouds.
Yet the data Seoul finishes today is needed for Europe's work, and what Europe produces is used in turn by the US. What the US creates during its day is needed by Asia the next morning.
One team finishing its day doesn't mean the company's work is done.
How do teams in different time zones work as one company?
ONE COMPANY, DIFFERENT WORKING HOURS
SEOUL
09:00
Working hours
FRANKFURT
01:00
Off hours
NEW YORK
19:00
Off hours
A new day in Seoul
Today's business data
Available
Source
Azure Blob Storage, Amazon S3
Target
Seoul Data Center
Seoul close
Europe morning
US morning
Europe close
US close
Seoul morning
A story built on how teams in different time zones at a fictional global company hand data to one another.
The company runs businesses in Asia, Europe and North America.
Seoul runs Asia business operations and manages business data. Frankfurt runs European operations and regional data analysis, and New York analyzes the global business and prepares the next day’s operating plan.
Each team has long used the IT infrastructure that suits its own work.
Seoul uses its own data center, and Europe uses Microsoft Azure. The US runs its work mainly on Amazon Web Services.
THE COMPANY
The company’s global work environment
ASIA
Seoul
Asia business operations
Environment
On-premisesWindows ServerLinux Server
Working hours
09:00–18:00UTC+9
EUROPE
Frankfurt
European operations and analytics
Environment
Microsoft AzureAzure Blob StorageLinux Compute
Working hours
09:00–18:00UTC+1
NORTH AMERICA
New York
Global analytics and operations planning
Environment
Amazon Web ServicesAmazon S3Amazon EC2
Working hours
09:00–18:00UTC−5
Working hours of the three teams
00:0004:0008:0012:0016:0020:0024:00
Seoul
09:00–18:00
Frankfurt
Europe hours
New York
US hours
Seoul time (KST); bars show local working hours
Regular working hours in Seoul and New York do not overlap.
To exchange files with the US team, Seoul staff sometimes have to get in touch outside their own hours or wait until the other side starts work.
If it were just one or two files a day, that might not matter much.
But at this company, large amounts of data move between teams every day.
Daily data handoffs between teams
Team creating the data
Team using the data
Main data
Asia
Europe
Asia business operations data
Asia
US
Regional sales and operations records
Europe
US
Regional analysis results
Europe
Asia
European operations results
US
Asia
Global analysis results and operating plans
When one team’s data becomes available to another shapes the whole company’s schedule.
Today, as always, each team at the company is doing its own work.
Live contextNow
Monday, One company, three regions16:00 KST
Seoul 16:00
Working
Frankfurt 08:00
Before work
New York 02:00
Off hours
Current data
asia_daily_dataset, preparing
Team using the data
Europe analytics team
Data needed by
12:00 CET
THE END OF A WORKING DAY, 16:00
Seoul is wrapping up its working day.
It is 4 p.m. in Seoul.
The Asia business operations team is organizing the business data created across its sites today.
Sales records, service usage data, regional operations status and records from business systems all go into today’s dataset.
The analytics team in Europe plans to use this data from noon local time.
SEOUL DATA CENTER, DAILY BUSINESS DATA
asia_daily_dataset
SEOUL
16:00
FRANKFURT
08:00
Dataset
Size
Status
transactions/
680 GB
Ready
service_logs/
520 GB
Ready
regional_operations/
420 GB
Preparing
business_reports/
180 GB
Preparing
Expected size1.8 TB
EUROPE ANALYTICS TEAM
Asia regional data analysis
Data needed at
12:00 CET
Current status
Waiting for Asia dataset
Seoul is still at work, but in Europe a new working day is about to begin.
Staff on the two teams don’t contact each other every day to check whether the data is ready.
A scheduled transfer job is set up to run as soon as today’s business data is complete.
Live contextNow
Monday, Seoul wraps up16:00 KST
Seoul 16:00
Working
Frankfurt 08:00
Before work
New York 02:00
Off hours
Current data
asia_daily_dataset, preparing
Team using the data
Europe analytics team
Data needed by
12:00 CET
SEOUL FINISHES THE DAY, 18:00
Staff in Seoul get ready to go home.
At 5:58 p.m., today’s Asia business data is complete.
Staff in Seoul have finished their work for the day.
Two minutes later, a transfer starts sending today’s business data from the Seoul data center to Azure Blob Storage in Europe.
INNORIX STUDIO, FLOWS
Asia daily business data
Source
Seoul Data Center
Windows Server
/business/daily/
1.8 TB
Target
Azure Blob Storage
Europe
/analytics/asia/input/
Direct transfer
Execution
Daily
Scheduled time
18:00 KST
Target local time
10:00 CET
Dataset condition
Daily dataset ready
On interruption
Resume when available
18:00:00, SCHEDULED EXECUTION
Running
Asia daily business data
Scheduled execution started
Staff in Seoul don’t need to stay in the office waiting for the data to go out.
Staff in Europe don’t need to ask Seoul to send today’s data either.
Data completed in Seoul’s business systems goes straight to the cloud in Europe on a set schedule.
Live contextNow
Monday, Data leaves Seoul18:00 KST
Seoul 18:00
Closing
Frankfurt 10:00
Morning work
New York 04:00
Before work
Current data
Asia business data, 1.8 TB sending
Team using the data
Europe analytics team
Data needed by
12:00 CET
THE SAME DATA, ANOTHER WORKING DAY, 19:36
Data made during Seoul’s day is put to work in Europe’s today.
Live contextNow
Monday, Data reaches Europe19:36 KST
Seoul 19:36
Day ended
Frankfurt 11:36
Data received
New York 05:36
Before work
Current data
Asia business data, 1.8 TB received
Team using the data
Europe analytics team
Data needed by
12:00 CET
SEOUL 19:36, FRANKFURT 11:36
SEOUL
19:36
The working day is over.
FRANKFURT
11:36
Asia data has arrived.
Asia daily business data
Completed
1.8 TB
Sent from Seoul
18:00 KST
Received in Europe
11:36 CET
INNORIX in Practice
The settingSetting
Staff in Europe use the data made in Seoul.
It is 11:36 a.m. in Frankfurt.
Today’s Asia business data has arrived in Azure Blob Storage in Europe.
The European analytics team checks the data in the cloud environment it always uses.
They don’t log in to the Seoul data center separately, or download Asia’s data to their own computers and upload it to the cloud again.
AZURE BLOB STORAGE, EUROPE
analytics / asia / input / daily
Name
Size
Received
transactions/
680 GB
11:14
service_logs/
520 GB
11:29
regional_operations/
420 GB
11:34
business_reports/
180 GB
11:36
Total received1.8 TB
Data ready
11:36
Analysis starts
12:00
From noon, the European analytics team starts analyzing Asia’s business operations data.
The data was made in Seoul, but it is put to use in Europe.
Staff in Seoul have already gone home, and staff in Europe carry on with their day.
A NEW DATASET IN EUROPE, 21:20
New data is created in Europe.
It is 1:20 p.m. in Frankfurt.
The European analytics team has produced new analysis results from Asia’s business data and the reference data it manages in Europe.
This data is not used only in Europe.
The global analytics team in the US also needs it from this morning.
In New York it is still 7:20 a.m.
There are about 1 hour and 40 minutes before the US team starts work.
FRANKFURT, ANALYTICS OUTPUT
New data created in Europe
File name
Size
regional_analysis.parquet
186 GB
business_indicators.parquet
42 GB
market_reference.csv
11.8 GB
analysis_summary.json
0.2 GB
New analysis results240 GB
INNORIX STUDIO, RUN DETAILS
Running
European analysis results
Source
Azure Blob Storage
Europe
Target
Amazon S3
United States
Execution condition
Analysis output ready
Execution started
13:20 CET
When the analysis results are complete, a transfer job to deliver them runs.
The data goes directly from Azure Blob Storage in Europe to Amazon S3 in the US.
There is no need to send it back to a server in Seoul or route it through a separate central store.
Each team creates data on the infrastructure it already uses and delivers it to the team that needs it.
Live contextNow
Monday, Europe produces results21:20 KST
Seoul 21:20
Day ended
Frankfurt 13:20
Results produced
New York 07:20
Before work
Current data
240 GB of results sending
Team using the data
US analytics team
Data needed by
09:00 EST
BEFORE THE NEXT TEAM ARRIVES, 22:02
The data arrived before the US team got to work.
It is 8:02 a.m. in New York.
The 240 GB of analysis results created in Europe has arrived in Amazon S3 in the US.
The US team hasn’t really started work yet, but the data it needs is already in place.
EUROPE TO NORTH AMERICA
Before the US workday starts
07:20Transfer starts08:02Received09:00US work starts
Data transfer, 42 min
58 min until work starts
New York local time (EST)
Analysis data delivered
240 GB
US work starts
09:00
If the US team had asked Europe for the results after arriving at work, the real analysis could only have started once the data came in.
Today the US team can start work without waiting for the data to arrive.
Live contextNow
Monday, Data reaches the US22:02 KST
Seoul 22:02
Day ended
Frankfurt 14:02
Afternoon work
New York 08:02
Before work
Current data
240 GB of results received
Team using the data
US analytics team
Data needed by
09:00 EST
ANOTHER TEAM STARTS WORK, 23:30
Seoul’s day is done; in the US, a new one begins.
Live contextNow
Monday, US workday begins23:30 KST
Seoul 23:30
Day ended
Frankfurt 15:30
Afternoon work
New York 09:30
Global analysis
Current data
Global analysis input, 2.74 TB
Team using the data
US operations team
Data needed by
18:00 EST
SEOUL 23:30, FRANKFURT 15:30, NEW YORK 09:30
SEOUL
23:30
Day ended
Today’s business data delivered
FRANKFURT
15:30
Afternoon work
Regional data analysis and processing
NEW YORK
09:30
Morning work
Global data analysis begins
People working at different hoursdo the work of the same company.
INNORIX in Practice
The settingSetting
From 9:30 a.m., the US global analytics team is analyzing today’s regional business status.
Amazon S3 already holds business data sent directly from Asia and analysis results created in Europe. The separate transfer from Asia to the US runs independently of Europe’s delivery.
The US team analyzes the global business using its own data together with the data it has received.
AMAZON S3, GLOBAL ANALYTICS INPUT
Data used in the US today
Dataset
Origin
Size
Status
asia_operations/
Seoul
840 GB
Available
europe_analysis/
Frankfurt
240 GB
Available
us_operations/
New York
1.2 TB
Available
global_reference/
New York
460 GB
Available
Total input for analysis2.74 TB
The analytics team’s job is not collecting and passing on files.
It is using data that is already in place to analyze the business and build the next operating plan.
EUROPE FINISHES THE DAY, 02:00
Staff in Europe have finished their day too.
It is 6 p.m. in Frankfurt.
In Seoul it is 2 a.m. the next day, and in the US it is noon.
The final business data created in Europe today has been put together.
Completed at 5:20 p.m., Europe’s business data has started going to two different destinations: the US and Seoul.
The US uses it for this afternoon’s work, and Seoul uses it for the next morning’s.
EUROPE, END-OF-DAY DATA
Data from one team, used for different purposes
NEW YORK
Completed
For US afternoon work
European operations status
380 GB
Target
Amazon S3
Received
11:58 EST
SEOUL
Running
For Asia’s next day
European results and operations reference data
460 GB
Target
Seoul Data Center
Expected
03:12 KST
Not all of Europe’s business data goes to every other team.
The US global operations team and the Asia operations team in Seoul need different data.
The company runs each transfer job with its own data and destination.
Even after Europe’s day ends, the transfer to Seoul keeps running.
Live contextNow
Tuesday, Europe ends its day02:00 KST
Seoul 02:00
Off hours
Frankfurt 18:00
Closing
New York 12:00
Working
Current data
Europe business data, 380 GB and 460 GB
Team using the data
Asia operations team
Data needed by
09:00 KST
WHILE ANOTHER TEAM IS ASLEEP, 05:40
Global analysis results were produced while Seoul slept.
It is 3:40 p.m. in New York.
The US global analytics team has completed new analysis results using the data received from Asia and Europe today and the US business data.
They include global operations status, key regional metrics and reference data that Asia needs for the next day’s operations.
The total size is 620 GB.
Staff in Seoul will use this data when they arrive at work in a few hours.
NEW YORK, GLOBAL ANALYTICS OUTPUT
Global daily results
File name
Size
global_business_results.parquet
420 GB
regional_operating_plan.parquet
160 GB
business_reference/
40 GB
Total data620 GB
INNORIX STUDIO, AUTOMATED EXECUTION
Running
US global results to Asia
Source
Amazon S3, US
Target
Seoul Linux Server
New York 16:20Seoul 06:20
Transferred 279 GB / 620 GB
Data created
Sending to Seoul
Received
Once the analysis results are complete in the US, a transfer starts delivering the files to Seoul’s business server.
No one in Seoul has to request the data or wait at a business system to receive the files.
At 7:10 a.m., the delivery is complete.
Seoul’s regular workday has not started yet.
Live contextNow
Tuesday, Global results produced05:40 KST
Seoul 05:40
Before work
Frankfurt 21:40
Day ended
New York 15:40
Results produced
Current data
Global results, 620 GB sending
Team using the data
Asia operations team
Data needed by
09:00 KST
THE LAST WORKING HOURS IN AMERICA, 08:00
The US creates its last business data of the day.
It is 6 p.m. in New York.
The US team is wrapping up its day too.
Additional operations records and final business results created since the afternoon are sent to Seoul.
But there is no need to resend the 620 GB of analysis results already delivered.
Only the 90 GB of final data created for the day’s last tasks needs to go.
US DAILY DATA, TRANSFER OPERATIONS
Today’s data going from the US to Seoul
Dataset
Size
Status
Global analysis results
620 GB
Completed
Final business records
64 GB
Running
Next-day operation plan
26 GB
Running
08:00 KST, 18:00 EST
Final US business data
Already delivered
620 GB
Already received
Sending now
90 GB
Newly created data
While the US team wraps up its day, staff in Seoul are getting ready for work.
At 8:24 a.m., the last data needed this morning has been delivered.
Live contextNow
Tuesday, US wraps up08:00 KST
Seoul 08:00
Before work
Frankfurt 00:00
Off hours
New York 18:00
Closing
Current data
Final US business data, 90 GB sending
Team using the data
Asia operations team
Data needed by
09:00 KST
EVERYTHING IS READY IN SEOUL, 08:24
Seoul’s business server now holds data it didn’t have yesterday.
Since Seoul staff left at 6 p.m. the day before, a great deal of work has happened across the company.
Europe ran its analysis on Asia’s data, and the US analyzed the global business using data from every region.
The results from each team were delivered for Seoul’s next working day.
SEOUL DATA CENTER, INCOMING DATA
Data that arrived after staff went home
Received
Dataset
Origin
Size
03:12
European business results
Frankfurt
460 GB
07:10
Global analysis results
New York
620 GB
08:24
Final US business data
New York
90 GB
From Europe
460 GB
From the US
710 GB
Europe
US
Total received1.17 TB
All data was ready 36 minutes before Seoul’s workday began.
The 1.17 TB that arrived after Seoul staff went home will be used in today’s work.
No one needs to contact the other teams one by one to find out what they did overnight.
INNORIX transfer history shows when each piece of data was created, when it was delivered and which server it was stored on.
Live contextNow
Tuesday, Next-day data ready08:24 KST
Seoul 08:24
Before work
Frankfurt 00:24
Off hours
New York 18:24
Day ended
Current data
All received data, 1.17 TB
Team using the data
Asia operations team
Data needed by
09:00 KST
A NEW WORKING DAY, 09:00
Staff in Seoul arrive and start the day’s work.
Live contextNow
Tuesday, A new day in Seoul09:00 KST
Seoul 09:00
Work starts
Frankfurt 01:00
Off hours
New York 19:00
Day ended
Current data
Today's business data, Available
Team using the data
Asia operations team
Data needed by
09:00 KST
TUESDAY, SEOUL
09:00
A new day begins in Seoul.
Data made in Seoul yesterday and in Europe and the US today is where the new day’s work begins.
TODAY'S BUSINESS DATA
Business dataAvailable
European operations resultsAvailable
Global analysis resultsAvailable
Today’s operating planAvailable
INNORIX in Practice
The settingSetting
The data they finished yesterday was used in Europe and the US.
And the new data those teams produced is being used in Seoul’s work this morning.
Even after staff went home, the company’s data operations kept going.
It is 9 a.m., just like yesterday, but the data in their hands is different.
THE LAST 24 HOURS, 09:00
What happened at the company over the last 24 hours?
Seoul has completed one work cycle, from 9 a.m. yesterday to 9 a.m. today.
Europe and the US each went through their own day as well.
Put the three teams’ working hours on one timeline, and you can see how the company’s data is being used.
GLOBAL BUSINESS TIMELINE
Three teams’ work and data movement
09:0015:0021:0003:0009:00
Seoul
Local hours
Frankfurt
Local hours
New York
Local hours
Asia / EU
Asia / US
EU / US analysis
EU / US ops
EU / Seoul
US / Seoul results
US / Seoul final
Local working hours
Key file transfers
All times in Seoul time, from Monday 09:00 to the start of Seoul’s new workday at 09:00 Tuesday
Teams
3 regions
Key data transfers
7
Total data sent
4.43 TB
Key data movements in the last 24 hours
Transfer
Size
Received (local time)
Asia business data, Europe
1.8 TB
11:36 CET
Asia business data, US
840 GB
05:49 EST
Europe analysis results, US
240 GB
08:02 EST
Europe business data, US
380 GB
11:58 EST
Europe business data, Seoul
460 GB
03:12 KST
US global analysis results, Seoul
620 GB
07:10 KST
Final US business data, Seoul
90 GB
08:24 KST
Total
4.43 TB
The company’s staff did not all work at the same time.
Each team worked in a different time zone, on different infrastructure.
Yet the data each team needed was made by one team, passed to another, and used for the company’s next piece of work.
Live contextNow
Tuesday, The last 24 hours09:00 KST
Seoul 09:00
Work starts
Frankfurt 01:00
Off hours
New York 19:00
Day ended
Current data
4.43 TB sent in the last 24 hours
Team using the data
Asia operations team
Data needed by
09:00 KST
ONE COMPANY, A CONTINUOUS WORKING DAY
A company’s dayhas more than one end.
SEOUL
18:00
The working day ends.
FRANKFURT
18:00
Another working day ends.
NEW YORK
18:00
New business data is ready.
People work at different hours.Teams use different infrastructure.
Where one team’s day ends,another team’s work begins.
INNORIX carries the company’s data in between.
THE TECHNOLOGY BEHIND THIS STORY
Server & Cloud-to-Cloud Transfer
Deliver data created on different servers and clouds to the working environment of the team that needs it. Run file transfers around each team's schedule and the time its data is created.