Manish Parashar: Good morning, everybody, welcome to the first sighs distinguished lecture of 2022 it's my absolute pleasure to introduce our speaker today, Dr Julio ibarra.
Manish Parashar: he's a research professor in the knight foundation school of computer science in the college of engineering and computing and is the assistant Vice President in technology augmented research in the division of it at Florida international university.
Manish Parashar: Dr bar is responsible for furthering the mission of the Center for Internet augmented research and assessment of Sierra.
Manish Parashar: To contribute to the pace and the quality of research at fsu to the applications of advanced cyber infrastructure.
Manish Parashar: under his leadership and stewardship nsf is funded the empath international exchange point and america's light paths am like network in its portfolio of international science infrastructure.
Manish Parashar: Both these projects have been tremendously impactful a empath provides international research and education network connectors.
Manish Parashar: with access to US production experimental backbone networks such as Internet to and, yes, net to facilitate international science, research and education collaborations.
Manish Parashar: Am light is an international network backbone and interconnect the research and education networks in the US with peer networks in Latin America, the Caribbean and Africa.
Manish Parashar: Dr Bowers research interests include software defined networks autonomic network architectures network automation and network control and management so without delaying any further, let me turn it over to Dr bar over to Julio.
Julio Ibarra: diminish, thank you for having me and for the opportunity to present at the nsf distinguished lecture series.
Julio Ibarra: My.
Julio Ibarra: The topic of my talk is the family expressive protect network and.
Julio Ibarra: me expressing protect operates as an international production network and platform for network innovation supporting research and education, and as you see here my introductory slide here, I am the principal investigator for the vm light project.
Julio Ibarra: This is the outline of my talk and my objective is for you to gain an understanding of first what am I, is a production, research and education network.
Julio Ibarra: How we're using emulate resources for network, innovation and how am I responding to challenges from science applications i'll start by giving an introduction to the home of emulated fit you followed by some history about Emily.
Julio Ibarra: So Emma is managed from the Center for Internet augmented research and assessment Sierra in the division of it edify you as as minish mentioned.
Julio Ibarra: Sierra is an interdisciplinary Center it supports and conducts research and education through the application of advanced cyber infrastructure.
Julio Ibarra: Sierra consists of a small group of network engineers software developers and a support team to the right of my slide you can see a recent photo of the Sierra team.
Julio Ibarra: Some of the goals of Sierra art to bridge technology gaps between researchers and it practitioners, so one of my roles is to leverage the expertise in the division of it and the College of engineering and computing to better inform our community about em light and projects at Sierra.
Julio Ibarra: Another goal is to reinvigorate scholarship for undergraduate and graduate students engaging students to participate in projects is one of our core activities at Sierra in 2021 19 students participated in projects at Sierra.
Julio Ibarra: Finally, Sierra aligns with fit goals as a public research university contributing to its research scholarship and technology development.
Julio Ibarra: Some history about Emily Emily it was established in 2020 2010 under an iron see award.
Julio Ibarra: From the office of cyber of advanced cyber infrastructure and like consists of a 20 year build out that includes connections to research and education in Latin America.
Julio Ibarra: fit you lead the effort to link the US research and education networks to Latin America, in collaboration with Internet to global crossing and industry collaborators this collaboration resulted in the creation of an path as an international exchange point in Miami it back in 2000.
Julio Ibarra: Emily built upon the accomplishments of the project we call read laila it's an iron see award that was made to fit you and scenic that proceeded emulate also part of the rnc portfolio Emily was one of the first to use optical spectrum, combined with least capacity on it's backbone.
Julio Ibarra: Long term leases on optical spectrum was a key accomplishment we have these leases until 2032.
Julio Ibarra: They provide value to us science facilities in Chile, South America can potentially Antarctica.
Julio Ibarra: Emily was one of the first to deploy and operate its production network with software defined networking since 2014 SDN enable dynamic service provisioning and has significantly increased operations efficiency.
Julio Ibarra: We also establish a committee, called the South American astronomy coordination committee or the sack sack provides a venue for the exchange of information and coordination between the US astronomy projects in Chile and the am late network operators sack is now in its 11th year.
Julio Ibarra: We had a sack meeting in 2021 we hosted 61 participants each year that number appears to be growing with more interest in the work with astronomy in in South America and also branching out to Africa.
Julio Ibarra: The 2021 sack report is available at the M like project website.
Julio Ibarra: Some key factors that have enabled and like success.
Julio Ibarra: First, support from nsf the office of advanced cyber infrastructure and the rnc program the rnc program has been critical to the success of Emily.
Julio Ibarra: Support for you, if I you has encouraged our participation and nsf programs, such as the rnc.
Julio Ibarra: And our partnerships with research and education network scan Latin America, the Caribbean and Africa have been key to emulate success they have been built upon layers of trust, over time, for example, sharing operations resources resources such as network bandwidth.
Julio Ibarra: Colocation facilities network and compute resources.
Julio Ibarra: The sharing of human resources, I can emphatically say that emulates accomplishments rest upon its people.
Julio Ibarra: collaboration and cooperation amongst some of the most talented network engineers in the global r&d Community participate in the am like project.
Julio Ibarra: Nuts let's let's take a look at MIT as it is today.
Julio Ibarra: Am like operates as an international production, research and education network.
Julio Ibarra: This is the production network operating today the network map shows and light footprint in the US, Latin America and Africa.
Julio Ibarra: The light ring showing green consists of multiple 200 gigabit segments from boca raton to San Paulo boca raton to fortaleza some pollo to fortaleza boca raton to Cape Town and Sunday, I go to Porto Alegre.
Julio Ibarra: The ring.
Julio Ibarra: The protect ring in red carries primary traffic, as well as serves to protect the express network it consists of the following city pairs Miami fortaleza fortaleza some pollo.
Julio Ibarra: Some pollo Santiago Santiago Panama Panama some point one and someone back to Miami that's the red ring you see here.
Julio Ibarra: It aggregate we have 600 gigabits of capacity.
Julio Ibarra: To the US, we also have a president ECHO presence it's open exchange points in Miami fortaleza some pollo Santiago and Cape Town.
Julio Ibarra: This map here.
Julio Ibarra: represents what am late envisions for the next five years in the current iron see award the goal of this plan network infrastructure is to increase capacity and resiliency.
Julio Ibarra: it's a very busy slide on busy diagram showing the complexity of the network.
Julio Ibarra: My reasons for showing it our first, the number of network segments and facilities operated by am like and its partners, you see there, and all of these solid and dash and dotted lines and let operate segments shown in three colors you can see here in this legend above.
Julio Ibarra: All the other colors are network segments operated by am like partners, this is one of the successes of the rnc program is attracting participation among all the networks in many different countries to exchange and link to the US for supportive research and education.
Julio Ibarra: And the logos on the right identify all of our partners in Emily.
Julio Ibarra: The ellipses as you see here represent data centers for submarine cable landings.
Julio Ibarra: The clouds represent external collaborators, such as Internet to an s nets lines represent network connections between facilities, the solid lines here.
Julio Ibarra: The solid lines represent active connections as well dashed lines represent connections and dotted lines represent goals for the next four years, the blue rectangles represents cities, for example, San Paulo fortaleza Brazil Santiago, Chile.
Julio Ibarra: And the light green rectangle above represents the empath open exchange port facilities in Florida and Georgia.
Julio Ibarra: Planned increases in bandwidth capacity are MIT is adding 200 gigabits of capacity from some pollo the boca raton it's shown in this Green dashed line here.
Julio Ibarra: That scheduled to be completed operating by 2023 and rb is adding 200 gigabits of capacity from fortaleza to Apollo that's this this blue.
Julio Ibarra: dashed line that you see here, so all of this is increasing the capacity of within the region on the light network with our partners, contributing to to the the capacity so by 2023 Am I scheduled to have 800 gigabits about true aggregate capacity between the US and and South America.
Julio Ibarra: Up to this point i've presented the MIT network infrastructure it's links aggregation points and bandwidth capacity, as it is today, and the enhancements plan to increase capacity and resilience.
Julio Ibarra: Next, I will introduce embed network telemetry referred to as I empty.
Julio Ibarra: it's a technology that is currently in production service, but we also consider it one of the most significant innovations.
Julio Ibarra: So i'll start by describing the challenge and reasons for it.
Julio Ibarra: So isolating and detecting faults of data transfers in long home that works with high latency such as as the light network is complex and time consuming.
Julio Ibarra: it's both a technical challenge and a social challenge because isolating and detective detecting false is constrained by lack of visibility.
Julio Ibarra: And oftentimes it's not just the technology that's needed but also the support and collaboration with peer networks which.
Julio Ibarra: Sometimes, is not not easy when they have policies to not expose all the necessary data from their networks as a result, detecting what events cause performance degradation often result in questions that have incomplete answers.
Julio Ibarra: For example, we don't really know where there is a packet loss and why it's happening or which path the packet took or how much time a packet queued at each switch effectively there's a lack of tools that provide enough visibility to the tech faults.
Julio Ibarra: The slide shows network monitoring pain points when attempting to detect network printing events common network management tools fail to detect network transit events tools we've used for years i've just too limited.
Julio Ibarra: Network transit events are short term and sporadic degradation in network performance they're caused by conditions that can lead to failures, over time, for example, attenuation on an optical channel, they often go undetected such as micro bursts, so what causes a microburst.
Julio Ibarra: A data transfer that so short and time in the time domain, the tools cannot detect it.
Julio Ibarra: It can be malicious or not, but it's it's not easy to detect the time scale can be as low as 100 milliseconds.
Julio Ibarra: To hundreds of microseconds.
Julio Ibarra: They can have a high impact, causing packet loss and long haul network latency such as emulate.
Julio Ibarra: So what is an online solution to this to this condition and challenge with monitoring and limitations with tools.
Julio Ibarra: inbound network telemetry.
Julio Ibarra: I believe we are creating new methods to see deeper into the phenomena in our networks, similar to the instruments astronomers and high energy physicists create to see deeper into phenomena, it is a new method by which to instrument, the network for more granular visibility.
Julio Ibarra: This slide describes what I empty is and what it does.
Julio Ibarra: So it records network telemetry information in the packet while the packet to versus a path between two points in the network.
Julio Ibarra: What is network telemetry information basically it's a snapshot of the state of the network provided as metadata.
Julio Ibarra: telemetry reports are exported directly from the data plane, with no impact to the control plane, this is very important because typically.
Julio Ibarra: there's with our traditional monitoring tools, the cpu can be severely impacted and oftentimes resources have to be dedicated for the function.
Julio Ibarra: It tracks contract, monitor and evaluate every single packet at line rate and in real time, and this is unprecedented.
Julio Ibarra: Some examples of network telemetry information collected are timestamp ingress port eagerness port keeper for utilization and many others.
Julio Ibarra: As a result, visibility on the network is unprecedented the telemetry data is available to detect throughput issues due to bottlenecks failures or configuration errors.
Julio Ibarra: So, how does it work, this is an example of a network instrumented with iot.
Julio Ibarra: The diagram here on the on the right shows you.
Julio Ibarra: The the source node on the left and a sink note on the right and the network is.
Julio Ibarra: A five switches with iot enabled in the switches.
Julio Ibarra: So the source node at the left of the diagram sends a packet and the source node is unaware, it is enabled in the network it doesn't need to know this information.
Julio Ibarra: And this is illustrated here with number one in the path the job of the iot source switch this first one here is the portion that I empty header and metadata into the packet.
Julio Ibarra: that's the first telemetry a header here.
Julio Ibarra: Every it switch in the network path and push it as metadata into the packet.
Julio Ibarra: Sony your number three you see all of these headers being put in here with telemetry information in there note the stacking of the IT meditate.
Julio Ibarra: If I switch is not and I empty switch it just ignores the IMC content in the packet the I empty sinks, which.
Julio Ibarra: This one here at the end of the network path and.
Julio Ibarra: Its job is to extract the telemetry information, then, to forward the original packet to the sink node which is here.
Julio Ibarra: The same it sinks, which.
Julio Ibarra: Then forwards telemetry the telemetry report to the telemetry collector all of these headers and metadata here form the telemetry report it's all collected and forward it to the telemetry collected here on this computer.
Julio Ibarra: The telemetry collector then receives parses processes and generates operational telemetry reports and there you have the ABC of of it, how it simply works.
Julio Ibarra: it's not that complicated.
Julio Ibarra: So here's a representative representation of a telemetry report with metadata and its data, so you can see here all of these variables are metadata identifiers.
Julio Ibarra: A purse which level, and these are the metadata on a telemetry port level this here is an example of what the Meta data variable is such as uptime in time per switch switch 1234 and five, as illustrated in the previous slide and all of this data is now available.
Julio Ibarra: For us to be able to.
Julio Ibarra: understand what is going on in the network capturing.
Julio Ibarra: Events per packet.
Julio Ibarra: Now this this thick set of slides provide examples of how we're using the metadata and the granular visibility provided and what has with iot.
Julio Ibarra: So interface utilization measured in the switch per packet, this is the from ingress egress all the way through this which.
Julio Ibarra: it's useful for detecting micro bursts and i'll get to more detail about that, but as we define microburst earlier, these are bursts that occur within a very short time domain that are very difficult to detect unless you have the visibility.
Julio Ibarra: We can see the start and the end of the micro bursts here in this graph.
Julio Ibarra: The Spikes or 40 gigabytes I mean gigabits per second are classified as microburst these, these are the are the first few of these five.
Julio Ibarra: and
Julio Ibarra: The Spikes below 20 gigabits are classified as normal traffic, these are the ones shown here below the 20 gigabit line in green and seven orange.
Julio Ibarra: The telemetry allows us to monitor bandwidth per interface and Q, so this gives us the ability to see exactly what's going on within the switch and how long that Pack is in there.
Julio Ibarra: instantaneous egress interface buffer utilization.
Julio Ibarra: we're now able to measure buffer utilization report of every switch, which is something we've never been able to do before we're using this metadata to evaluate que es policies and to detect sources of packet drops.
Julio Ibarra: note the difference in the vertical scale between the normal buffer utilization and under congestion.
Julio Ibarra: The graph on the left the vertical scale here is in kilobytes versus on the right that's in megabytes So you can see just.
Julio Ibarra: The difference in scale between when buffers are operating at normal levels of utilization versus under congestion.
Julio Ibarra: So what are the thresholds for normal and under congestion buffers We found that anything above 200 kilobytes becomes a problem that leads to congestion.
Julio Ibarra: The specs Meta data.
Julio Ibarra: allows us to monitor perhaps per packet forwarding delay it's useful for finding sources of gender along the path deter refers to variation and packet to link.
Julio Ibarra: The graph on the Left shows normal buffer utilization the graph on the right shows congested buffers the vertical axis represents delay that you see here.
Julio Ibarra: Note that under normal buffer utilization delay was measured in microseconds and if you can see that, clearly, but the scale here is in microseconds under congested buffers the delay was measured in milliseconds that's here on the on the right graph.
Julio Ibarra: And you can see here some of the Spikes that were generated, for example, this first year occurred.
Julio Ibarra: And you had these the the buffers congested reflecting that at about 65 milliseconds so to put things in perspective, consider the degree of delay in the right track here.
Julio Ibarra: Some packets with buffer for like I said, approximately 65 milliseconds that's about how long a packet takes to transit from some pollo to Atlanta, to give you an idea of how long.
Julio Ibarra: Under congestion conditions, these buffers and the being.
Julio Ibarra: delayed within cubes.
Julio Ibarra: To sum up, this is a use case of an experiment, we did to compare it and SNP we producing an event of micro bursts on a 100 gigabit link.
Julio Ibarra: The experiment transmits five bursts of 40 to 50 gigabits.
Julio Ibarra: of traffic for five seconds, the top graph represents an iot switch exporting metadata in real time per packet.
Julio Ibarra: The anti graph shows five Spikes.
Julio Ibarra: Lasting five seconds each generating 38 to 50 gigabits per second of traffic.
Julio Ibarra: And these these Spikes are classified as microburst.
Julio Ibarra: The bottom graph represents an ethernet switch it's pulling with SMP at its maximum rate of every 15 seconds.
Julio Ibarra: The s&p graph shows to Spikes lasting 30 plus seconds with peaks of utilization of 13 gigabits per second.
Julio Ibarra: they're not report they're not reported as microbus given that they're there.
Julio Ibarra: Within a 15 second time scale.
Julio Ibarra: So this clearly shows that the identity graph is a more realistic representation of network events.
Julio Ibarra: And then find an important finding, though, is that a legacy protocols, such as s&p is not enough to characterize the microburst and to determine their impact.
Julio Ibarra: From another perspective as an MP reported that he goes ation of the hundred gigabit link was at most 13 gigabits per second.
Julio Ibarra: Giving a false impression there's more available bandwidth and it really is so if you're using us an MP other tools will be needed in addition to accurately characterize events legacy protocols are just not going to be sufficient to do this.
Julio Ibarra: As a result, observing microburst becomes straightforward when you're monitoring instrument provides full visibility of network events such as I empty.
Julio Ibarra: So let's review what was previously presented.
Julio Ibarra: We.
Julio Ibarra: recovered reasons why amway was an early adopter of it.
Julio Ibarra: how it works what it metadata uses for deeper visibility into the network to improve operations and support it's already communities.
Julio Ibarra: Comparison of it is an MP for measuring micro bursts, and this next section opposite how am I operates as a platform for network innovation alongside operating as a production, research and education network.
Julio Ibarra: This slide represents a snapshot of the M light SDN architecture.
Julio Ibarra: SDN has been essential to foster innovation on me like the blue boxes represent southbound interfaces southbound interfaces introduce an abstraction between the traditional forwarding control planes the yellow boxes represents the ketosis SDN platform.
Julio Ibarra: He does performs a function of the control it's responsible for interfacing own network applications and southbound protocols.
Julio Ibarra: The Green boxes represent the keto Spyker applications I keep those my application performs a specific task for the control plane.
Julio Ibarra: Green yellow and blue collectively form the control plane, the pink layer represents higher layer applications to support business services, such as routing troubleshooting and provisioning etc.
Julio Ibarra: And the ellipses you see there at the top, our applications or interfaces for users to make service requests for example the ether that virtual circuit manager the ABC manager, you see here in this ellipse.
Julio Ibarra: leveraging multiple applications from the pink layer
Julio Ibarra: which then call upon the the green layer for specific.
Julio Ibarra: operations with the control plane.
Julio Ibarra: The red box is what we refer to as the optical and packet telemetry collector over here on the right it collects streaming telemetry from multiple sources, including the optical later.
Julio Ibarra: The job of the op etc, is to detect network events at the optical and packet layers that could result in failures.
Julio Ibarra: The purple box is the behavior anomaly and performance management bpm.
Julio Ibarra: bpm interprets network status updates.
Julio Ibarra: And network telemetry reports from the op etc and other sources, the bpm applies learning algorithms searches for specific patterns, then notifies the SDN controller when nonconformity is detected and by nonconformity I mean.
Julio Ibarra: Not compliance or out of range with policies that have been already programmed into the resources of the network, so this is how we're able to use it to detect if if if things are operating normally or not normally.
Julio Ibarra: be a PM leveraging that we're calamity to learn the current state of the network and then respond if network anomalies are potentially impacting science applications.
Julio Ibarra: The op etc, and the bpm form the management plane of the architecture.
Julio Ibarra: This slide shows how we're applying the the architecture to the IT infrastructure that MIT is deploying at each of the sites, you can see here in this figure the.
Julio Ibarra: Each MIT site for too late, for example, the US and Brazil, I empty switches.
Julio Ibarra: generate telemetry reports here in the in the data plane a telemetry collector to process telemetry reports is also part of.
Julio Ibarra: insight and applications and database to interpret can display telemetry reports is also part of the the infrastructure, so what this.
Julio Ibarra: What this figure here shows is that every packet becomes a telemetry report and each telemetry collector can parse up to 2 million packets per second of telemetry reports.
Julio Ibarra: And this is unprecedented because before I empty network devices and never management tools to about process to limit reports on a per packet level.
Julio Ibarra: And we're doing this and each one of these sites, which is our ad exchange points to be able to track every single packet as it goes through every I empty switch in the network.
Julio Ibarra: Our goal is for me to be fully instrumented with I empty by the second quarter of 2022.
Julio Ibarra: So.
Julio Ibarra: To look at where we are at this point um we've covered the am light SDN architecture.
Julio Ibarra: I described the optical and packet telemetry collector and the behavior anomaly and performance manager as intimations leveraging network telemetry and described it appointment to instrument, the light network.
Julio Ibarra: The next innovation to present is a subset of autonomic networking that we refer to as closed loop orchestration.
Julio Ibarra: So let me take.
Julio Ibarra: A moment here for a brief review of autonomic networking.
Julio Ibarra: So autonomic networking autonomic systems were first described in 2001.
Julio Ibarra: There is a paper by gephardt and chess in 2003 on autonomic computing that.
Julio Ibarra: describes the concepts and what they mean.
Julio Ibarra: And they were used by IBM for many of their systems so autonomic computing is not a new idea.
Julio Ibarra: autonomic networking adopted many of those concepts and they have been documented in the Iit pipe by the ETF in rfc documents such as 7575 as well as other rfc.
Julio Ibarra: The fundamental goal with autonomic networking and system is self management it's comprised of several self star properties.
Julio Ibarra: One of its goals is to reduce dependencies on your administrators or centralized management systems.
Julio Ibarra: And to adapt to a changing environment.
Julio Ibarra: The.
Julio Ibarra: The other the other important characteristic about condom applicant is a closed loop control, this is a mechanism for self management functions that includes typically collecting analyzing deciding and acting on.
Julio Ibarra: An acting process, it does this in a forever loop, and so we refer to this closed loop control as.
Julio Ibarra: closed loop orchestration.
Julio Ibarra: So, so why is am like developing armored functions into its production operation.
Julio Ibarra: One reason is to increase operational efficiency by reducing dependency on knock operators and central management systems.
Julio Ibarra: But an even bigger reason is a technology pool that's coming from science applications with a requirement for SLA grade network resilience and I have an example coming up to explain what I mean.
Julio Ibarra: But first let's look at where we are today with.
Julio Ibarra: Our networking and what we call closed loop orchestration so this table represents categories of self management as a as a continuum towards the left side our categories, with more human dependency.
Julio Ibarra: The right side describes categories, with less human dependency.
Julio Ibarra: User input towards the left requires more prescriptive information as we move to the right user inputs consists of responding to conditions and triggers.
Julio Ibarra: and responding to us or policies, as opposed to prescriptive information and light has evolved from the left to the right since its adoption of software defined networking and emulate is currently around the middle of closed loop orchestration around here.
Julio Ibarra: And so, with our current project, we want to get as close to autonomic as possible, for example, having autonomic provisioning and operation of layer to vpn.
Julio Ibarra: is a goal for the current project layer to vpn is a very common service that research and education networks provide.
Julio Ibarra: So our goal is to move more services towards autonomic over time.
Julio Ibarra: This slide here represents a use case to self optimize the M light network or reason for self optimizing is to respond to network transit events in near real time if you recall.
Julio Ibarra: These transit moments occur in a very short time scale, so we have to be able to do this as close to real time as possible today optimization is a manual and iterative process.
Julio Ibarra: The diagram shows three sites in the ham like domain, we have Florida Chile and Brazil.
Julio Ibarra: This is representative of the slide that I showed earlier of where we will have the.
Julio Ibarra: The light SDN infrastructure and telemetry infrastructure deploy.
Julio Ibarra: The data plane and green.
Julio Ibarra: That you see here exports it reports to the telemetry collector represented here in blue.
Julio Ibarra: In turn, the telemetry collectors export telemetry summaries.
Julio Ibarra: To the learning systems, which includes the behavior anomaly and performance manager the bpm.
Julio Ibarra: What when when nonconformity is detected.
Julio Ibarra: The learning systems will send alarms to.
Julio Ibarra: The the Doc where we have human intervention, if necessary, as well as to the SDN orchestrator where there's less dependency on human intervention.
Julio Ibarra: And the SDN orchestrator sends instruction then to the control plane, which are shown here in red segments, the program the data plane.
Julio Ibarra: If the controls are there to to allow that so all of that is is under operator control it's not like it's something that the network will now be self driven there's always a way to have operators.
Julio Ibarra: First, determine if it's necessary to intervene or through allow for self driving of the network, so this this is representative of the closed loop orchestration system.
Julio Ibarra: So, essentially, just to recap we're going from the bottom up here into the learning systems with telemetry summaries the interpretation occurs here and actions, then and Sue to be able to do this in a closed loop fashion fashion.
Julio Ibarra: Now this is, this is the approach that we're taking for self self optimization.
Julio Ibarra: To be able to respond to the the networking events in real time.
Julio Ibarra: So i'm.
Julio Ibarra: The roadmap to self optimizing shows the improvements plan as autonomic functions and learning algorithm arm are improved, so today where where we're working around five seconds by year three we we plan to improve to to your four to one and your five to 500 milliseconds.
Julio Ibarra: So we've covered autonomic networking and now we've also compared closed loop orchestration with automatic automation and autonomic and presented a use case to self optimize am like that applies autonomic functions and closed loop orchestration.
Julio Ibarra: Next let's let's take a look at how we are applying these innovations on em light as a production network to support science.
Julio Ibarra: let's start with a service level agreement SLA agreement driven use case.
Julio Ibarra: The verb Observatory.
Julio Ibarra: very rude, but it is a large aperture wide field ground based optical telescope under construction in northern Chile.
Julio Ibarra: it's an 8.4 meter telescope it will take a picture of the southern sky every 27 seconds and will produce a 30 gigabyte data set.
Julio Ibarra: Every 27 seconds each dataset must be transferred to the US Data facility at slack in menlo park California within five seconds inside that 27 second transfer window.
Julio Ibarra: So and white, has, along with all the networks participating in this very reuben network we have five seconds to get the.
Julio Ibarra: The data set from northern chilly here.
Julio Ibarra: In a town called la serena with the base station is all the way to slack in menlo park California.
Julio Ibarra: Some of the challenges that we are are facing here with with this use case is.
Julio Ibarra: The the high propagation delay.
Julio Ibarra: In the end, to end path the round trip time from the base station and loss arena she led to the US Data facility and slack is approximately 180 plus milliseconds we've computed that a point 00 1% packet loss will compromise the Ruby Observatory application.
Julio Ibarra: So this is very, very time sensitive.
Julio Ibarra: So this slide represents the very reuben workflow cadence and.
Julio Ibarra: we're trying to represent here, the what happens in the 27 seconds.
Julio Ibarra: That I described in the previous slide so the 27 seconds is for data.
Julio Ibarra: is for the data set transfer window 22 seconds is to gather and process the image shown here in white and.
Julio Ibarra: five seconds for the transfer to the US Data facility shown in blue over here Okay, at least 40 gigabits per second of dedicated bandwidth is the estimated.
Julio Ibarra: level to achieve the data set transfer within five seconds.
Julio Ibarra: So what if a condition occurs that results in packet loss shown here at this point the network must react within 22 seconds of the next data set process window in order to not miss the data transfer window.
Julio Ibarra: Without proper instrumentation because of the complexity and troubleshooting a distributed multi domain network topology such as their rubens.
Julio Ibarra: is likely.
Julio Ibarra: This this condition is likely to impact the following data transfer window and that's shown here with this Red Square and this X.
Julio Ibarra: And the following wants to, but you see here.
Julio Ibarra: So, depending on the type of issue, for example, soft issues such as a packet loss.
Julio Ibarra: It can take hours days and possibly weeks to mitigate this problem, unlike a hard.
Julio Ibarra: Issues such as a fiber cut.
Julio Ibarra: It could take quite a bit of time with with packet loss as I covered previously it's hard to know where it's happening.
Julio Ibarra: In in a short amount of time.
Julio Ibarra: So it looks like the very reuben Observatory needs a network that's properly instrumented I can respond to transit events in real time.
Julio Ibarra: So let's uh let's take a look.
Julio Ibarra: emulators instrumented for SLA grade network resilience for the rubber very reuben Observatory the expressive protect paths are instrumented with iot and persona.
Julio Ibarra: From Santiago, Chile to Atlanta Georgia, where Am I will hand off to the ies that network, you can see here all of this instrumentation is in place.
Julio Ibarra: from Chile, all the way to to Georgia, we have the it switches we have dual connectivity here, with the primary express path and the protect path, and we have our closed loop orchestration here with the iot collector per site.
Julio Ibarra: So instrumented with iot and lights management plane is processing telemetry reports.
Julio Ibarra: Isolating and detecting traffic anomalies validating performance thresholds and computing risk profiles of optical links and IP layer metrics.
Julio Ibarra: So if a transit event were to occur during the data set transfer window packet loss by impact the transfer the event will be detected in the iot reports so we may lose one image.
Julio Ibarra: Transfer window.
Julio Ibarra: The the instructions will program the data plane to provision an alternate path before the next data transfer window is is is set.
Julio Ibarra: The the closed loop orchestration repeat this process for every packet as it traverses the network so we're able to.
Julio Ibarra: Have the detection mechanism in place to be able to not miss the next window so much and not miss the next day that's made us a transfer window, as a result of the instrumentation that's in place.
Julio Ibarra: So, finally, our metric for success is to not miss that data transfer window, and this is what we're instrument thing the network to be able to achieve from Aruba as well as for other SLA driven applications.
Julio Ibarra: Emily also supports fabric.
Julio Ibarra: And let will be providing a.
Julio Ibarra: Dedicated optical.
Julio Ibarra: path between the fabric notify you and the Atlantic or note, if I, you will be hosting one we were expecting it to arrive within the next few months.
Julio Ibarra: We will have multiple hundred gigabits stitching points to these to these fabric nodes in Atlanta stitching points to yes, that and Internet to as well as Pam path in Miami.
Julio Ibarra: We have.
Julio Ibarra: This will be this will be available in Miami as well as an other locations that you see in the footprint in we saw on the footprint in South America, and even in in Cape Town.
Julio Ibarra: and up to 50 gigabits per seconds of available bandwidth capacity over am light links during experiments to support the goal for reproducibility on fabric experiments will have access to per packet telemetry in real time as well.
Julio Ibarra: This is a network diagram to show the the network as planned for for fabric, you see the fabric edge notify you year and the fabric or note in Atlanta.
Julio Ibarra: there's multiple hundred gigabit path between the the fabric nodes and if I you and the coordinate in Atlanta that leverages the infrastructure that's in place.
Julio Ibarra: compute and storage devices services at open exchange points will be available and path and these exchange points here.
Julio Ibarra: These exchange points will be operating as software defined exchanges, the blue rectangles they will support close the orchestration.
Julio Ibarra: For exchange point in across multiple network domains, so my main takeaway is to note that the M like backbone is instrumented with real time in bed network telemetry that fabric can leverage for its experiments.
Julio Ibarra: Other science Community supported on emulate the large hadron collider open network environment polizzi one the open science grid partnership to advance supercomputing the event horizon telescope.
Julio Ibarra: Ground based telescopes in Chile and South Africa, the event horizon telescope actually it's an interesting story, because that involves will eat all the.
Julio Ibarra: The projects in the rnc program not just me right.
Julio Ibarra: So this gives you an idea of all the different communities that can benefit from the the instrumentation that we will be operating on.
Julio Ibarra: The MIT team.
Julio Ibarra: Is is here, we have myself is principal investigator Toronto bizarro is the chief network architect he leads the and the engineering teams and also the software development teams, for all of the software that I described in this presentation.
Julio Ibarra: But soca check out over is our lead for outreach and education, Heidi Morgan at usc is the lead for research engagement chip Cox of vanderbilt university is our coordinator for operations.
Julio Ibarra: We say Professor least Lopez at the University of San Paulo and if I you, these are chair for the Research Committee.
Julio Ibarra: And Eduardo was n D R amp D he's our Chair for for the engineering committee.
Julio Ibarra: And I left for the last slide.
Julio Ibarra: The the Julio in one slide.
Julio Ibarra: description, and so I will just briefly mentioned or answer the question of when how and why did that I decided to go to pursue a research career.
Julio Ibarra: I will give credit to much encouragement I received from a Vice President at nyu many, many years ago and and also a family member, I must say that.
Julio Ibarra: Entering graduate school and then.
Julio Ibarra: Pursuing my PhD was was a journey and.
Julio Ibarra: There was inspiration from colleagues and TEAM members and also motivation for my PhD professor, I will say the experience was transformational.
Julio Ibarra: It has really helped me to be more mindful and effective of.
Julio Ibarra: The the importance of working with.
Julio Ibarra: Research faculty and it practitioners and the importance of them working together effectively and I give much credit to the the programs nsf has produced to enable us to do this.
Julio Ibarra: Some references if you're interested in more information about the topic site I covered.
Julio Ibarra: And thank you very much for your time and the.
Julio Ibarra: The opportunity to present this to to all of you, thank you.
Manish Parashar: Thank you, Julio for absolutely brilliant talk on the skiff virtual round of applause TULIO.
Elements of.
Manish Parashar: it's just amazing to see the tremendous impact and broad impact your research is having.
Manish Parashar: You know, both in the networking research community, but also in the science broader science community by the research and enables to these remote instruments so with that, let me open it up for questions, I know there are two lined up in the Q amp a.
Manish Parashar: box i'll start with that the first question is from Sally o'connor and she's asking our redundancies addressed in the network, why was boca raton selected instead of fit campus.
Julio Ibarra: The reason for boca raton.
Julio Ibarra: Is that the the undersea cable system lands in boca raton and there is a data Center that the the the cable is is terminated X.
Julio Ibarra: And it was just more effective for us to establish a point of presence there to minimize the latency for the Vera ruben observed the variable Observatory If you recall.
Julio Ibarra: Where we have we have five seconds to get that 13 gigabyte data set to to the data facility at slack so by by going North directly from boca raton where the cable lands were able to.
Julio Ibarra: Keep the the latency to a minimum, as opposed to coming all the way down to Miami and then going North again and that's mainly the reason why.
Manish Parashar: Thank Thank you and again a reminder to everybody if you have questions, please enter them in the Q a box and i'll read them out.
Manish Parashar: So we have another question from Jennifer schaaf.
Manish Parashar: She asks on slide 28 our experiences with other astronomy applications, such as the hd has shown that the problem with transferring the files isn't the long haul networks such as.
Manish Parashar: The ones you're supporting, but the network between instruments and the first exchange point.
Manish Parashar: Which is generally less than one gigabit per second network or a controller computer with less than one gigabit transfer rate how have you dealt with these high level bottlenecks, which are more common and perform performance impacting then micro events.
Julio Ibarra: Thank you Jennifer for your question.
Julio Ibarra: That is is a reality that we have to to to work with that I classify that more as a social engineering challenge than a technology challenge because.
Julio Ibarra: Many of these instruments are just not connected at the level that they should be, and Jennifer has been leading this effort for the IMC.
Julio Ibarra: group she has a very.
Julio Ibarra: Important program called epic that works with researchers and makes it very easy for them to understand where there are bottlenecks and what needs to be done.
Julio Ibarra: Network telemetry essentially is providing visibility and much needed visibility that we don't have today with traditional tools, so it doesn't solve a bottleneck problem.
Julio Ibarra: That has to be that that typically has a cost, and it just has to be addressed by the.
Julio Ibarra: Projects or the the operators.
Manish Parashar: Thank you.
Manish Parashar: Our next question is from deep Medi.
Manish Parashar: He says.
Julio Ibarra: i'd be.
Manish Parashar: Great talk.
Manish Parashar: How are planning how are you planning to incorporate coordinate the need of event follow the horizon telescope an action to meet their data transfer in incoming incoming is.
Julio Ibarra: Well, the the event horizon telescope is is, as I mentioned a social challenge because many of their sites just are not well connected for the kind of data movement that that they require.
Julio Ibarra: There was a I think it was an.
Julio Ibarra: That the science, the science digest nsf.
Julio Ibarra: publish that the the the way that they are, they are getting the data to their their analysis centers essentially is via.
Julio Ibarra: Via hard drives they drive up they take the hard drives and drive them down a mountain to whether then shipped to a an analysis Center.
Julio Ibarra: And we have been meeting with them, working with them to adopt the research and education networks as their approach instead of using.
Julio Ibarra: Physical disk drives from to move their data many of a number of the sites are properly connected, but quite a few others are not and, and so this is this is part of the work that we we we've.
Julio Ibarra: we've taken on with the the sack committee to to show them what's at least available in South America, but they can leverage, but there is this is a, this is a global instrument involving many.
Julio Ibarra: Many instruments, and so the.
Julio Ibarra: Each of the iron CP is is working to better inform these these these astronomers about what's available to them and for them to to use these these resources.
Manish Parashar: Thank you.
Think.
Manish Parashar: Jennifer thanks you for the shoutout T book.
Julio Ibarra: you're welcome Jen.
Manish Parashar: Other questions for Julio.
Manish Parashar: well.
Manish Parashar: we'll wait for another minute.
Manish Parashar: see if there are any further questions.
Manish Parashar: I will remind that for the nsf program officers there's a session later this afternoon.
Manish Parashar: The boss live lecture officer it's between three and four, and so that's another opportunity to chat with Julio.
Manish Parashar: Seeing no more questions Oh, there is one.
Manish Parashar: Thank you Sylvia this is from Sylvia spangler do you see the network as being eXtensible to other disciplines within South America.
Julio Ibarra: Yes, absolutely I I didn't.
Julio Ibarra: I didn't cover other disciplines as well, but yes, we definitely are working to attract more disciplines.
Julio Ibarra: Soviet, thank you for your question it's good to hear from you certainly the the bio sciences community is one of interest, as well as ecology and geosciences we as as a as a program the rnc P eyes communities week we share a lot of experiences and try to figure out how we can get these.
Julio Ibarra: These different.
Julio Ibarra: Communities of.
Julio Ibarra: Researchers to engage with the research networks, so we have been leveraging leveraging some types of cyber infrastructure, for example, data transfer notes that that they can use to least.
Julio Ibarra: copy their data to these nodes and be able to move them rapidly across the network to where they they are analyzed.
Julio Ibarra: In some cases, this is a.
Julio Ibarra: This has been very, very effective, the results have been very good in other cases it's just like I said earlier, it's a social engineering challenge to.
Julio Ibarra: get some of the the researchers to adopt new methods and to use the research intuition networks so for sure we were certainly interested in every opportunity to engage with.
Julio Ibarra: The different disciplines and have them benefit from the networks that are available to them.
Thank you.
Manish Parashar: well.
Manish Parashar: We have a question from Patrick Smith.
Manish Parashar: Sylvia says lovely talk.
Julio Ibarra: Thank you, Sophia.
Manish Parashar: and Patrick says fascinating presentation, thank you for your insights linear talk you mentioned Antarctica.
Manish Parashar: Yes, are you interested in the recent announcement by sub tell Chile, for a subsea cable between Tierra del Fuego and King George island.
Julio Ibarra: Yes, absolutely we we have been pursuing and following all the activities.
Julio Ibarra: With nsf in the rnc program I I follow pat smith's presentations as much as possible, and I know he has one coming up, I think this this Saturday, as part of T PR E and we will we will certainly be be there to enjoy your talk Pat, but we are for sure interested in.
Julio Ibarra: in Antarctica and the opportunities for Antarctica to benefit from the research networks, we have close to them, so the MIT network is is is a is a resource that we would like to.
Julio Ibarra: make available for for the instruments in Antarctica I believe the the telemetry capability that we're instrument thing on emulate would be beneficial.
Julio Ibarra: For a lot of that science and we would welcome the opportunity to show that so, but you know clearly this is a an opportunity for the entire irc program and nsf to to really.
Julio Ibarra: be able to get the instruments connected to a high speed optical network.
Julio Ibarra: and
Julio Ibarra: As opposed to just using satellite communications as as they are today.
Manish Parashar: Thank you Sylvia has another question, he asked should domains work with your science person at usc.
Julio Ibarra: Yes, absolutely for sure hi amy hi amy Morgan is.
Julio Ibarra: A excellent person to the contact and and inform them of pinterest for for me like thank you very much for for doing that.
Manish Parashar: Q and we have a comment for for me the chose me she says no question just thanks for a great presentation.
Julio Ibarra: Thank you so much, I really appreciate that.
Okay.
Manish Parashar: So with that, let us then close the session reminder again, there is a post lecture office are.
Manish Parashar: between three and four, this afternoon, where we have another opportunity to talk to Julio can Julio, thank you for all your work impactful work and for this great presentation and with that i'm close the session, thank you.
Julio Ibarra: Welcome Thank you so much.