Lessons Learned and Cost Analysis of Hosting a Full Stack Open Data Cube (ODC) Application on the Amazon Web Services (AWS)

Rizvi, S. R. H.; Killough, Brian; Cherry, Andrew L.; Gowda, Sanjay

doi:10.1109/igarss.2018.8518084

Cited by 12 publications

(6 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To efficiently and effectively process these large volumes of data and developed tailored applications, the SDC provides a Python application programming interface (API) that enables users to write their own processing algorithms [113]. This API is accessible through Jupyter Notebooks, an interactive web-based programming interface that can be used for combining software code, algorithm output and explanatory text [114].…”

Section: Methodsmentioning

confidence: 99%

Essential Variables for Environmental Monitoring: What Are the Possible Contributions of Earth Observation Data Cubes?

Giuliani

Egger

Italiano

et al. 2020

Data

View full text Add to dashboard Cite

Environmental sustainability is nowadays a major global issue that requires efficient and effective responses from governments. Essential variables (EV) have emerged in different scientific communities as a means to characterize and follow environmental changes through a set of measurements required to support policy evidence. To help track these changes, our planet has been under continuous observation from satellites since 1972. Currently, petabytes of satellite Earth observation (EO) data are freely available. However, the full information potential of EO data has not been yet realized because many big data challenges and complexity barriers hinder their effective use. Consequently, facilitating the production of EVs using the wealth of satellite EO data can be beneficial for environmental monitoring systems. In response to this issue, a comprehensive list of EVs that can take advantage of consistent time-series satellite data has been derived. In addition, a set of use-cases, using an Earth Observation Data Cube (EODC) to process large volumes of satellite data, have been implemented to demonstrate the practical applicability of EODC to produce EVs. The proposed approach has been successfully tested showing that EODC can facilitate the production of EVs at different scales and benefiting from the spatial and temporal dimension of satellite EO data for enhanced environmental monitoring.

show abstract

Section: Methodsmentioning

confidence: 99%

Essential Variables for Environmental Monitoring: What Are the Possible Contributions of Earth Observation Data Cubes?

Giuliani

Egger

Italiano

et al. 2020

Data

View full text Add to dashboard Cite

show abstract

“…The service can also communicate with other global EO data sources offering the APIs mentioned above. The service is engineered to effortlessly interface with a broad spectrum of globally recognized EO data repositories, among which prominent platforms like Google Earth Engine and Amazon AWS Earth stand out (Zhao et al, 2021;Rizvi et al, 2018). These repositories are renowned for housing an extensive range of invaluable EO datasets, offering a treasure trove of geospatial information.…”

Section: Data Repositoriesmentioning

confidence: 99%

Optimized Multi-Modular Services: Empowering Earth Observation Data Processing

Lalayan,

Astsatryan,

Poghosyan

et al. 2024

Informatica

View full text Add to dashboard Cite

The significance of earth observation data spans diverse fields and domains, driving the need for efficient management. Nevertheless, the exponential increase in data volume brings new challenges that complicate processing and storing data. This article proposes an optimized multi-modular service for earth observation data management in response to these challenges. The suggested approach focuses on choosing the optimal configurations for the storage and processing layers to improve the performance and cost-effectiveness of managing data. By employing the recommended optimized strategies, earth observation data can be managed more effectively, resulting in fast data processing and reduced costs.

show abstract

“…In order to collect statistics and visualize them, a separate server was implemented. This server can be run on a device alongside the Jetson Nano (for example, AWS EC2) [22]. The web-based GUI system accommodates statistics from the MaskCam system, stores them in a database, and displays them.…”

Section: Mqtt Broker and Webservermentioning

confidence: 99%

A Practical Hybrid IoT Architecture with Deep Learning Technique for Healthcare and Security Applications

Tran

Amer

et al. 2023

Information

View full text Add to dashboard Cite

Facial mask detection technology has become increasingly important even beyond the context of the COVID-19 pandemic. Along with the advancement in facial recognition technology, face mask detection has become a crucial feature for various applications. This paper introduces an Internet of Things (IoT) architecture based on a developed deep learning algorithm named You Only Look Once (YOLO) to keep society healthy, and secured, and collect data for future research. The proposed paradigm is built on the basis of economic consideration and is easy to implement. Yet, the used YOLOv4-tiny is one of the fastest object detection models to exist. A mask detection camera (MaskCam) that leverages the computing power of NVIDIA’s Jetson Nano edge nanodevices was built side by side with a smart camera application to detect a mask on the face of an individual. MaskCam distinguishes between mask wearers, those who are not wearing masks, and those who are not wearing masks properly according to MQTT protocol. Furthermore, a self-developed web browsing application comes with the MaskCam system to collect and visualize statistics for qualitative and quantitative analysis. The practical results demonstrate the superiority and effectiveness of the proposed smart mask detection system. On the one hand, YOLOv4-full obtained the best results even at smaller resolutions, although the frame rate is too small for real-time use. On the other hand, it is twice as fast as the other detection models, regardless of the quality of detection. Consequently, inferences may be run more frequently over the entire video sequence, resulting in more accurate output.

show abstract

Lessons Learned and Cost Analysis of Hosting a Full Stack Open Data Cube (ODC) Application on the Amazon Web Services (AWS)

Cited by 12 publications

References 1 publication

Essential Variables for Environmental Monitoring: What Are the Possible Contributions of Earth Observation Data Cubes?

Essential Variables for Environmental Monitoring: What Are the Possible Contributions of Earth Observation Data Cubes?

Optimized Multi-Modular Services: Empowering Earth Observation Data Processing

A Practical Hybrid IoT Architecture with Deep Learning Technique for Healthcare and Security Applications

Contact Info

Product

Resources

About