Lessons learned deploying a big-data geospatial system on AWS

preview_player
Показать описание
by Eric Wenger

During the past year we undertook an effort to transition a geospatial data processing system developed under a government research project from a small private cluster running Windows to an AWS-based environment running Linux. This talk will cover a variety of subjects including the steps taken to migrate the system, hurdles encountered with Linux and AWS (particularly differences in performance), and how we ended up working around those issues. The system in question leverages about 18 TB of satellite imagery, OSM, DEM and other sources and extracts information such as 2m landcover classification maps, terrain descriptors, objects such as orchards, zebra crosswalks, water towers and multiview DSMs.
  1. FOSS4G NA
  2. Amazon
  3. AWS
  4. Big Data
  5. FOSS4G NA
  6. FOSS4G NA 2016
Рекомендации по теме
Lessons learned deploying 0:37:36

Lessons learned deploying a big-data geospatial system on AWS

Big Data LDN 0:15:13

Big Data LDN 2018 Interviews: Lessons Learned for Deploying Real-World AI Systems

Big Data In 0:05:12

Big Data In 5 Minutes | What Is Big Data?| Big Data Analytics | Big Data Tutorial | Simplilearn

Lessons learned deploying 0:06:05

Lessons learned deploying ML in industry | ALMD Keynote Session | Marcin Pietrzyk

Big Data in 0:19:37

Big Data in Production — Lessons from Running in the Cloud

Lessons Learned Replatforming 0:38:13

Lessons Learned Replatforming A Large Machine Learning Application To Apache Spark Taylor Hess Morni

Roadmap to Become 0:00:05

Roadmap to Become a Generative AI Expert for Beginners in 2025

Top 5 Lessons 0:56:04

Top 5 Lessons Learned Deploying Real-World Artificial Intelligence Infrastructure

Protecting MCP servers 0:04:42

Protecting MCP servers with F5 BIG-IP Next for Kubernetes deployed on NVIDIA BlueField-3 DPUs

AWS: Deploying Real-World 0:27:45

AWS: Deploying Real-World Machine Learning│Michelle Lee

Josh Howes | 0:39:16

Josh Howes | PyData in Production: Lesson Learned from Various PyData Deployment Strategies

Lessons Learned from 0:20:11

Lessons Learned from Building a Deployment Process for 100+ Devs at a Large Bank - Bob Walker

Lessons Learned from 0:03:38

Lessons Learned from Developing and Deploying a Large-Scale Employer Name Normalization System

Big Data Project 0:13:30

Big Data Project Deployment Explained

Lessons learned deploying 0:24:21

Lessons learned deploying a LLM document processing system at scale

PyTorch vs. TensorFlow 0:01:00

PyTorch vs. TensorFlow

QlikView Lessons Learned 0:37:10

QlikView Lessons Learned #1-3: Deploying & Managing Multiple Applications

Data Pipeline Overview 0:00:58

Data Pipeline Overview

How do Data 0:01:00

How do Data Engineers deploy their pipeline in production? #interview #dataengineering

HDFS on Kubernetes—Lessons 0:31:24

HDFS on Kubernetes—Lessons Learned - Kimoon Kim

Lessons Learned from 0:30:33

Lessons Learned from Dockerizing Spark Workloads: Spark Summit East talk by Tom Phelan

Google cloud for 0:00:44

Google cloud for ML model #ai #technology #codingexperience

Top 5 Lessons 0:43:31

Top 5 Lessons Learned in Helping Organizations Adopt MLOps Practices

Lessons Learned Developing 0:34:51

Lessons Learned Developing & Managing High Volume Apache Spark Pipelines in Production -Erni Du...

join shbcf.ru