Working with Big Data and FME

Liz Sanderson
Liz Sanderson
  • Updated

Introduction

Big data is a term to describe datasets that are high in volume and have a variety of data types, that also need to be processed at high velocity. For a high-level overview of how FME can help you with Big Data, see our website

 

Tutorials

Getting Started with Google BigQuery

FME & Hadoop FAQ

 

Format Documentation

Apache Hive (Hadoop) Reader
​​​​​​​Amazon DynamoDB Reader/Writer
Google BigQuery Reader / Writer
IBM Cloudant
 

​​​​​​​Top Questions and Answers

big data -> big headache
​​​​​​​Big Data Processing
​​​​​​​What is the Standard Process in Loading Big Data to a Database

​​​​

Additional Resources

Blogs

7 Emerging Data & Enterprise Integration Trends in 2022
​​​​​​​10 Ways to Automate All Your Data Workflows
​​​​​​​Bring Your GIS and Business Data Into Google BigQuery with FME
​​​​​​​COVID-19: New Trends & Medical Data Integration
​​​​​​​DynamoDB and S3 – Using Geohashes to Give Location to Big Data
​​​​​​​How to Upload Big Data to the Cloud
​​​​​​​setld, FME and the 4 Vs of Big Data: Building Business Intelligence “Products”
​​​​​​​Think like a point cloud: Tips for effective data processing
 

Presentations

​​​​​​​Big Cities, Big Dreams, Big Data Problems: Making Urban Design Tools Talk to Each Other with FME
​​​​​​​Leveraging IoT Big Data to Bring Insights to Global Vessel Patterns [22:01]
Performance and Application of GIS and Big Data ETL Processes Using FME
 

Templates

BigQueryGIS - Simple​​​​​​​
BigQueryGIS - Dynamic

 

Videos

​​​​​​​Build a limitless spatial database in the cloud with Amazon DynamoDB and S3 [18:25] 

 

Webinars

Big Data - Tap into Cloud Infrastructure [1:09:08]
 

Known Issues

For a list of Known Issues, see the following articles: 2021.x2020.x2019.x2018.x2017.x
 

Support

Can’t find what you are looking for? Search our Community for a related question or post your question in our Forums or contact Support.

Was this article helpful?

Comments

0 comments

Please sign in to leave a comment.