Introduction
Big data is a term to describe datasets that are high in volume and have a variety of data types, that also need to be processed at high velocity. For a high-level overview of how FME can help you with Big Data, see our website.
Tutorials
Getting Started with Google BigQuery
- Loading a Single File to BigQuery
- Loading Multiple Files Dynamically into BigQuery
- Cleaning & Preparing Data for Google BigQuery
- Automating Data Upload to Google BigQuery from Google Cloud Storage
Format Documentation
Apache Hive (Hadoop) Reader
Amazon DynamoDB Reader/Writer
Google BigQuery Reader / Writer
IBM Cloudant
Top Questions and Answers
big data -> big headache
Big Data Processing
What is the Standard Process in Loading Big Data to a Database
Additional Resources
Blogs
7 Emerging Data & Enterprise Integration Trends in 2022
10 Ways to Automate All Your Data Workflows
Bring Your GIS and Business Data Into Google BigQuery with FME
COVID-19: New Trends & Medical Data Integration
DynamoDB and S3 – Using Geohashes to Give Location to Big Data
How to Upload Big Data to the Cloud
setld, FME and the 4 Vs of Big Data: Building Business Intelligence “Products”
Think like a point cloud: Tips for effective data processing
Presentations
Big Cities, Big Dreams, Big Data Problems: Making Urban Design Tools Talk to Each Other with FME
Leveraging IoT Big Data to Bring Insights to Global Vessel Patterns [22:01]
Performance and Application of GIS and Big Data ETL Processes Using FME
Templates
BigQueryGIS - Simple
BigQueryGIS - Dynamic
Videos
Build a limitless spatial database in the cloud with Amazon DynamoDB and S3 [18:25]
Webinars
Big Data - Tap into Cloud Infrastructure [1:09:08]
Known Issues
For a list of Known Issues, see the following articles: 2021.x, 2020.x, 2019.x, 2018.x, 2017.x
Support
Can’t find what you are looking for? Search our Community for a related question or post your question in our Forums or contact Support.