flatjae.blogg.se

#Fme etl software
#Fme etl Pc

If you want to run tasks periodically you should take a look at FME Server… I was not able to find out to start a follow-up process if the “storing process” was successful or not.

Furthermore I needed to start this last process with a so-called creator.

#Fme etl Pc

I ended up with calling WinSCP on my Windows PC with some custom commands. The normal FTPCaller was not working with our sftp digital-geography server (…). Therefore I needed to use the System Caller Transformer. The hard one was to get it on the server so a potential webmap application could work with the data. I loaded it back again from this file and saved it again as geoJSON. To work on with it I needed to store it on my hdd. After choosing the Google Sheet reader I needed to replace some strings and format my lat/lon columns and defined the lat/lon columns for the Geometry. There all the fancy processes and tasks are stored like string manipulation, spatial queries and even an IP geocoder or the What3WordsEncoder.

#Fme etl software

The help section of this software is really great and you will find plenty of video tutorials for this baby made by FME.įor the second task I needed some more magic from the so-called Transformer Gallery. Take care of string formatting a bit and decide which columns you really need and off you go.

The first task was done quite easy as you simply load the excel with a file reader process and attach three different file writers to it.Įxample view of a a process after run of FMEĪs you simply need to define the lat/lon columns everything else is done by the program. You’ll get support for over 350 file formats. The software itself can be used in three-way: Desktop version, Server version or Cloud version. For short-term tests they offer a 30 day trial. Despite this price: If you need software like FME for your studies, just drop them a line as they have an academic grant program. An indicator for the price is set at the cloud provider. The installation is a no-brainer but this does definitely not come for free.

load data from a google spreadsheet, transform it into a geoJSON and put it onto a server using ftpįME is a product from Safe Software and is somehow the flagship when it comes to ETL processes, data manipulation and process monitoring.

safe an excel file in three different spatial formats (shapefile, KML and geoJSON).

Both are somehow different but I wanted to solve two problems: As I searched the web I found those two candidates: FME and the open source tool talend. What’s it aboutĪs I already used ETL tools in large-scale IT environments at banks I was interested in “What can I do with them in terms of spatial data?”. In this article I would like to present you two of them: FME from Safe Software and Talend with Spatial Extension. To manage this variety and support the work with a standardized data set most companies use so-called ETL tools to Extract, Transform and Load data. But there is always a wide variety not only in available and used file formats but also in structure of data and formats of the data itself (numbers as text, different separators, etc.). Spatial data has some formats most of you know (shapefile, geoJSON, TiFF,…).