Zimagi
Distributed Data Processing Platform
Links
Zimagi Site
GitHub Project
Documentation
What Need Does Zimagi Fulfill?
Unify data sources
Normalization of relations among data entities
Flexible and universal service hosting
Both schedulable and user launchable actions
Types of Zimagi users
Zimagi versus Luigi, Airflow, and Jenkins
A Tabular Comparison of what Zimagi is and is not
Getting Started with Zimagi
About Zimagi
Components of Zimagi
Databases
Execution Environment
Specifications
Command specifications
Data Specifications
Plugin Specifications
Plugins
Parsers
Modules
Putting It All Together
Using Zimagi Modules
Installing Zimagi
Cloning the Zimagi Repo
Configuring the environment
The Command Line Interface
Config Commands
Environment Commands
Database Commands
Schedule Commands
Data Import Commands
User
Launching Vagrant containers
When things go wrong
Dependencies
Ports
Recovery
Contributing to Zimagi
Developing a Zimagi Module
Creating a module
Initializing Zimagi
Creating a module skeleton
Adding a module to Zimagi
Creating a local remote
Developing module functionality
Defining roles
Data mixins
Command mixins
Defining a data model
Defining data_base objects
Defining data objects
Defining data importation
Python import code
Loading items
Defining commands
Import commands
Comparison of
noaa-stations
with
module-noaa-stations
Code required
Feature comparisons
Zimagi Design and Architecture
Zimagi Concepts
Zimagi Technologies
Zimagi Systems
Zimagi Interface
Zimagi Services
Zimagi Command Line Interface
Zimagi Command API
Zimagi Data API
Zimagi Scheduler
Zimagi Worker
Zimagi Data Types
Zimagi Environment Data
Zimagi Environment Host Data
Zimagi User Data
Zimagi Group Data
Zimagi Log Data
Zimagi Module Data
Zimagi State Data
Zimagi Configuration Data
Zimagi Schedule Data
Zimagi Notification Data
Zimagi Plugins
Zimagi Module Plugin
Zimagi Task Plugin
Zimagi Commands
Zimagi Help Commands
Zimagi Environment and Connection Management Commands
Zimagi Service Commands
Zimagi Data Management Commands
Zimagi Orchestration and Workflow Commands
Zimagi Orchestration Components
Zimagi Configuration Component
Zimagi Group Component
Zimagi Run Components
Zimagi Destroy Components
Zimagi Profile Component
Extending Zimagi
Zimagi
-
Distributed Data Processing Platform
Docs
»
Zimagi Design and Architecture
»
Zimagi Services
»
Zimagi Worker
View page source
Zimagi Worker