Menu

Continent 8 Automation

Home / portfolio / Continent 8 Automation

Infrastructure Automation & Data Pipelines (Apache Airflow)

Designed and maintained infrastructure automation workflows using Apache Airflow to support network operations, cloud reporting, and billing processes across multiple systems.

Network Automation & Backups
• Designed and implemented from scratch an Airflow-based backup workflow for NFtables devices (via Docker + SSH), integrating configuration retrieval into centralized automation pipelines.
• Migrated Fortinet device backup automation from legacy PHP scripts to Python-based Airflow DAGs, improving reliability and observability.
• Maintained and stabilized existing PHP-based backup scripts for Cisco, Juniper (NETCONF), and A10 devices executed via cron across distributed servers.
• Automated version-controlled storage of network device configurations in GitLab repositories to enable auditability and rollback support.

Data Lifecycle & Database Maintenance
• Implemented scheduled data retention workflows to purge time-based records from multiple high-volume log tables.
• Improved database performance and storage efficiency through automated cleanup policies.

Cloud & Virtual Infrastructure Automation
• Built Airflow pipelines to collect and process VDC operational data from VMware vRealize for reporting within the Nuleus platform.
• Migrated legacy PHP script (Mitig8ProtectedIps) to Python-based Airflow DAG, improving maintainability and observability.
• Implemented Cloudian billing cache data collection via Cloudian API integration.

Internal Tooling
• Designed and implemented a custom Redis queue library to support distributed task processing and asynchronous workflows.