- Hotline: 0932.684.295
JOB DESCRIPTION
1. Partner Collaboration and Template Management
● Work directly with business partners to understand their data transformation requirements
● Design and implement flexible NiFi templates that accommodate partner-specific data formats
● Manage template versioning and changes based on partner requirements
● Document template specifications and maintain template change history
● Provide technical support and guidance to partners during template implementation
● Conduct regular reviews with partners to optimize template performance
● Handle template modifications and updates efficiently to minimize disruption
2. Data Pipeline Development
● Design, develop, and maintain data pipelines using Apache NiFi for data ingestion, transformation, and distribution
● Create and manage NiFi templates for standardized data processing workflows
● Implement robust data synchronization solutions between AWS S3 and Google Cloud Storage
● Develop and optimize PostgreSQL-based data transformation processes
● Ensure data quality, consistency, and reliability across all systems
3. Template Development and Management
● Design modular and reusable template components
● Implement template validation and testing procedures
● Manage template lifecycle and versioning
● Create template documentation and usage guidelines
● Develop template migration strategies
● Monitor template performance and optimize as needed
4. System Optimization
● Monitor and optimize pipeline performance
● Implement error handling and recovery mechanisms
● Develop monitoring and alerting systems
● Ensure cost-effective utilization of cloud resources
Công ty Cổ phần Công nghệ Finviet
Copyright©2019 - 2022. Toàn bộ bản quyền thuộc ITNAVI
