Our client is a US-based technology start-up that builds advanced open-source and enterprise data integration and analytics software for public health and development entities in low- and middle-income countries. Their vision is to transform how public and private sector stakeholders access and use data to address the world's most pressing development challenges. As a global company, diversity, equity, and inclusion are core parts of their values. They define impact by their success in helping their users access the full power of their data so they can act on valuable insights to build and sustain high performing, equitable systems. Their software is currently used by 12 countries across Africa, Asia and South America and they are funded by some of the largest global health foundations.
Job Overview
Our client is currently seeking an experienced System Integration Software Engineer who will be responsible for creating and maintaining highly reliable and efficient data integrations for their clients. Your focus will be on building integrations for key systems, ensuring they are reliable, performant, and cost-effective. You will also collaborate closely with their engineering and data teams to optimize and fine-tune our integration pipelines.
Job Type: Full Time
Workplace: Remote
Location: Cape Town
Requirements
- Bachelors or Masters degree in Computer Science, Engineering, or a related field.
- 5+ years of professional experience in software development, data engineering or similar capacity.
- Strong experience in systems engineering, data integration, and data pipeline optimization
- Proficiency in programming languages - Python.
- Familiarity with cloud hosting platforms such as AWS and GCP.
- Good working knowledge and exposure to technologies such as Docker and PostgreSQL.
- Strong proficiency in optimizing and fine-tuning integration pipelines, including databases, ETL processes, and API connections.
- Experience with Druid.
- Experience in data pipeline and integration tools (e.g., Airflow, Apache NiFi, Apache Kafka).
- Experience in collaborating with clients to gather requirements, provide updates, and ensure their needs are met.
- Ability to communicate complex technical concepts related to databases and integrations to both technical and non-technical stakeholders.
- Experience in designing, implementing, troubleshooting, and monitoring data pipelines to ensure data quality and integrity.
- Strong problem-solving skills and ability to work independently or as part of a team.
- Excellent communication skills, both written and verbal.
- Data Integration Development
- Develop and maintain data integrations for key systems with high reliability, performance, and cost-efficiency.
- Optimize and fine-tune integration pipelines, including databases, ETL processes, and API connections.
- Design, implement, troubleshoot, and monitor data pipelines to ensure data quality and integrity
- Technology and Tools Management
- Continuously refine the technology stack and tools for optimal performance, security, and scalability, focusing on technologies such as PostgreSQL, Druid, Pandas, Python, and SQL.
- Stay current with industry trends and best practices in data integration, database administration, and systems engineering.
- Technical Support and Troubleshooting
- Provide technical support and guidance to team members and clients as a subject matter expert in data integration and systems engineering.
- Communication and Stakeholder Engagement
- Communicate complex technical concepts related to databases and integrations to both technical and non-technical stakeholders.
- Participate in meetings with cross-functional teams to review progress, discuss challenges, and plan future initiatives.
- Actively participate in team discussions and knowledge-sharing sessions to support collective learning and improvement.
- Collaborate with clients to gather requirements, provide updates, and ensure their needs are met, including managing and developing new data integrations.
