Intermediate Data Engineer

Description

JOBJACK is growing and looking for a Data Engineer to come along for the ride.
At JOBJACK, you will have the opportunity to work with a team of innovative individuals passionate about seeing the world employed. Within our agile Data team, you will help build a pioneering tech-solution infrastructure that serves as a marketplace for entry-level jobs. Our vibrant Data team is in charge of producing effective data solutions while following in house data warehousing and data pipeline standards.
As a Data Engineer at JOBJACK, you will be responsible for designing, developing, and maintaining the infrastructure and systems necessary for the efficient and reliable processing, storage, and analysis of data. You will work closely with our Development team to ensure data is accessible, reliable, and scalable. Collaborating with other teams, you will understand business requirements and design data solutions using cutting-edge technology. This role is essential for enabling data-driven decision-making by ensuring data availability, integrity, and accessibility, all while tackling South Africas unemployment crisis with a passionate and growing team.
If you want to join a highly dynamic team and partner with us in our vision to Employ the World, JOBJACK is for you!
Apply now, before the deadline of 18 July, 2024. If you're the right fit, you'll hear from us within three weeks of the closing date.

Responsibilities

1. Data Pipeline Design and Development

• Provide reasonable estimates of complexity and communicate throughout the development cycle.
• Design and develop data pipelines, ensuring they align with the overall architecture and technical vision of JOBJACK.
• Effectively utilize abstractions and code isolation in data processing and transformation tasks.
• Identify technical risks in data pipelines and determine appropriate controls (mitigation strategies).
• Understand the data requirements and how they contribute to the overall business objectives.
• Use a systematic and analytical approach to troubleshoot and debug complex data-related issues.

2. Data Engineering

• Develop, test, deploy, and maintain data engineering solutions.
• Write efficient and scalable code that follows best practices and coding standards.
• Implement data quality checks and ensure data accuracy and integrity.
• Optimize data processing and transformation tasks for performance and efficiency.
• Collaborate with cross-functional teams to understand data requirements and deliver appropriate solutions.
• Review and prioritize data engineering tasks, ensuring they are appropriately sized and aligned with project timelines.
• Ensure data security and privacy best practices are implemented to protect sensitive information.
• Stay updated with the latest industry trends, tools, and technologies in data engineering.

3. Collaboration & Communication

• Foster positive team dynamics and contribute to a motivating work environment.
• Provide proactive support and assistance to other team members.
• Seek opportunities to give recognition and receive constructive feedback.
• Communicate effectively, actively listen, and share knowledge and insights with team members.
• Actively seek out opportunities to improve team processes, tools and methodologies.

4. Leadership

• Build strong relationships with teammates, managers, and relevant stakeholders
• Mentor junior team members, fostering a culture of learning and growth
• Encourage participation from all team members and ensure an inclusive environment for discussions

Requirements

• Degree in Computer Science, Data Science, or a related field
• 3+ years of experience as a Data Engineer or in a similar role
• Solid understanding of Computer Science fundamentals
• Strong analytical, problem-solving, and numerical skills.
• Excellent communication and collaboration skills
• Self-motivated and able to work independently
• Strong attention to detail with a 'big-picture' perspective.
• Excellent communication and collaboration abilities.
• Self-motivated with the ability to work independently.
• Passion for innovation and collaboration.
• Joyful, driven attitude with a desire for excellence.
• Eager to embrace challenges and continually improve.
• Strong relationship-building skills.
• Commitment to JOBJACK's vision to Employ the World.

Technical knowledge

• Strong knowledge in relevant data engineering and ETL experience.
• Experience with SQL databases: PostgreSQL or AWS RDS/Redshift (2 years+), focusing on performance optimization.
• Proficiency in AWS services: Glue (ETL), S3 (storage), Athena (query analysis).
• Strong skills in Python or PySpark (2 years+) for robust data processing and transformation.
• Knowledge of data warehousing concepts and dimensional modeling.
• Understanding of data quality best practices, data governance frameworks, and data privacy regulations.

Benefits

• Mid-week remote days - with our hybrid working model we offer two remote working days per week plus 4 remote weeks per year.
• Flexible hours - your day starts anytime between 6 am and 9 am
• No dress code
• 20 annual leave days - with an additional 5 days from year 2
• Culture - it's our top priority
• Upskilling - access to audible and Udemy courses
• A mission-driven team
• Opportunities for growth!