Amazon Simple Notification Service (SNS), Data Pipelines, Hotjar, Data Engineering, Object Storage, Design Development, Business Intelligence Tools, Extract, Transform, Load (ETL)
Job description
We are looking for a talented Data Engineer to assist with building our data infrastructure, ETL (Extract, Transform & Load) pipelines, and data warehouse infrastructure, so that we are able to optimise our data engineering capabilities across the business.
As a Data Engineer, you will be responsible for designing, visualising and implementing data models/pipelines/structures to service the business data requirements, as well as delivering reliable and accurate information to key stakeholders. Working closely with our Dev Team, DevOps Team and other key stakeholders, you will create and maintain solutions that will optimise data collection and share analysis and insights between teams. You will support our analysts, product managers and operational leads on data initiatives and will ensure optimal data delivery across projects.
This exciting new position, reporting directly to our Data Manager, provides a fantastic opportunity to work with great people and new cloud-based technologies in an environment where you are
given ownership and responsibility to grow and develop in your area of expertise.
Key responsibilities will include:
- Building infrastructure for ETL and querying of data across data sources; designing and maintaining data systems and databases
- Implementing analytics tools to provide actionable insights; using statistical and business intelligence tools to interpret data sets, paying particular attention to trends and patterns that could be valuable for diagnostic and predictive analytics efforts
- Mining/structuring large, complex data sets as required by different teams to find usable information
- Visualising data - creating and preparing reports, graphs, infographics, presentations, dashboards and other appropriate methods that effectively communicate trends, patterns, and predictions using relevant data that allows stakeholders to understand the models, process, dashboards, data pipelines etc.
- Collaborating with stakeholders across the business to help with technical data issues and support their data infrastructure needs
- Assist with building and deducing consumer facing insights and dashboards
- Assisting and educating the business on how to visualise their data
- You have strong technical expertise in data models, database design development, data mining and segmentation techniques
- You are curious by nature and have a strong attention to detail
- You have strong mathematical, numerical , statistical and problem solving skills. You love seeing data move onto the information and knowledge phases through pipelines youre created
- You are a team player. You reach out to peers and cooperate with others to establish collaborative working relationships. You understand that flying solo is a limiting and isolating choice and know that making your team look good works far better than creating a one-man/one-woman show
- You are self-motivated, collaborative and responsive while being able to work independently and with minimal supervision
- You are able to collect, organise, analyse, and disseminate significant amounts of information with high attention to detail and accuracy
- You have a knack for explaining complicated things simply. You communicate effectively and structure information to meet the needs and understanding of your intended audience (both verbally and in writing)
- You are level-headed and cool under pressure. When things change, you know how to roll with the punches
- You are comfortable with a hybrid work model and with meeting at the office when necessary
- You value both giving and receiving constructive feedback
- Basically, you will blow us away with your work ethic, your passion, your integrity, your attitude and your energy!
- Data warehousing and architecture, data pipelines
- Structured and unstructured databases (SQL, Heroku, Redshift, Postgres)
- System events (AWS SNS, SQS)
- Object storage (AWS S3)
- User and product events (Firebase, HotJar, Google Play, Apple iTunes, Mandrill)
- AWS and/or GCP and open source software
- Looker and various data sources
- DBT
- Airbyte
- Github
- Python
- Website analytics and behaviour (Google analytics)
- Proven working experience of 4-8 years as a Data Engineer preferably in a startup environment
- Relevant qualifications/training in Data Engineering, Data Analytics and/or Software development, or equivalent work experience
- Proven experience with:
- Building out data pipelines using various technologies
- Engaging on all aspects of the ETL process
- Bonus points for:
- Knowledge and experience in the Financial Services industry, Fintech and/or Payments industry
- Previous experience in cross-departmental project/task coordination and delivery
- A competitive salary
- 30 days of annual leave
- A medical aid contribution/fringe benefit of up to R2 000 per month
- An Apple MacBook and the necessary gear
- A trendy office space with huddle rooms, a cafe, bean bags and all the equipment youll need
- Discretionary annual bonus
- Flexible office/remote working - you get to choose whether you want to work remotely or from the office, depending on the importance of critical in-person meetings.
- Paid undercover parking (when working from the office) or city parking reimbursement when the office parking is full.
- The opportunity to be part of a great team and culture
- Lots of opportunities to learn
- Mental health days