Our client is a leading South African financial technology company. They deliver financial services to consumers (B2C) and merchants (B2B) in Southern Africa through their proprietary banking and payment technologies. The company offers banking, lending and insurance products to consumers and cash management solutions, bill payment technologies, value-added services, business funding and card acquiring solutions to formal and informal retail merchants.
Description:
The Data Engineer is primarily responsible for development, enhancement, troubleshooting and maintenance services on both on-premises (Microsoft SQL Server) and cloud data systems. You will need to have a sound understanding of relational database management systems, system analysis and design and data modelling. You will need to have working experience (5 years+) and competency with the Microsoft BI stack primarily SSIS, SSRS and T-SQL development. You will be required to upskill and learn the Google cloud services platform stack and assist with cloud migration of on-premise reports.
Experience required:
- Understanding of concepts related to RDBMS (Atomicity, transactions, Isolation levels, concurrency, locking, blocking)
- Data modelling for OLTP system (normalization, ERDs, Interaction diagrams)
- At least 5 years of experience with the Microsoft BI Stack (SSIS, SSRS and SQL-server)
- At least 5 years of experience with T-SQL development
- Using SQL query execution plan
- Optimizing code using indexes, partitioning, refactoring code, redesigning tables etc.
- Normalizing de-normalized tables to 3NF
- Working in an Agile environment
- Creating complex ETL processes using SSIS or similar tool
- Software development (any optional of Python, java, C# or C++)
- System analysis and design
- Good software development principles (abstraction, decomposition - modularizing code, developing for reuse, commenting appropriately, choosing appropriate data types, quantifying and managing complexity, writing simple readable code)
- Responding to issues ickets related to support of existing systems
- Developing new reports on both on-premises and cloud systems
- Upskilling on cloud services used by the Data Engineering team
- Supporting on-premises system
- Developing high performing stored procedures using T-SQL
- Troubleshooting issues that arise on data systems (on-premises and cloud)
- Developing and automating complex ETL processes
- Adhering to development standards and naming conventions
- Update tasks on Jira
- Understanding SQL execution plan
- Optimizing code, developing indexes etc.
- Working well with team members within and outside of your team to deliver on tasks
- Communicating progress with Scrum master and other stakeholders
- Understanding payment processes and data
- Delivering within SLAs and agreed timelines.
- Research and Introduce DB tools that are available outside Microsoft, e.g., MongoDB, etc.
- Should be willing to do Standby, standby process will be discussed and explained in interview.
- Communication skills (written and verbal) in English
- Analytical, diagnostic and problem-solving skills
- Business acumen
- Process and organizational thinking
- Attention to detail
- Adaptability to change
- Willingness to take ownership and accountability
- Ability to work under own initiative without guidance, cope well under sustained pressure and deliver to deadlines
- Ability to deal with multiple projects at the same time
