Data Engineer - AWS and Redshift
A group providing value conscious mass-marketing to customers in Southern Africa and leaders in providing innovative financial services have an opportunity for a data engineer who will take responsibility for driving, designing and building scalable ETL systems for a big data warehouse to implement robust and trustworthy data to support high performing ML algorithms, predictive models and support real-time data visualisation requirements across the organisation to enable self-help analytics.
Responsibilities:- Systematic solution design of the ETL and data pipeline in line with business user specifications
- Develop and implement ETL pipelines aligned to the approved solution design
- Ensure data governance and data quality assurance standards are upheld
- Create easily understandable technical documentation that are kept up to date
- Conduct data design, database architecture, metadata and repository creation
- Translates business needs into long-term architecture solutions
- Define, design and build dimensional databases
- In-depth knowledge and experience of Retail SAP architecture
- Strong networks and knowledge of emerging trends across Data/Analytics (Big Data, Machine Learning, Deep Learning, AI)
- Responsible for developing data warehousing blueprints, evaluating hardware and
- Enhance and maintain our existing ETL frameworks in line with agreed design
- Ensure data is precise and is benchmarked and validated against financial records
Qualifications and experience- Three year IT related degree postgraduate qualification (advantageous)
- Five + years’ experience and understanding in designing and developing data warehouses
- Adept at design and development of ETL processes. SQL development experience, preferably SAS data studio and AWS experience
- The ability to ingest/output CSV, JSON and other flat file types and any related data sources.
- Proficient in Python or R or willingness to learn.
- Expert knowledge of complex IT
- Knowledge of technology and SDLC and Agile methodology
- Knowledge of retail industry data models
- Advanced knowledge of compliance and IT governance
- General SAS experience
The reference number for this position is
NG59281 which is a
remote, contract position, offering a rate of
R500 to R700 per hour, salary negotiable based on experience. E-mail
Nokuthula on
az.oc.egrem-e@galuhtukon or call her for a chat on
011 463 3633 to discuss this and other opportunities.
Are you ready for a change of scenery? E-Merge IT recruitment is a niche recruitment agency. We offer our candidates options so that we can successfully place the right people with the right companies, in the right roles. Check out the E-Merge IT website
www.e-merge.co.za for more great positions.
Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!
Posted on 12 Jun 11:52, Closing date 11 Aug
