Data Engineer - AWS and Redshift
Location: | Remote |
Remote work: | Only remote work |
Type: | Contract |
Reference: | #NG59281 |
Company: | E-Merge IT Recruitment |
A group providing value conscious mass-marketing to customers in Southern Africa and leaders in providing innovative financial services have an opportunity for a data engineer who will take responsibility for driving, designing and building scalable ETL systems for a big data warehouse to implement robust and trustworthy data to support high performing ML algorithms, predictive models and support real-time data visualisation requirements across the organisation to enable self-help analytics.
Responsibilities:
- Systematic solution design of the ETL and data pipeline in line with business user specifications
- Develop and implement ETL pipelines aligned to the approved solution design
- Ensure data governance and data quality assurance standards are upheld
- Create easily understandable technical documentation that are kept up to date
- Conduct data design, database architecture, metadata and repository creation
- Translates business needs into long-term architecture solutions
- Define, design and build dimensional databases
- In-depth knowledge and experience of Retail SAP architecture
- Strong networks and knowledge of emerging trends across Data/Analytics (Big Data, Machine Learning, Deep Learning, AI)
- Responsible for developing data warehousing blueprints, evaluating hardware and
- Enhance and maintain our existing ETL frameworks in line with agreed design
- Ensure data is precise and is benchmarked and validated against financial records
- Three year IT related degree postgraduate qualification (advantageous)
- Five + years’ experience and understanding in designing and developing data warehouses
- Adept at design and development of ETL processes. SQL development experience, preferably SAS data studio and AWS experience
- The ability to ingest/output CSV, JSON and other flat file types and any related data sources.
- Proficient in Python or R or willingness to learn.
- Expert knowledge of complex IT
- Knowledge of technology and SDLC and Agile methodology
- Knowledge of retail industry data models
- Advanced knowledge of compliance and IT governance
- General SAS experience
Are you ready for a change of scenery? E-Merge IT recruitment is a niche recruitment agency. We offer our candidates options so that we can successfully place the right people with the right companies, in the right roles. Check out the E-Merge IT website www.e-merge.co.za for more great positions.
Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!
Posted on 12 Jun 11:52, Closing date 11 Aug
Plant Engineer - Automotive
Our client in the automotive industry is looking for a plant engineer in the Eastern Cape, Port Elizabeth area. Requirements: Degree/diploma in electrical...
Senior Data Development Engineer
A diversified healthcare company with a focus on health administration has a role for a data development engineer.
AWS Data Engineer
Pioneers in harnessing the power of artificial intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide whose and vision...
Senior Azure Data Engineer
A long serving bank known as Africa's biggest lender of assets and financial services group committed to providing banking insurance and asset management services have...
CA User Data Engineer
A Global company with a focus on innovation topics as well as comprehensive IT solutions such as Development and Operations is looking for a CA User Data Engineer.
AWS Data Engineer
A diversified financial services group, listed on the Johannesburg Stock Exchange and is one of South Africa’s leading direct distributors of financial service...
AWS Data Engineer
Pioneers in harnessing the power of artificial intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide whose and vision...
Senior Data Development Engineer
A diversified healthcare company with a focus on health administration has a role for a Data Development Engineer.
Civil Engineer
Limpopo-based client is seeking a highly skilled and experienced Civil Engineer. Requirements: Degree in Civil EngineeringEPWP NQF 7ECSA RegisteredSACPCMP...
Data Engineer
Join a dynamic team at a major telecommunications company in Johannesburg as a data engineer.
Software Quality Engineer
Software Quality Engineer | Hybrid (JHB, Northern Suburbs) | Permanent Job purpose Use the automation test kit (frameworks and pre-defined test tools) to inspect...
Salesforce Engineer
Requirements: A bachelor's degree in computer science, information technology, or a related fieldA minimum of five + years experience as a Salesforce...
AWS Data Engineer
Pioneers in harnessing the power of artificial intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide whose and vision...
Senior Azure Data Engineer
An autonomous Namibian bank, providing superior financial services to individual and corporate clients as well as international banking services by liaising directly...
AWS Data Engineer
An AWS Advanced partner that augments and accelerates organisational capabilities with agile, modern, data-driven solutions and services built according to well...
AWS Data Engineer
Our valued client, a leader in African capital markets and a powerhouse in the automotive industry, is renowned for its diverse product offerings and global reach.
Data Engineer
Join a dynamic team at a major telecommunications company in Johannesburg as a data engineer.
Python AWS Software Engineer
Are you looking for a new opportunity with enhance your Python and AWS skills? If so apply now. Requirements: Relevant IT /engineering degree5 to 7...
Python AWS Software Engineer
Are you looking for a new opportunity with enhance your Python and AWS skills? If so apply now. Requirements: Relevant IT / engineering degree3-5...
Sales Engineer
Our client is a progressive engineering firm specialising in construction, consulting, and Independent Power Producer (IPP) services.
Junior Sales Engineer
Our client is a progressive engineering firm specialising in construction, consulting, and independent power producer (IPP) services.
Java System Integration Engineer
Become a member of a team enthusiastic about the challenges posed by integrating complex systems comprising diverse components and subsystems currently in search for...
Senior Java Software Engineer
SA’s most reputable software engineering business is on the lookout for a brilliant senior Java software engineer to join their exciting team.
Senior Full Stack Java Software Engineer
We are in search of a skilled and seasoned senior full stack Java software engineer to become a valuable member of our forward-thinking team.
JavaScript React Software Engineer
A leading international manufacturing concern are looking for a software engineer to join their team.
JavaScript Engineer
An opportunity to work with experts in software development as a JavaScript Engineer is available.
Java Software Engineer – Cloud and DevOps
An amazing opportunity for a software engineer (Cloud, Java SE11, DevOps) to join a leading Africa-focused financial services organisation is available.
Software Java Engineer
Amazing chance to join independent software engineering specialists that have emerged as a leader in designing, building and implementing Cloud-based, hybrid and...
Senior Java Software Engineer
Do you want to join a team of highly skilled, experienced and passionate technologists? Become a part of a leading software development team that focuses on doing what...
Software Engineer – Java/DevOps/Cloud
A leading Africa-focused financial services organisation has a new opportunity available for software engineer - Java SE11, SDLC, DevOps, Cloud to join their global team.